We present results of specific heat measurements on a Ce3Pd20Si6 single crystal and construct the magnetic phase diagram for the three cubic principal directions [100], [110] and [111]. The highly anisotropic phase diagram is discussed and can be qualitatively explained by the Zeeman splitting at the 8c-site. For B parallel to [100], the present study found two different quadrupolar ordered phases, which meet the paramagnetic phase at a tri-critical point and establish the new phase boundaries.