The effects of anisotropic thermal conductivity due to the crystallographic-preferred orientation (CPO) of olivine in the mantle wedge on the steady-state thermal structure of the Tohoku subduction zone, Northeast Japan, are investigated using geodynamic modeling. Four different olivine crystal fabrics are modeled based on theoretical CPO development in the mantle wedge: random (i.e., isotropic thermal conductivity), A-type, C-type, and E-type fabrics. The thermal conductivity in the mantle wedge is highly anisotropic in the regions just above the descending slab and near the base of the overriding plate. The obtained temperature differences between the anisotropic and isotropic cases are only up to 30 °C within the slab. Therefore, the impact of anisotropic thermal conductivity on the slab temperature may be limited when anisotropy is only considered in the mantle wedge.