<jats:p> We have systematically studied magnetotransport properties in van der Waals (vdW) magnetic materials, (Fe<jats:sub>1− x</jats:sub>Co<jats:sub> x</jats:sub>)<jats:sub>5</jats:sub>GeTe<jats:sub>2</jats:sub>, where the magnetic phase changes from the ferromagnetic with the perpendicular magnetic anisotropy (PMA; [Formula: see text]) or with the in-plane magnetic anisotropy (IMA; x = 0.19) to the antiferromagnetic ( x = 0.46) with the PMA. We have demonstrated that such magnetic properties seen in bulk still remain even in thin film devices. An anomalous Hall resistance with magnetic hysteresis was clearly observed in the low Co substitution ([Formula: see text]). The anomalous Hall effect was still observable for x = 0.19, but the magnetic hysteresis vanishes because of the IMA. In the antiferromagnetic region, there was no anomalous Hall effect in the low magnetic field range, but a clear hysteresis was observed at 2.5 T where the spin–flop transition takes place. This hysteresis can be seen only below 30 K and monotonically decreases with increasing temperature. We argue that the defects at a specific site in this system and also the resistance upturn below 30 K could be related to the hysteric behavior at the spin–flop transition. Our findings provide a recipe for the use of (Fe<jats:sub>1− x</jats:sub>Co<jats:sub> x</jats:sub>)<jats:sub>5</jats:sub>GeTe<jats:sub>2</jats:sub> with different Co substitutions to construct vdW magnetic devices. </jats:p>