© 2017 Author(s). To detect the absolute magnetic field, such as the earth’s magnetic field, a linear magnetic response, a zero point, and thermal stability are required. We thus propose an operating method and sensor probe consisting of a nanogranular in-gap magnetic sensor (GIGS), an operational amplifier integrated circuit, and a modulation coil. The sensor probe was operated in second-harmonic mode at a liquid-nitrogen (Liq. N2) temperature. When an AC magnetic field was applied to GIGS, the second-harmonic signal was generated and modulated by the outer magnetic field to be measured. After lock-in detection, the modulated output signal showed good linearity and a zero point. Moreover, higher sensitivity and low noise with low thermal fluctuation was obtained by the cooling at Liq. N2 temperature.