We demonstrate successful cooling of ultrathin fiber tapers and their coupling with nitrogen vacancy (NV) centers in nanodiamonds at cryogenic temperatures. Nanodiamonds containing multiple NV centers are deposited on ultrathin fiber tapers with diameters ranging from 450-500 nm. The fiber tapers were successfully cooled down to 9 K with our special fiber mount and an optimization of cooling speed. The fluorescence coupled with the fiber tapers showed characteristic sharp zero-phonon lines of neutral and negatively charged NV centers. The present demonstration is important for the future NV-based quantum information devices and sensitive nanoscale cryogenic magnetometry.