We present a fiber-coupled diamond-based single photon system. Single nanodiamonds containing nitrogen vacancy defect centers are deposited on a tapered fiber of 273 nanometer in diameter providing a record-high number of 689,000 single photons per second from a defect center in a single-mode fiber. The system can be cooled to cryogenic temperatures and coupled evanescently to other nanophotonic structures, such as microresonators. The system is suitable for integrated quantum transmission experiments, two-photon interference, quantum-randomnumber generation and nano-magnetometry. © 2012 Optical Society of America.