Ocular dominance plasticity is easily observed during the critical period in early postnatal life. Chondroitin sulfate (CS) is the most abundant component in extracellular structures called perineuronal nets (PNNs), which surround parvalbumin-expressing interneurons (PV-cells). CS accumulates in PNNs at the critical period, but its function in earlier life is unclear. Here, we show that initiation of ocular dominance plasticity was impaired with reduced CS, using mice lacking a key CS-synthesizing enzyme, CSGalNAcT1. Two-photon in vivo imaging showed a weaker visual response of PV-cells with reduced CS compared to wild-type mice. Plasticity onset was restored by a homeoprotein Otx2, which binds the major CS-proteoglycan aggrecan and promotes its further expression. Continuous CS accumulation together with Otx2 contributed bidirectionally to both onset and offset of plasticity, and was substituted by diazepam, which enhances GABA function. Therefore, CS and Otx2 may act as common inducers of both onset and offset of the critical period by promoting PV-cell function throughout the lifetime.