Little is known about the spatiotemporal dynamics of gray wolves in the Pleistocene across low-latitude regions of Eurasia. In Japan, a small-bodied endemic subspecies of Japanese wolves existed and went extinct in the early 1900s. The fossil record indicates that a giant wolf, which reached 70 cm in body height, inhabited Japan during the Pleistocene, but its evolutionary relationship, if any, with the Japanese wolf remains uncertain. Here, to reveal the genetic origin of the Japanese wolf, we analyzed ancient DNA from remains (recovered in Japan) of one Pleistocene wolf that lived 35,000 years ago and one Holocene wolf from 5,000 years ago. The analysis of the mitochondrial DNA revealed that the Pleistocene wolf was not part of the Japanese wolf clade but rather an earlier-diverging lineage. The analysis of the nuclear DNA of the Holocene Japanese wolf revealed that it was an admixture of the Japanese Pleistocene wolf and continental wolf lineages. These findings suggest that the Japanese wolf originated via waves of colonization of multiple Pleistocene wolf populations at 57-35 and 37-14 ka, respectively, followed by interpopulation hybridization.