Global histone hyperacetylation is suggested to play a critical role for replacement of histones by transition proteins and protamines to compact the genome during spermiogenesis. However, the underlying mechanisms for hyperacetylation-mediated histone replacement remains poorly understood. Here, we report that EPC1 and TIP60, two critical components of the mammalian nucleosome acetyltransferase of H4 (NuA4) complexes, are coexpressed in male germ cells. Strikingly, genetic ablation of either Epc1 or Tip60 disrupts hyperacetylation and impairs histone replacement, in turn causing aberrant spermatid development. Taking these observations together, we reveal an essential role of the NuA4 complexes for histone hyperacetylation and subsequent compaction of the spermatid genome.