In plants, F1 hybrids showing hybrid weakness exhibit weaker growth than their parents. The phenotypes of hybrid weakness are often suppressed at certain temperatures. However, it is unclear whether hybrid weakness in Capsicum annuum × C. chinense is temperature-dependent or not. Our study showed that Capsicum hybrid weakness was suppressed at 30 and 35 °C and was induced at 15, 20, and 25 °C. Moreover, we investigated the time course of hybrid weakness in cell death, metabolite content, and gene expression in leaves of plants transferred to 20 °C after growing at 30 °C for 21 days. The expression of pathogen defense-related genes was upregulated at 1 day after transfer to 20 °C (DAT). Cell death was detected at 7 DAT, plant growth had almost stopped since 14 DAT, and sugars were accumulated at 42 DAT in hybrid plants. The study revealed that some sugar transporter genes, which had been upregulated since 7 DAT, were involved in sugar accumulation in Capsicum hybrid weakness. Thus, our results demonstrated that gene expression changes occur first, followed by physiological and morphological changes after induction of hybrid weakness. These responses observed in this study in Capsicum hybrid weakness are likely to be owed to plant defense responses-like reactions.