The association between BMI and all-cause mortality may vary with gender, age, and ethnic groups. However, few prospective cohort studies have reported the relationship in older Asian populations. We evaluated the association between BMI and all-cause mortality in a cohort comprised 26,747 Japanese subjects aged 65-79 years at baseline (1988-1990). The study participants were followed for an average of 11.2 years. Proportional-hazards regression models were used to estimate mortality hazard ratios (HRs) and 95% confidence intervals. Until 2003, 9,256 deaths occurred. The underweight group was associated with a statistically higher risk of all-cause mortality compared with the mid-normal-range group (BMI: 20.0-22.9); resulting in a 1.78-fold (95% confidence interval: 1.45-2.20) and 2.55-fold (2.13-3.05) increase in mortality risk among severest thin men and women (BMI: <16.0), respectively. Even within the normal-range group, the lower normal-range group (BMI: 18.5-19.9) showed a statistically elevated risk. In contrast, being neither overweight (BMI: 25.0-29.9) nor obese (BMI: >= 30.0) elevated the risk among men; however among women, HR was slightly elevated in the obese group but not in the overweight group compared with the mid-normal-range group. Among Japanese older adults, a low BMI was associated with increased risk of all-cause mortality, even among those with a lower normal BMI range. The wide range of BMI between 20.0 and 29.9 in both older men and women showed the lowest all-cause mortality risk.