Grain-filling ability is one of the factors that controls grain yield in rice (Oryza sativa L.). We developed a method for describing grain weight distribution, which is the probability density function of single grain weight in a panicle, using 128 Japanese rice varieties. With this method, we quantitively analyzed genotypic differences in grain-filling ability and used the grain weight distribution parameters for genomic prediction subject to genetic improvement in grain yield in rice. The novel description method could represent the observed grain weight distribution with five genotype-specific parameters of a mixture of two gamma distributions. The estimated genotype-specific parameters representing the proportion of filled grains had applicability to explain the grain filling ability of genotypes comparable to that of sink-filling rate and the conventionally measured proportion of filled grains, which suggested the efficiency and flexibility of grain weight distribution parameters to handle several genotypes. We revealed that perfectly filled grains have to be prioritized over partially filled grains for the optimum allocation of the source of yield in a panicle, from the analysis for obtaining an ideal shape of grain weight distribution. We conducted genomic prediction of grain weight distribution considering five genotype-specific parameters of the distribution as phenotypes relating to grain filling ability. The proportion of filled grains, average weight of filled grains, and variance of filled grain weight, which were considered to control grain yield to a certain degree, were predicted with accuracies of 0.30, 0.28, and 0.53, respectively. The proposed description method of grain weight distribution facilitated not only the investigation of the optimum allocation of nutrients in a panicle for realizing high grain-filling ability, but also allowed genomic selection of grain weight distribution.