Fructooligosaccharides (FOS) are considered as prebiotics and are well known for their health-promoting properties, including antitumor, allergy-preventive, and infection-protective effects. They exert these effects by modulating the gut microbial composition and dynamics. In the present study, we performed a comparative whole metagenome shotgun sequencing analysis (WMGS) to elucidate the gut microbiota and secretary Immunoglobulin A (SIgA) dynamics as a result of 5% (w/w) FOS supplementation over a period of 7 days (fecal samples were collected every day). A number of taxa including Bacteroides, Lactobacillus, Roseburia, Clostridia, Faecalibaculum, and Enterorhabdus were found to be modulated with SIgA production in the murine gut. The process of SIgA production from FOS metabolization was found to be carried out via the production of short-chain fatty acids in the gut. Species of Bacteroides and Roseburia; namely, B. caccae, B. finegoldii, B. ovatus, B. thetaiotamicron, and Roseburia intestinalis, respectively, are predominantly responsible for FOS metabolization in the murine gut. The abundances of these bacterial species and their corresponding functions involved in FOS metabolization decreased over time even though these prebiotics were administered continuously for seven days. This suggests that there is a decrease in FOS metabolization over time. In addition, the present analysis suggests that the administration of FOS may help to reduce the pathogenic bacteria from the gut via SIgA production. Supplementary Information: The online version contains supplementary material available at 10.1007/s13205-022-03116-3.