The characterization of microbial communities that promote or suppress soil-borne pathogens is important for controlling plant diseases. We compared prokaryotic communities in soil with or without the signs of tomato bacterial wilt caused by Ralstonia solanacearum. Soil samples were collected from a greenhouse at two different depths because this pathogen is present in deep soil. We used samples from sites in which we detected phcA, a key gene regulating R. solanacearum pathogenicity. The pyrosequencing of prokaryotic 16S rRNA sequences in four soil samples without disease symptoms but with phcA and in two soil samples with disease symptoms indicated that community richness was not significantly different between these two soils; however, microbial diversity in the lower soil layer was higher in soil samples without disease symptoms but with phcA. A difference in prokaryotic community structures between soil samples with and without bacterial wilt was only observed in the upper soil layer despite apparent similarities in the communities at the phylum level. Proteobacteria, Acidobacteria, Chloroflexi, Verrucomicrobia, and several Archaea were more abundant in soil samples without disease symptoms, whereas taxa in another eight phyla were more abundant in soil samples with disease symptoms. Furthermore, some prokaryotic taxa were abundant specifically in the lower layer of soil, regardless of whether disease was present. These prokaryotic taxa may suppress or accelerate the pathogenesis of bacterial wilt and are good targets for future studies on disease control.