Transports of secondary cosmic-ray neutrons and muons in a building and a stacked server are simulated by Particle and Heavy Ion Transport code System (PHITS) with considering distributions of energy and zenith-angle of secondary cosmic-rays by PHITS based analytical radiation model in the atmosphere (PARMA) model. The calculated neutron fluxes are in surprisingly good agreement with measured data. Soft errors in an n-type metal-oxide-semiconductor field-effect transistor caused by secondary cosmic-ray neutron and muon in the open air and on the first floor of the building are analyzed based on the multiple sensitive volume (MSV) model using PHITS. It is found that the secondary cosmic-ray neutron-induced SER decrease by shielding effect of the building while that caused by secondary cosmic-ray muons is not affected.