In order to examine to what extent the rigid-band-like electron doping scenario is applicable to the transition metal-substituted Fe-based superconductors, we have performed angle-resolved photoemission spectroscopy studies of Ba(Fe1-xNix)(2)As-2 (Ni-122) and Ba(Fe1-xCux)(2)As-2 (Cu-122), and compared the results with Ba(Fe1-xCox)(2)As-2 (Co-122). We find that Ni 3d-derived features are formed below the Fe 3d band and that Cu 3d-derived ones further below it. The electron and hole Fermi surface (FS) volumes are found to increase and decrease with substitution, respectively, qualitatively consistent with the rigid-band model. However, the total extra electron number estimated from the FS volumes (the total electron FS volume minus the total hole FS volume) is found to decrease in going from Co-, Ni-, to Cu-122 for a fixed nominal extra electron number, that is, the number of electrons that participate in the formation of FS decreases with increasing impurity potential. We find that the Neel temperature T-N and the critical temperature T-c maximum are determined by the FS volumes rather than the nominal extra electron concentration or the substituted atom concentration. DOI: 10.1103/PhysRevLett.110.107007