© 1983-2012 IEEE. We present a new design approach of shape and topology optimization utilizing the full-vectorial beam propagation method (FV-BPM) so as to achieve efficient design for high-refractive-index contrast optical waveguides and devices based on gradual mode-evolution. In our design approach, material distribution is represented via normalized density parameters, and these design parameters are updated with sensitivity computed based on an adjoint variable method (AVM). The sensitivity analysis method and the design procedure are offered in the specific case where the density method, the AVM, and the FV-BPM based on an alternative direction implicit method (AIDM) are employed. The applicability of our design approach is numerically studied by designing high-refractive-index contrast photonic components which induce polarization rotation: a TM0-to-TE1 mode order converter and a polarization rotator. The results of the design examples indicate that our approach has potential to be suitable for efficient initial design of optical devices based on gradual mode-evolution.