Indirect palpation is required to examine lots of cases like breast cancer and prostate malignance. This paper proposes interaction model between elastic objects to simulate indirect palpation. The interaction is simulated by displacement of colliding elements based on normal stress derived from temporary displacement. The physics-based approach represents the difference of physical properties such as stiffness of colliding objects. Deformation and haptic reproduction is possible to be carried out in real time with two organ models consisting of roughly 200 nodal points. As an example, we developed a rectal palpation simulator based on the proposed method. The experiment using rectal palpation simulator confirmed that the method enables a user to perceive difference of stiffness of prostate model located behind rectum model indirectly.