Interactive behaviors of panel and joint at non-diaphragm CHS-column to H-beam connection were experimentally investigated. Herein, the panel indicates the cylindrical part surrounded by the outward forms of beam and column intersecting at right angles, and the joint indicates the seam between column surface and beam end. Two types of specimens were tested: one is an X-shaped frame in that the panel is subjected to shear resulting from a pair of anti-symmetric bending moments at beam ends, and the other is a 3-point bending specimen in that the panel is free from shear because of a pair of symmetric moments. It was found that the joint strength of non-diaphragm connection is little influenced by the shear in the panel, while its joint stiffness is significantly different between anti-symmetric and symmetric moments that is simply owing to the elastic action not to the panel shear.