This paper presents a novel approach for silhouette extraction from multi-viewpoint images. The main contribution of this paper is a new algorithm for 1) 3D context-aware error detection and correction of 2D multi-viewpoint silhouette extraction and 2) 3D context-aware classification of cast-shadow regions. Some experiments demonstrate advantages against previous approaches.