論文

査読有り
2011年6月

Display-camera calibration using eye reflections and geometry constraints

COMPUTER VISION AND IMAGE UNDERSTANDING
  • Christian Nitschke
  • ,
  • Atsushi Nakazawa
  • ,
  • Haruo Takemura

115
6
開始ページ
835
終了ページ
853
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.1016/j.cviu.2011.02.008
出版者・発行元
ACADEMIC PRESS INC ELSEVIER SCIENCE

In this paper, we describe a novel method for calibrating display-camera setups from reflections in a user's eyes. Combining both devices creates a capable controlled illumination system that enables a range of interesting vision applications in non-professional environments, including object/face reconstruction and human computer interaction. One major issue barring such systems from average homes is the geometric calibration to obtain the pose of the display which requires special hardware and tedious user interaction. Our proposed approach eliminates this requirement by introducing the novel idea of analyzing screen reflections in the cornea of the human eye, a mirroring device that is always available. We employ a simple shape model to recover pose and reflection characteristics of the eye. Thorough experimental evaluation shows that the basic strategy results in a large error and discusses possible reasons. Based on the findings, a non-linear optimization strategy is developed that exploits geometry constraints within the system to considerably improve the initial estimate. It further allows to automatically resolve an inherent ambiguity that arises in image-based eye pose estimation. The strategy may also be integrated to improve spherical mirror calibration. We describe several comprehensive experimental studies which show that the proposed method performs stably with respect to varying subjects, display poses, eye positions, and gaze directions. The results are feasible and should be sufficient for many applications. In addition, the findings provide general insight on the application of eye reflections for geometric reconstruction. (C) 2011 Elsevier Inc. All rights reserved.

リンク情報
DOI
https://doi.org/10.1016/j.cviu.2011.02.008
Web of Science
https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=JSTA_CEL&SrcApp=J_Gate_JST&DestLinkType=FullRecord&KeyUT=WOS:000290831100009&DestApp=WOS_CPL
ID情報
  • DOI : 10.1016/j.cviu.2011.02.008
  • ISSN : 1077-3142
  • eISSN : 1090-235X
  • Web of Science ID : WOS:000290831100009

エクスポート
BibTeX RIS