論文

査読有り 本文へのリンクあり
2022年3月2日

Pix2Pix-Based Monocular Depth Estimation for Drones with Optical Flow on AirSim

Sensors
  • Tomoyasu Shimada
  • ,
  • Hiroki Nishikawa
  • ,
  • Xiangbo Kong
  • ,
  • Hiroyuki Tomiyama

22
6
開始ページ
2097
終了ページ
2097
記述言語
掲載種別
研究論文(学術雑誌)
DOI
10.3390/s22062097

In this work, we propose a method for estimating depth for an image of a monocular camera in order to avoid a collision for the autonomous flight of a drone. The highest flight speed of a drone is generally approximate 22.2 m/s, and long-distant depth information is crucial for autonomous flights since if the long-distance information is not available, the drone flying at high speeds is prone to collisions. However, long-range, measurable depth cameras are too heavy to be equipped on a drone. This work applies Pix2Pix, which is a kind of Conditional Generative Adversarial Nets (CGAN). Pix2Pix generates depth images from a monocular camera. Additionally, this work applies optical flow to enhance the accuracy of depth estimation. In this work, we propose a highly accurate depth estimation method that effectively embeds an optical flow map into a monocular image. The models are trained with taking advantage of AirSim, which is one of the flight simulators. AirSim can take both monocular and depth images over a hundred meter in the virtual environment, and our model generates a depth image that provides the long-distance information than images captured by a common depth camera. We evaluate accuracy and error of our proposed method using test images in AirSim. In addition, the proposed method is utilized for flight simulation to evaluate the effectiveness to collision avoidance. As a result, our proposed method is higher accuracy and lower error than a state of work. Moreover, our proposed method is lower collision than a state of work.

リンク情報
DOI
https://doi.org/10.3390/s22062097
DBLP
https://dblp.uni-trier.de/rec/journals/sensors/ShimadaNKT22
Scopus
https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85125896362&origin=inward 本文へのリンクあり
Scopus Citedby
https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=85125896362&origin=inward
URL
https://dblp.uni-trier.de/db/journals/sensors/sensors22.html#ShimadaNKT22
ID情報
  • DOI : 10.3390/s22062097
  • ISSN : 1424-8220
  • DBLP ID : journals/sensors/ShimadaNKT22
  • SCOPUS ID : 85125896362

エクスポート
BibTeX RIS