Real-time Accurate Runway Detection based on Airborne Multi-sensors Fusion

  • Lei Zhang School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an, 710 072
  • Yue Cheng School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an, 710 072
  • Zhengjun Zhai School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an, 710 072
Keywords: Runway detection, airborne multi-sensors fusion, coordinate transformation, EDLines, line segments linking

Abstract

Existing methods of runway detection are more focused on image processing for remote sensing images based on computer vision techniques. However, these algorithms are too complicated and time-consuming to meet the demand for real-time airborne application. This paper proposes a novel runway detection method based on airborne multi-sensors data fusion which works in a coarse-to-fine hierarchical architecture. At the coarse layer, a vision projection model from world coordinate system to image coordinate system is built by fusing airborne navigation data and forward-looking sensing images, then a runway region of interest (ROI) is extracted from a whole image by the model. Furthermore, EDLines which is a real-time line segments detector is applied to extract straight line segments from ROI at the fine layer, and fragmented line segments generated by EDLines are linked into two long runway lines. Finally, some unique runway features (e.g. vanishing point and runway direction) are used to recognise airport runway. The proposed method is tested on an image dataset provided by a flight simulation system. The experimental results show that the method has advantages in terms of speed, recognition rate and false alarm rate.

Author Biographies

Lei Zhang, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an, 710 072
Mr Lei Zhang received the BS (Computer Science) from Xi’an Jiao Tong University, in 2001, and MS from China Aviation Academe, in 2011. Now he is a senior engineer in Xi’an Aeronautic Computing Technique Research Institute, and also pursuing his PhD in Computer Science and Technology at Northwestern Polytechnical University. His research interests include : Computer vision, image processing and vision based navigation in airborne system.
Yue Cheng, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an, 710 072
Dr Yue Cheng received the BS and PhD in Electronic Engineering from Zhejiang University, in 2008 and 2013, respectively. And post doctor from Northwestern Polytechnical University, in 2014. Currently working as a senior engineer in Xi’an Aeronautic Computing Technique Research Institute. His research interests include : Computer vision and augmented reality in airborne system.
Zhengjun Zhai, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an, 710 072
Prof. Zhengjun Zhai received his BS (Information System Engineering) and MS (Computer Science and Technology) from Northwestern Polytechnical University, in 1985 and 1988, respectively. Now he is the Director of Computer Measurement and Control and Simulation Technology Institute in Northwestern Polytechnical University. His research interests include : Information processing, embedded system and avionics system.
Published
2017-09-19
How to Cite
Zhang, L., Cheng, Y., & Zhai, Z. (2017). Real-time Accurate Runway Detection based on Airborne Multi-sensors Fusion. Defence Science Journal, 67(5), 542-550. https://doi.org/10.14429/dsj.67.10439
Section
Computers & Systems Studies