Undelayed Initialization Using Dual Channel Vision for Ego-Motion in Power Line Inspection

WU Hua; WU Yanxiong; LIU Changan; YANG Guotian; LI Zhichen

doi:10.1049/cje.2016.01.006

Volume 25 Issue 1

Turn off MathJax

Article Contents

Article Navigation > Chinese Journal of Electronics > 2016 > 25(1): 33-39

WU Hua, WU Yanxiong, LIU Changan, et al., “Undelayed Initialization Using Dual Channel Vision for Ego-Motion in Power Line Inspection,” Chinese Journal of Electronics, vol. 25, no. 1, pp. 33-39, 2016, doi: 10.1049/cje.2016.01.006

Citation:

WU Hua, WU Yanxiong, LIU Changan, et al., “Undelayed Initialization Using Dual Channel Vision for Ego-Motion in Power Line Inspection,” Chinese Journal of Electronics, vol. 25, no. 1, pp. 33-39, 2016, doi: 10.1049/cje.2016.01.006

Citation:

PDF( 870 KB)

Undelayed Initialization Using Dual Channel Vision for Ego-Motion in Power Line Inspection

doi: 10.1049/cje.2016.01.006

1.
School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, China;
2.
Department of Disaster Prevention Apparatus, Institute of Disaster Prevention Science and Technology, Hebei 101601, China;
3.
China North Industries Corporation, Beijing 100821, China

Funds: This work is supported by the National Natural Science Foundation of China (No.61105083), Program for New Century Excellent Talents in University (No.NCET-11-0634), the Fundamental Research Funds for the Central Universities (No.12ZX16), and the Program of the Co-construction with Beijing Municipal of China (No.GJ2013005).

Received Date: 2015-02-27
Rev Recd Date: 2015-05-05
Publish Date: 2016-01-10

Abstract

Abstract

This paper presents a novel approach to the initialization of an ego-motion estimation technique for autonomous power line inspection. Dual channel vision, consisting of an infrared and optical camera, is typically adopted during inspection. The infrared camera is far more proficient at reliably detecting heated regions of the power tower which can be regarded as a prior relationship between the tower and cameras. Using the infrared camera, which is equipped parallel to the optical camera, an incomplete correspondence between the optical image and a 3D CAD model is established. Depending on the degree of correspondence, the initial pose of the CAD model in the optical image is estimated through two stages of coarse-to-fine estimation. The primary contributions of this paper include: 1) using dual vision for partial initialization; 2) incorporating two-stage algorithms to estimate an accurate pose quickly; 3) implementing an algorithm which functions correctly regardless of the motion blur or background texture. Experimental results consistently show that the initial pose can be estimated efficiently and robustly.
- Undelayed initialization,
- 3D model,
- Ego-motion,
- Infrared and optical cameras,
- Power line inspection,
- Drones

FullText(HTML)

References(25)

References

D. Jones and G. Earp, “Requirements for aerial inspection of overhead electrical power lines”, Proceedings of the 12th Int Conf Remotely Piloted Vehicles, Bristol, U.K., 1996.

L. Ma and Y.Q. Chen, “ Aerial surveillance system for overhead power line inspection”, Logan: Center for Self-Organizing and Intelligent Systems (CSOIS), Utah State Univ., 2000.

P. Campoy, P. Garcia, A. Barrientos, et al., “A Stereoscopic Vision System Guiding an Autonomous Helicopter for Overhead Power Cable Inspection”, Robot Vision, Springer Berlin Heidelberg. pp.115-124, 2001.

C. Whitworth, A. Duller, D. Jones, et al., “Aerial video inspection of overhead power lines”, Power Engineering Journal, Vol.15, No.1, pp.25-32, 2002.

D. Jones, C. Whitworth, G. Earp, et al, “A laboratory testbed for an automated power line inspection system”, Control Engineering Practice, Vol.13, No.7, pp.835-851, 2005.

K. Jaka, P. Franjo and L. Bostjan, “A survey of mobile robots for distribution power line inspection”, IEEE Transactions on Power Delivery, Vol.25, No.1, pp.485-493, 2009.

I. Golightly and D. Jones, “Corner detection and matching for visual tracking during power line inspection”, Image and Vision Computing, Vol.21, No.9, pp.827-840, 2003.

I. Golightly and D. Jones, “Visual control of an unmanned aerial vehicle for power line inspection”, 12th International Conference on Advanced Robotics, ICAR'05, pp.288-295, 2005.

G. Yan, C. Li, G. Zhou, et al., “Automatic extraction of power lines from aerial images”, IEEE Geoscience and Remote Sensing Letters, Vol.4, No.3, pp.387-391, 2007.

Z. Li, Y. Liu, R. Hayward, et al., “Knowledge-based power line detection for UAV surveillance and inspection systems”, Proceedings of the Image Vision Computing, IEEE, New Zealand, pp.1-6, 2008.

Z. Li, Y. Liu, R. Walker, et al., “Towards automatic power line detection for a UAV surveillance system using pulse coupled neural filter and an improved Hough transform”, Machine Vision and Applications, Vol.21, No.5, pp.677-686, 2010.

H. Wu, M. Lv, C.A. Liu, et al., “Planning efficient and robust behaviors for model-based power tower inspection”, 2nd International Conference on Applied Robotics for the Power Industry (CARPI), pp.163-166, 2012.

C. Liu, S. Zhang, H. Wu, et al., “A Flying Robot Localization Method Based on Multi-sensor Fusion”, International Journal of Advanced Robotic Systems, Vol.11, No.178, pp.1-7, 2014.

D. Kragic and H.I. Christensen, “Model based techniques for robotic servoing and grasping”, Proceedings of the Intelligent Robots and Systems, IEEE/RSJ International Conference on, Vol.1, pp.299-304, 2002.

V. Lepetit, L. Vacchetti, et al., “Fully automated and stable registration for augmented reality applications”, Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality, pp.93-102, 2003.

L. Vacchetti, V. Lepetit and P. Fua, “Stable real-time 3d tracking using online and offline information”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.26, No.10, pp.1385-1391, 2004.

H. Najafi, N. Navab and G. Klinker, “Automated initialization for marker-less tracking: A sensor fusion approach”, Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR, pp.79-88, 2004.

V. Lepetit and P. Fua, “Monocular model-based 3d tracking of rigid objects: A survey”, Foundations and trends in computer graphics and vision, Vol.1, No.1, pp.1-89, 2005.

C. Teuliere, L. Eck, E. Marchand, et al., “3D model-based tracking for UAV position control”, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.1084-1089, 2010.

J. Wang, F. Shi, J. Zhang, et al., “A new calibration model of camera lens distortion”, Pattern Recogn, Vol.41, No.2, pp.607- 615, 2008.

A, Arranz, A.S. Nchez and M. Alvar, “Multiresolution energy minimisation framework for stereo matching”, IET computer vision, Vol.6, No.5, pp.425-434, 2012.

R. Chang, Y. Wang and K. Leman, “Robust unmanned aerial vehicle camera self-calibration for surveillance applications”, Proceedings of the Sensor Signal Processing for Defence (SSPD), pp.1-5, 2012.

T. Drummond and R. Cipolla, “Real-time visual tracking of complex structures”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.24, No.7, pp.932-946, 2002.

C. Martinez, C. Sampedro, et al., “Towards autonomous detection and tracking of electric towers for aerial power line inspection”, International Conference on Unmanned Aircraft Systems (ICUAS), pp.284-295, 2014.

A. Ceron, B. Mondragon, F. Ivan, et al., “Power line detection using a circle based search with UAV images”, 2014 International Conference on Unmanned Aircraft Systems, pp.632-639, 2014.

Relative Articles

Supplements(0)

Cited By

Proportional views