LIU Chang'an, DONG Ruifang, JIN Lu, WU Hua. Viewpoint Optimization Method for Flying Robot Inspecting Transmission Towers Based on Point Cloud Model[J]. Chinese Journal of Electronics, 2018, 27(5): 976-984. doi: 10.1049/cje.2018.05.005
Citation: LIU Chang'an, DONG Ruifang, JIN Lu, WU Hua. Viewpoint Optimization Method for Flying Robot Inspecting Transmission Towers Based on Point Cloud Model[J]. Chinese Journal of Electronics, 2018, 27(5): 976-984. doi: 10.1049/cje.2018.05.005

Viewpoint Optimization Method for Flying Robot Inspecting Transmission Towers Based on Point Cloud Model

doi: 10.1049/cje.2018.05.005
Funds:  This work is supported by the Programme for New Century Excellent Talents in University (No.NCET-11-0634) and the Fundamental Research Funds for the Central Universities (No.2015XS63).
More Information
  • Corresponding author: WU Hua (corresponding author) is currently an associate professor in North China Electric Power University. He received his Ph.D. degree in Pattern Recognition and Intelligent System from Beihang University in 2010. His research interest lies in robot navigation, computer vision and machine learning for power industry. (
  • Received Date: 2016-12-16
  • Rev Recd Date: 2017-09-06
  • Publish Date: 2018-09-10
  • This paper presents a method to derive optimal viewpoints for flying robot based transmission tower inspection, which applies point cloud model. A safe envelope is established according to safe transmission tower inspection rules. Essential inspection factors are proposed to evaluate the quality of candidate viewpoints, which includes visibility, dimensionality feature of point cloud as well as the distance between viewpoint and transmission power. A score function is constructed to quantify candidate viewpoints, while multiple attribute decision theory is applied to calculate the weight of each factor. Particle swarm optimization (PSO) is used to find the optimal viewpoints set. Both simulation experiment and practical observations are carried out. The results prove that optimal viewpoints have a great contribution for accurate transmission tower inspection. Final results are compared to patch-based method and proved to be feasible.
  • loading
  • L.F. Luque-Vega, B. Castillo-Toledo, A. Loukianov, et al., “Power line inspection via an unmanned aerial system based on the quadrotor helicopter”, 17th IEEE Mediterranean Electrotechnical Conference, Beirut, Lebanon, pp.393-397, 2014.
    H. Wu, M. Lv, C.-A. Liu, et al., “Planning efficient and robust behaviors for model-based power tower inspection”, 2nd International Conference on Applied Robotics for the Power Industry, Zurich, Switzerland, pp.163-166, 2012.
    D. Jones and G. Earp, “Camera sightline pointing requirements for aerial inspection of overhead power lines”, Electric Power Systems Research, Vol.57, No.2, pp.73-82, 2001.
    G. Yang, R. Dong, H. Wu, et al., “Viewpoint optimization using genetic algorithm for flying robot inspection of electricity transmission tower equipment”, Chinese Journal of Electronics, Vol.23, No.2, pp.426-431, 2014.
    R.B. Rusu, Z.C. Marton, N. Blodow, et al., “Towards 3D point cloud based object maps for household environments”, Robotics and Autonomous Systems, Vol.56, No.11, pp.927-941, 2008.
    Y. Ye, L. Xiaoping and B. Buckles, “Residential building reconstruction based on data fusion”, Acta Electronica Sinica, Vol.42, No.2, pp.250-256, 2014. (in Chinese)
    S. Sakane and T. Sato, “Automatic planning of light source and camera placement for an active photometric stereo system”, Transactions of the Society of Instrument and Control Engineers, Vol.26, No.10, pp.1201-1208, 1990.
    S. Sakane, R. Niepold, T. Sato, et al., “Illumination setup planning for a hand-eye system based on an environmental model”, Advanced Robotics, Vol.6, No.4, pp.461-482, 1991.
    T. CAI, X. WANG, Q. ZHAO, et al., “Viewpoint Planning of Multi-CCD Sensors in Online Monitoring System”, Journal of Test and Measurement Technology, Vol.24, No.4, pp.339-343, 2010.
    J.I. Vásquez-Gómez, E. Löpez-Damian and L.E. Sucar, “View planning for 3D object reconstruction”, IEEE/RSJ International Conference on Intelligent Robots and Systems, Missouri, USA, pp.4015-4020, 2009.
    Y. Li and Z. Liu, “Information entropy-based viewpoint planning for 3-D object reconstruction”, IEEE Transactions on Robotics, Vol.21, No.3, pp.324-337, 2005.
    S. Wenhardt, B. Deutsch, J. Hornegger, et al., “An information theoretic approach for next best view planning in 3-d reconstruction”, 18th International Conference on Pattern Recognition, Hong Kong, China, pp.103-106, 2006.
    E. Dunn and J.-M. Frahm, “Next best view planning for active model improvement”, British Machine Vision Conference, London, UK, pp.1-11, 2009.
    W.R. Scott, “Model-based view planning”, Machine Vision and Applications, Vol.20, No.1, pp.47-69, 2009.
    X. Zhou, B. He and Y. Li, “Research on new view planning method for automatic reconstruction of unknown 3D objects”, IEEE International Conference on Robotics and Biomimetics, Guilin, China, pp.965-970, 2009.
    S. Katz, A. Tal and R. Basri, “Direct visibility of point sets”, ACM Transactions on Graphics, Vol.26, No.3, pp.24, 2007.
    O.S. Ahmed, S.E. Franklin, M.A. Wulder, et al., “Characterizing stand-level forest canopy cover and height using landsat time series, samples of airborne LiDAR, and the random forest algorithm”, Journal of Photogrammetry and Remote Sensing, Vol.101, pp.89-101, 2015.
    R. Mehra, P. Tripathi, A. Sheffer, et al., “Visibility of noisy point cloud data”, Computers & Graphics, Vol.34, No.3, pp.219-230, 2010.
    A. Gressin, C. Mallet, J. Demantké, et al., “Towards 3D lidar point cloud registration improvement using optimal neighborhood knowledge”, ISPRS Journal of Photogrammetry and Remote Sensing, Vol.79, pp.240-251, 2013.
    X. Qi, C. Liang and J. Zhang, “Generalized cross-entropy based group decision making with unknown expert and attribute weights under interval-valued intuitionistic fuzzy environment”, Computers & Industrial Engineering, Vol.79, pp.52-64, 2015.
    D.C. Tran and Z. Wu, “Adaptive multi-layer particle swarm optimization with neighborhood search”, Chinese Journal of Electronics, Vol.25, No.6, pp.1079-1088, 2016.
    Y. Wang and Y. Zheng, “Viewpoint selection using PSO algorithms for volume rendering”, Second International MultiSymposiums on Computer and Computational Sciences, Iowa, USA, pp.286-291, 2007.
    R.B. Rusu and S. Cousins, “3d is here: Point cloud library (pcl)”, IEEE International Conference on Robotics and automation, Shanghai, China, pp.1-4, 2011.
    C.-a. Liu, R. Dong, H. Wu, et al., “A 3d laboratory testplatform for overhead power line inspection”, International Journal of Advanced Robotic Systems, Vol.13, No.2, pp.72, 2016.
  • 加载中


    通讯作者: 陈斌,
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (105) PDF downloads(238) Cited by()
    Proportional views


    DownLoad:  Full-Size Img  PowerPoint