ZHONG Fangxun, LIU Yunhui. Image-Based 3D Pose Reconstruction of Surgical Needle for Robot-Assisted Laparoscopic Suturing[J]. Chinese Journal of Electronics, 2018, 27(3): 476-482. doi: 10.1049/cje.2017.06.009
Citation: ZHONG Fangxun, LIU Yunhui. Image-Based 3D Pose Reconstruction of Surgical Needle for Robot-Assisted Laparoscopic Suturing[J]. Chinese Journal of Electronics, 2018, 27(3): 476-482. doi: 10.1049/cje.2017.06.009

Image-Based 3D Pose Reconstruction of Surgical Needle for Robot-Assisted Laparoscopic Suturing

doi: 10.1049/cje.2017.06.009
Funds:  This work is supported by the HK RGC (No.415011, CUHK6/CRF/13G), the HK ITF (ITS/112/15FP, ITT/012/15GP), the VCs Discretionary Fund through CURI (No.4930763, No.4930725), and the CUHK SHIAE (No.8115053).
  • Received Date: 2017-03-16
  • Rev Recd Date: 2017-04-05
  • Publish Date: 2018-05-10
  • We present a new method to solve the recognition and localisation problem of a surgical needle for robot-assisted laparoscopy. Based on the observation from a single monocular laparoscopic image, we propose a new modelling method to parametrise the full 3D pose of the surgical needle by constrained Degrees of freedom (DOFs) using only two generalised variables. To obtain effective image feedback for the modelling, a feature segmentation algorithm is introduced from probabilistic linear constraints in RGB colour space, constructed from typical laparoscopic images. An iterative algorithm using gradient descent rule is implemented to converge the computed needle's pose to its real one. Experiments demonstrate the feasibility of the proposed scheme using laparoscopic torso models.
  • loading
  • R.H. Taylor, A. Menciassi, G. Fichtinger, et al., "Medical robotics and computer-integrated surgery", Springer Handbook of Robotics, pp.1199-1222, 2008.
    R. Pasic and R. L. Levine, "Laparoscopic suturing and ligation techniques", The Journal of the American Association of Gynecologic Laparoscopists, Vol.3, No.1, pp.67-79, 1995.
    F. Nageotte, C. Doignon, M. de Mathelin, et al., "Circular needle and needle-holder localization for computer-aided suturing in laparoscopic surgery", Proc. SPIE, Medical Imaging, Vol.5744, pp.87-98, 2005.
    P. Hynes, G.I. Dodds and A.J. Wilkinson, "Uncalibrated visualservoing of a dual-arm robot for MIS suturing", IEEE International Conference on Control, Automation and Systems (ICCAS'13), pp.420-425, 2013.
    C. Wengert, L. Bossard, C. Baur, et al., "Endoscopic navigation for minimally invasive suturing", Computer Aided Surgery, Vol.13, No.5, pp.299-310, 2008.
    S. Sen, A. Garg, D.V. Gealy, et al., "Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization", IEEE International Conference on Robotics and Automation (ICRA'16), pp.4178-4185, 2016.
    S. Iyer, T. Looi and J. Drakes, "A single arm, single camera system for automated suturing", IEEE International Conference on Robotics and Automation (ICRA'13), pp.239-244, 2013.
    S. Speidel, A. Kroehnert, S. Bodenstedt, et al., "Image-based tracking of the suturing needle during laparoscopic interventions", Proc. SPIE, Medical Imaging, Vol.9415, pp.94150B-1-94150B-6, 2015.
    Y. Kurose, Y.M. Baek, Y. Kamei, et al., "Preliminary study of needle tracking in a microsurgical robotic system for automated operations", IEEE International Conference on Control, Automation and Systems (ICCAS'13), pp.627-630, 2013.
    J. Chang, "Robust needle recognition using artificial neural network (ANN) and random sample consensus (RANSAC)", IEEE Applied Imagery Pattern Recognition Workshop (AIPR'12), pp.1-3, 2012.
    F. Zhong, D. Navarro-Alarcon, Z. Wang, et al., "Adaptive 3D pose computation of suturing needle using constraints from static monocular image feedback", IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'16), pp.5521-5526, 2016.
    R. Safaee-Rad, I. Tchoukanov, K.C. Smith, et al., "Threedimensional location estimation of circular features for machine vision", IEEE Transactions on Robotics and Automation, Vol.8, No.5, pp.624-640, 1992.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (90) PDF downloads(223) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return