Constrained High Accuracy Stereo Reconstruction Method for Surgical Instruments Positioning

  • Wang, Chenhao (Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University) ;
  • Shen, Yi (Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University) ;
  • Zhang, Wenbin (Department of Oral and Maxillofacial Surgery, Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine) ;
  • Liu, Yuncai (Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University)
  • Received : 2012.05.03
  • Accepted : 2012.09.21
  • Published : 2012.10.31

Abstract

In this paper, a high accuracy stereo reconstruction method for surgery instruments positioning is proposed. Usually, the problem of surgical instruments reconstruction is considered as a basic task in computer vision to estimate the 3-D position of each marker on a surgery instrument from three pairs of image points. However, the existing methods considered the 3-D reconstruction of the points separately thus ignore the structure information. Meanwhile, the errors from light variation, imaging noise and quantization still affect the reconstruction accuracy. This paper proposes a method which takes the structure information of surgical instruments as constraints, and reconstructs the whole markers on one surgical instrument together. Firstly, we calibrate the instruments before navigation to get the structure parameters. The structure parameters consist of markers' number, distances between each markers and a linearity sign of each instrument. Then, the structure constraints are added to stereo reconstruction. Finally, weighted filter is used to reduce the jitter. Experiments conducted on surgery navigation system showed that our method not only improve accuracy effectively but also reduce the jitter of surgical instrument greatly.

Keywords

References

  1. R. Galloway, "The process and development of image-guided procedures", Annual Review of Biomedical Engineering, 2001, 3: 83-108. https://doi.org/10.1146/annurev.bioeng.3.1.83
  2. R.Taylor, "Summer School Talk - Taylor.pptx - Robotics Summer School", 2012.
  3. Medical Vision Group at the MIT AI Lab, Cambridge, Massachusetts, USA..
  4. Surgical Planning Laboratory of Bgham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.
  5. D.D. Menthon and L.S. Davis, "New Exact and Approximate Solutions of the Three-point Perspective Problem," Proc. IEEE Int'l Conf. Robotics and Automation, Cincinnati, Ohio, May, 1990, pp.40-45.
  6. J. Yang, and J. Qian, "Research on Computer Aided Surgical Navigation Based on Binocular Stereovision", Proc. IEEE Int'l Conf. on Mechatronics and Automation, Luoyang, China, June 25-28, 2006, pp.1532-1536.
  7. J. Wang, Digital Infrared Navigator for Surgery, Doctoral Dissertation of Shanghai Jiaotong University, 2007.
  8. Y. Zheng, Y. Liu, "Extent the Projected Sphere Center Deviates from the Perspective Elliptical Contour Center", IET Electronics Letters, vol.44, no. 11, 673-674, 2008. https://doi.org/10.1049/el:20081167
  9. R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision", Cambridge, 2004.
  10. Y. Yuan, W. Sun, "Optimization Theory and Methods Science Press", Beijing ,1997.
  11. J. Bouguet, Camera Calibration Toolbox for Matlab.
  12. Z. Duan, Z. Yuan, X. Liao, W. Si and J. Zhao. 3D Tracking and Positioning of Surgical Instruments in Virtual Surgery Simulation. Journal of Multimedia, Vol 6, No 6, 502-509, 2011.