Real-time Visual Tracking System and Control Method for Laparoscope Manipulator

복강경 수술용 도구의 실시간 영상 추적 및 복강경 조종기의 지능형 제어 방법

  • Published : 2004.11.01

Abstract

In this paper we present a new real-time visual servoing unit for laparoscopic surgery This unit can automatically control laparoscope manipulator through visual tracking of laparoscopic surgical tool. For the tracking, we present two-stage adaptive CONDENSATION(conditional density propagation) algorithm to extract the accurate position of the surgical tool tip from a surgical image sequence in real-time. This algorithm can be adaptable to abrupt change of laparoscope illumination. For the control, we present virtual damper system to control a laparoscope manipulator safely and stably. This system causes the laparoscope to move under constraint of the virtual dampers which are linked to the four sides of image. The visual servoing unit operates the manipulator in real-time with locating the surgical tool in the center of image. The experimental results show that the proposed visual tracking algorithm is highly robust and the controlled manipulator can present stable view with safe.

Keywords

References

  1. Maurice, E. A., Robert, J. F. Jr., Namir, K., Barry, J. M., Harry, R., 'Principles of Laparoscopic surgery,' Springer-Verlag, 1995
  2. Omote, K., Feussner, H., Ungeheuer, A., Arbter, K., Guo-Qing, W., 'Self-guided robotic camera control for laparoscopic surgery compared with human camera control,' The American journal of surgery, Vol. 177, pp. 321-324, April, 1999 https://doi.org/10.1016/S0002-9610(99)00055-0
  3. Casal, A., Amat, J., Laporte, E., 'Automatic guidance of an assistant robot in laparoscopic surgery,' IEEE International Conf. on Robotics and Automation, Vol. l,pp.895-900, 1996 https://doi.org/10.1109/ROBOT.1996.503886
  4. Isard, M., Blake, A., 'CONDENSATION-Conditional Density Propagation for Visual Tracking,' Int. J. Computer Vision, 29(1), pp.5-28, 2001 https://doi.org/10.1023/A:1008078328650
  5. Reynard, D., Wilderberg, A., Blake, A., Marchant, J., 'Learning dynamics of complex motions from image sequences,' Proc. European Conf. Computer Vision, pp. 357-368, 1996
  6. Jang, G. J., Kweon, I. S., 'Robust Object Tracking Using an Adaptive Color Model,' IEEE International Conf. on Robotics and Automation, pp. 1677-1682, 2001 https://doi.org/10.1109/ROBOT.2001.932852