Transactions of the Korean Society of Mechanical Engineers A (대한기계학회논문집A)

The Korean Society of Mechanical Engineers (대한기계학회)
권호 표지
DOI QR코드

DOI QR Code

Real-Time Haptic Rendering of Slowly Deformable Bodies Based on Two Dimensional Visual Information for Telemanipulation

원격조작을 위한 2차원 영상정보에 기반한 저속 변형체의 실시간 햅틱 렌더링

  • 김정식 (한국과학기술원 기계공학과) ;
  • 김영진 (한국과학기술원 기계공학과) ;
  • 김정 (한국과학기술원 기계공학과)
  • Published : 2007.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

Haptic rendering is a process providing force feedback during interactions between a user and a virtual object. This paper presents a real-time haptic rendering technique for deformable objects based on visual information of intervention between a tool and a real object in a remote place. A user can feel the artificial reaction force through a haptic device in real-time when a slave system exerts manipulation tasks on a deformable object. The models of the deformable object and the manipulator are created from the captured image obtained with a CCD camera and the recognition of objects is achieved using image processing techniques. The force at a rate of 1 kHz for stable haptic interaction is deduced using extrapolation of forces at a low update rate. The rendering algorithm developed was tested and validated on a test platform consisting of a one-dimensional indentation device and an off-the shelf force feedback device. This software system can be used in a cellular manipulation system providing artificial force feedback to enhance a success rate of operations.

Keywords

References

  1. Salisbury, K., Brocki, D., Massiet, T., Swarupf, N. and Zillest, C., 1995, 'Haptic Rendering: Programming: Touch Interaction with Virtual Objects,' Proc. of Symp. Interactive 3D Graphics, ACM Press, pp. 123-130
  2. Kyung, K. U. and Park, J. S., 2006, 'The State of the Art and R&D Perceptives on Haptics,' Electronics and Telecommunications Trends, ETRI, Vol. 21, No.5, pp.93-108
  3. Kim, L., Sukhatme, G S. and Desbrun, M., 2004, 'A Haptic-Rendering Technique Based on Hybrid Surface Representation,' IEEE Computer Graphics and Applications, Vol. 24, pp. 66-75 https://doi.org/10.1109/MCG.2004.1274064
  4. Basdogan, C., De, S., Kim, J., Muniyandi, M., Kim, H. and Srinivasan, M. A., 2004, 'Haptics in Minimally Invasive Surgical Simulation and Training,' IEEE Computer Graphics and Applications, Vol. 24, pp. 56-64 https://doi.org/10.1109/MCG.2004.1274062
  5. Park, J. and Khatib, O., 2006, 'A Haptic Teleoperation Approach Based on Contact Force Control,' Int. J. of Robotics Research, Vol. 25, pp. 575-591 https://doi.org/10.1177/0278364906065385
  6. Pillarisetti, A., Anjum, W., Desai, J. P., Friedman, G and Brooks, A. D., 2005, 'Force Feedback Interface for Cell Injection,' First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'05), pp. 391-400
  7. Ammi, M., Ferreira, A., 2006, 'Biological Cell Injection Visual and Haptic Interface,' Advanced Robotics, Vol. 20, No.3, pp. 283-304 https://doi.org/10.1163/156855306776014376
  8. Shim, J. H., Cho, S. Y., Cha, D. H., 2004, 'VisionGuided Micromanipulation System for Biomedical Application,' Proc. of SPIE, Vol. 5604, pp. 98-107 https://doi.org/10.1117/12.570976
  9. Kim, D. H., Kim, B., Yun, S., Kang, H., 2003, 'Cellular Force Sensing for Force Feedback-Based Biological Cell Injection,' Trans. of the KSME (A), Vol. 27, No. 12, pp. 2079-2084 https://doi.org/10.3795/KSME-A.2003.27.12.2079
  10. Sun, Y., Nelson, B. J., 2002, 'Biological Cell Injection Using an Autonomous MicroRobotic System,' The International Journal of Robotics Research, Vol. 21, No. 10-11, pp. 861-868 https://doi.org/10.1177/0278364902021010833
  11. Lee, M. H., 2002, 'Nonlinear Virtual Coupling for Stable Haptic Interface,' KAIST, Master Thesie
  12. http://www.intel.com/technology/computing/opencv
  13. Lewis, J. P., 1995, 'Fast Normalized Cross- correlation,' Vision Interface, pp 120-123
  14. Kass, M., Witkin, A. and Terzopoulos, D., 1988, 'Snakes: Active Contour Models,' International Journal of Computer Vision, Vol. 1, No.4, pp. 321-331 https://doi.org/10.1007/BF00133570
  15. Williams, D. J. and Shah, M., 1992, 'A Fast Algorithm for Active Contours and Curvature Estimation,' CVGIP: Image Understanding, Vol. 55, No.1, pp.14-26 https://doi.org/10.1016/1049-9660(92)90003-L
  16. Zhuang, Y. and Canny, J., 2000, 'Haptic Interaction with Global Deformation,' Proc. IEEE Int. Con! Robot. Autom., Vol. 3, pp. 2428-2433 https://doi.org/10.1109/ROBOT.2000.846391
  17. Picinbono, G, Lombardo, J. C., Delingette, H. and Ayache, N., 2002, 'Improving Realism of a Surgery Simulator: Linear Anisotropic Elasticity, Complex Interactions and Force Extrapolation,' Journal of Visualization and Computer Animation, Vol. 13, pp. 147-167 https://doi.org/10.1002/vis.257