Current Optics and Photonics

Optical Society of Korea (한국광학회)
권호 표지
DOI QR코드

DOI QR Code

Exploring the Potential of Modifying Visual Stimuli in Virtual Reality to Reduce Hand Tremor in Micromanipulation Tasks

  • Prada, John (Department of Robotics Engineering, DGIST) ;
  • Park, Taiwoo (Department of Media and Information, Michigan State University) ;
  • Jang, Sunjin (Department of Robotics Engineering, DGIST) ;
  • Im, Jintaek (Department of Robotics Engineering, DGIST) ;
  • Song, Cheol (Department of Robotics Engineering, DGIST)
  • Received : 2017.09.27
  • Accepted : 2017.11.02
  • Published : 2017.12.25
Download PDF
⟨ Previous Next ⟩

Abstract

Involuntary hand tremor has been a serious challenge in micromanipulation tasks and thus draws a significant amount of attention from related fields. To minimize the effect of the hand tremor, a variety of mechanically assistive solutions have been proposed. However, approaches increasing human awareness of their own hand tremor have not been extensively studied. In this paper, a head mount display based virtual reality (VR) system to increase human self-awareness of hand tremor is proposed. It shows a user a virtual image of a handheld device with emphasized hand tremor information. Provided with this emphasized tremor information, we hypothesize that subjects will control their hand tremor more effectively. Two methods of emphasizing hand tremor information are demonstrated: (1) direct amplification of tremor and (2) magnification of virtual object, in comparison to the controlled condition without emphasized tremor information. A human-subject study with twelve trials was conducted, with four healthy participants who performed a task of holding a handheld gripper device in a specific direction. The results showed that the proposed methods achieved a reduced level of hand tremor compared with the control condition.

Keywords

References

  1. T. Tanikawa and T. Arai, "Development of a micro-manipulation system having a two-fingered micro-hand," IEEE Trans. Robot. Autom. 15, 152-162 (1999). https://doi.org/10.1109/70.744610
  2. G. Borchert, A. Burisch, and A. Raatz, "APIS-A miniaturized robot for precision assembly with low-cost piezoelectric motors," Int. J. Precis. Eng. Manuf. 12, 629-634 (2011). https://doi.org/10.1007/s12541-011-0081-0
  3. U. X. Tan, W. T. Latt, C. Y. Shee, and W. T. Ang, "A low-cost flexure-based handheld mechanism for micromanipulation," IEEE/ASME Trans. Mechatronics 16, 773-778 (2011). https://doi.org/10.1109/TMECH.2010.2069568
  4. S. K. Jericho, M. H. Jericho, T. Hubbard, and M. Kujath, "Micro-electro-mechanical systems microtweezers for the manipulation of bacteria and small particles," Rev. Sci. Instrum. 75, 1280-1282 (2004).
  5. K. Moelhave and O. Hansen, "Electro-thermally actuated microgrippers with integrated force-feedback," J. Micromech. Microeng. 15, 1265 (2005). https://doi.org/10.1088/0960-1317/15/6/018
  6. R. Herbert, "Shaking when stirred: mechanisms of physiological tremor," J. Physiol 590(11), 2549 (2012). https://doi.org/10.1113/jphysiol.2012.232876
  7. S. Yang, R. Maclachlan, and C. Riviere, "Manipulator design and operation of a six-degree-of-freedom handheld tremorcanceling microsurgical instrument," IEEE/ASME Trans. Mechatronics, 20(2), 761-772 (2015). https://doi.org/10.1109/TMECH.2014.2320858
  8. B. Gonenc, E. Feldman, P. Gehlbach, J. Handa, R. Taylor, and I. Iordachita, "Towards robot-assisted vitreoretinal surgery: Force-sensing micro-forceps integrated with a handheld micromanipulator," in Proc. IEEE International Conference on Robotics and Automation (ICRA, 2014) pp. 1399-1404.
  9. B. Gonne, T. Handa, L. Gehlbach, R. Taylor, and I. Iordachita, "Robot-assisted retinal vein cannulation with forcebased puncture detection: Micron vs. the steady-hand eye robot," in Proc. 38th Annul. IEEE Engineering in Medicine and Biology Conference (EMBC, 2016), pp. 5107-5111.
  10. T. Latt, X. Tan, Y. Shee, and T. Ang, "A compact handheld active physiological tremor compensation instrument," in IEEE/ASME International Conference on Advanced Intelligent Mechatronics (2009), pp. 711-716.
  11. C. Song, P. L. Gehlbach, and J. U. Kang, "Swept source optical coherence tomography based smart handheld vitreoretinal microsurgical tool for tremor suppression," in Proc. 34th Annul. IEEE Engineering in Medicine and Biology Conference (EMBC, 2012), pp. 1405-1408.
  12. C. Song, P. L. Gehlbach, and J. U. Kang, "Ball lens fiber optic sensor based smart handheld microsurgical instrument," Proc. SPIE 8576, 857601-1-6 (2013).
  13. C. B. Yeo, H. C. Park, S. Jang, P. L. Gehlbach, and C. Song, "Dual optical coherence tomography sensor guided, two-motor, horizontal SMART micro-scissors", Opt. Lett. 41(20), 4723-4726 (2016). https://doi.org/10.1364/OL.41.004723
  14. D. Koo, H. C. Park, P. L. Gehlbach, and C. Song, "Development and preliminary results of bimanual smart microsurgical system using a ball-lens coupled OCT distance sensor," Biomed. Opt. Express 7(11), 4816-4826 (2016). https://doi.org/10.1364/BOE.7.004816
  15. S. Markez, Development of a hand tremor quantification device for the measurement of pathological tremor (Doctoral dissertation, National Library of Canada = Bibliotheque nationale du Canada, ON, Canada, 2000).
  16. S. Konishi, M. Nokata, O. Jeong, S. Kusuda, T. Sakakibara, M. Kuwayama, and H. Tsutsumi, "Pneumatic micro hand and miniaturized parallel link robot for micro manipulation robot system," in Proc. 2006 IEEE International Conference on Robotics and Automation (2006), pp. 1036-1041.
  17. K. K. Bhagat, W. K. Liou, and C. Y. Chang, "A cost-effective interactive 3D virtual reality system applied to military live firing training." Virtual Reality 20(2), 127-140 (2016). https://doi.org/10.1007/s10055-016-0284-x
  18. J. L. Maples-Keller, C. Yasinski, N. Manjin, and B. O. Rothbaum, "Virtual reality-enhanced extinction of phobias and post-traumatic stress," Neurotherapeutics 14(3), 554-563 (2017). https://doi.org/10.1007/s13311-017-0534-y
  19. B. Bideau, R. Kulpa, N. Vignais, S. Brault, F. Multon, and C. Craig, "Using virtual reality to analyze sports performance," in IEEE Comput. Graph. Appl. 30(2), 14-21 (2010). https://doi.org/10.1109/MCG.2010.111
  20. J. W. V. de Faria, M. J. Teixeira, L. de Moura Sousa Júnior, J. P. Otoch, and E. G. Figueiredo, "Virtual and stereoscopic anatomy: when virtual reality meets medical education," J. Neurosurg. 125(5), 1105-1111 (2016). https://doi.org/10.3171/2015.8.JNS141563
  21. S. Faroque, B. Horan, and M. Joordens, "Keyboard control method for virtual reality micro-robotic cell injection training," in 10th System of Systems Engineering Conference (SoSE, 2015), pp. 416-421.
  22. J. Alex, B. Vikramaditya, and B. J. Nelson, "A virtual reality teleoperator interface for assembly of hybrid MEMS prototypes," in Proc. DETC ASME Design Engineering Technical Conference (1998), pp. 5836.
  23. Y. Velaz, J. R. Arce, T. Gutierrez, A. Lozano-Rodero, and A. Suescun, "The influence of interaction technology on the learning of assembly tasks using virtual reality," J. Comput. Inf. Sci. Eng. 14(4), 041007 (2014). https://doi.org/10.1115/1.4028588
  24. C. Batista, V. Seshadri, R. Augusto, P. Reinhardt, P. Moreira, and J. Batista, "Applying virtual reality model to green ironmaking industry and education: 'a case study of charcoal mini-blast furnace plant'," Trans. Inst. Min. Metall. C126(1-2), 116-123 (2017).
  25. B. Takacs and L. Simon, "A clinical virtual reality rehabilitation System for phobia treatment," in 11th International Conference Information Visualization (IV'07, 2007), pp. 798-806.
  26. S. Sozzi, A. Monti, D. Nunzio, M. C. Do, and M. Schieppati, "Sensori-motor integration during stance: time adaptation of control mechanisms on adding or removing vision," Hum. Mov. Sci. 30(2), 172-189 (2011). https://doi.org/10.1016/j.humov.2010.06.002
  27. G. Jin and S. Nakayama, "Virtual reality game for safety education," in International Conference on Audio, Language and Image Processing, (Shanghai, 2014), pp. 95-100.
  28. S. Benford, J. Bowers, L. E. Fahlen, and C. Greenhalgh, "Managing mutual awareness in collaborative virtual environments," in Proc. the Conference on Virtual Reality Software and Technology (1994), pp. 223-236.
  29. C. Carlsson and O. Hagsand, "DIVE A multi-user virtual reality system," in Virtual Reality Annual International Symposium (1993), pp. 394-400.
  30. D. Reid, "The influence of virtual reality on playfulness in children with cerebral palsy: a pilot study," Occup. Ther. Int. 11(3), 131-144 (2004). https://doi.org/10.1002/oti.202
  31. B. K. Wiederhold and M. D. Wiederhold, "Three-year follow-up for virtual reality exposure for fear of flying," Cyberpsychol. Behav. 6(4), 441-445 (2003). https://doi.org/10.1089/109493103322278844
  32. J. McComas and H. Sveistrup, "Virtual reality applications for prevention, disability awareness, and physical therapy rehabilitation in neurology: our recent work," J. Neurol. Phys. Ther. 26(2), 55-61 (2002).
  33. B. C. Becker, R. A. MacLachlan, L. A. Lobes, G. D. Hager, and C. N. Riviere, "Vision-based control of a handheld surgical micromanipulator with virtual fixtures," IEEE Trans. Robot. 29(3), 674-683, (2014). https://doi.org/10.1109/TRO.2013.2239552
  34. T. Y. Fang, P. C. Wang, C. H. Liu, M. C. Su, and S. C. Yeh, "Evaluation of a haptics-based virtual reality temporal bone simulator for anatomy and surgery training," Comput. Methods Programs Biomed. 113(2), 674-681 (2014). https://doi.org/10.1016/j.cmpb.2013.11.005
  35. S. G. Kang, B. J. Ryu, K. S. Yang, Y. H. Ko, S. Cho, S. H. Kang, R. Patel, and J. Cheon, "An effective repetitive training schedule to achieve skill proficiency using a novel robotic virtual reality simulator," J. Surg. Educ. 72(3), 369-376 (2015). https://doi.org/10.1016/j.jsurg.2014.06.023
  36. O. Ossmy and R. Mukamel, "Short term motor-skill acquisition improves with size of self-controlled virtual hands," PloS One 12(1), 0168520, (2017).
  37. I. Kapandji, The physiology of the joints: Upper limb. Churchill (Volume 2, Churchill Livingstone, 1983).