Browse > Article
http://dx.doi.org/10.7746/jkros.2013.8.3.179

Haptic Interaction with Objects Displayed in a Picture based on Surface Normal Estimation  

Kim, Seung-Chan (Mechanical Engineering, KAIST)
Kwon, Dong-Soo (Mechanical Engineering, KAIST)
Publication Information
The Journal of Korea Robotics Society / v.8, no.3, 2013 , pp. 179-185 More about this Journal
Abstract
In this paper we propose a haptic interaction system that physically represents the underlying geometry of objects displayed in a 2D picture, i.e., a digital image. To obtain the object's geometry displayed in the picture, we estimate the physical transformation between the object plane and the image plane based on homographic information. We then calculate the rotated surface normal vector of the object's face and place it on the corresponding part in the 2D image. The purpose of this setup is to create a force that can be rendered along with the image without distorting the visual information. We evaluated the proposed haptic rendering system using a set of pictures of objects with different orientations. The experimental results show that the participants reliably identified the geometric configuration by touching the object in the picture. We conclude this paper with a set of applications.
Keywords
Image Understanding; Resistive Force; Force Display;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Minsky, O.-y. Ming, O. Steele et al., "Feeling and seeing: issues in force display," SIGGRAPH Comput. Graph., vol. 24, no. 2, pp. 235-241, 1990.
2 G. Robles-De-La-Torre, and V. Hayward, "Virtual surfaces and haptic shape perception." pp. 1081-1085.
3 G. Robles-De-La-Torre, and V. Hayward, "Force can overcome object geometry in the perception of shape through active touch," Nature, vol. 412, no. 6845, pp. 445-448, 2001.   DOI   ScienceOn
4 S. Saga, and K. Deguchi, "Lateral-Force-Based 2.5- Dimensional Tactile Display for Touch Screen." pp. 15 - 22.
5 K. Hinckley, M. Sinclair, E. Hanson et al., "The videomouse: a camera-based multi-degree-of-freedom input device." pp. 103-112.
6 K. D. D. Willis, I. Poupyrev, S. E. Hudson et al., "SideBySide: ad-hoc multi-user interaction with handheld projectors," in Proceedings of the 24th annual ACM symposium on User interface software and technology, Santa Barbara, California, USA, 2011, pp. 431-440.
7 S. J. Lederman, and R. L. Klatzky, "Haptic perception: A tutorial," Attention, Perception, & Psychophysics, vol. 71, no. 7, pp. 1439-1459, 2009.   DOI   ScienceOn
8 H. Yano, Y. Miyamoto, and H. Iwata, "Haptic interface for perceiving remote object using a laser range finder," in Proceedings of the Third Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2009, pp. 196-201.
9 D. C. Ruspini, K. Kolarov, and O. Khatib, "The haptic display of complex graphical environments." pp. 345- 352.
10 C. Basdogan, C. H. Ho, and M. Srinivasan, "A ray-based haptic rendering technique for displaying shape and texture of 3D objects in virtual environments." pp. 77-84.
11 J. P. Fritz, and K. E. Barner, "Stochastic models for haptic texture." pp. 34-44.
12 J. Shopf, and M. Olano, "Procedural haptic texture." pp. 179-185.
13 S.-C. Kim, S.-C. Kang, and D.-S. Kwon, "Sound Generation for the Haptic Perception using an Irregular Primitive Function." pp. 19-24.
14 P. Bach-y-Rita, C. C. Collins, F. A. Saunders et al., "Vision substitution by tactile image projection," Nature, vol. 221, no. 6845, pp. 963-964, 1969.   DOI   ScienceOn
15 M. Shinohara, Y. Shimizu, and A. Mochizuki, "Threedimensional tactile display for the blind," Rehabilitation Engineering, IEEE Transactions on, vol. 6, no. 3, pp. 249-256, 1998.   DOI   ScienceOn
16 A. Israr, O. Bau, S.-C. Kim et al., "Tactile feedback on flat surfaces for the visually impaired," in Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts, Austin, Texas, USA, 2012, pp. 1571-1576.
17 B.-K. Han, S.-C. Kim, S.-C. Lim et al., "Physical mobile interaction with kinesthetic feedback." pp. 571-575.
18 S.-C. Kim, B.-K. Han, and D.-S. Kwon, "Feeling the unseen: physical interaction with depth-embedded images," in CHI '13 Extended Abstracts on Human Factors in Computing Systems, Paris, France, 2013, pp. 727-732.
19 S. J. Lederman, and R. L. Klatzky, "Haptic identification of common objects: Effects of constraining the manual exploration process," Attention, Perception, & Psychophysics, vol. 66, no. 4, pp. 618-628, 2004.   DOI   ScienceOn