Browse > Article
http://dx.doi.org/10.15701/kcgs.2020.26.2.1

3D Surface Painting in VR using Force Feedback  

Kim, Minyoung (Dept. of Computer Science and Engineering, Ewha Womans University)
Kim, Young J. (Dept. of Computer Science and Engineering, Ewha Womans University)
Publication Information
Journal of the Korea Computer Graphics Society / v.26, no.2, 2020 , pp. 1-9 More about this Journal
Abstract
In this paper, we propose haptic interfaces based on force feedback to provide a physical painting experience to virtual reality users. Through this system, the user can create surface-based painting holding a haptic stylus, while utilizing both visual feedback from the worn HMD and haptic feedback during painting. In particular, the haptic interfaces simulate the physical interaction between painting brush and painting, which can help to improve the spatial perception of users and compensate for visual feedback. This can reduce laborious drawing works to repeatedly paint strokes and therefore yield a better painting performance. As a result, users can experience more effective and realistic VR painting with this system.
Keywords
virtual reality painting; haptic interface; spatial perception; virtual reality;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Google, "Tilt brush by google," https://www.tiltbrush.com/, 2016.
2 Facebook, "Quill by Facebook," https://quill.fb.com/, 2016.
3 Y. Kim, B. Kim, and Y. J. Kim, "Dynamic deep octree for high-resolution volumetric painting in virtual reality," in Computer Graphics Forum, vol. 37, no. 7, 2018, pp. 179-190.   DOI
4 R. Arora, R. H. Kazi, F. Anderson, T. Grossman, K. Singh, and G. Fitzmaurice, "Experimental Evaluation of Sketching on Surfaces in VR," Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI'17, pp. 5643-5654, 2017.
5 D. R. Lampton, D. P. McDonald, M. Singer, and J. P. Bliss, "Distance estimation in virtual environments," in Proceedings of the human factors and ergonomics society annual meeting, vol. 39, no. 20. SAGE Publications Sage CA: Los Angeles, CA, 1995, pp. 1268-1272.
6 L. Bouguila, M. Ishii, and M. Sato, "Effect of coupling haptics and stereopsis on depth perception in virtual environment," in Proc. of the 1st Workshop on Haptic Human Computer Interaction, 2000, pp. 54-62.
7 E.-L. Sallnas, K. Rassmus-Grohn, and C. Sjostrom, "Supporting presence in collaborative environments by haptic force feedback," ACM Transactions on Computer-Human Interaction (TOCHI), vol. 7, no. 4, pp. 461-476, 2000.   DOI
8 E. Sachs, A. Roberts, and D. Stoops, "3-draw: A tool for designing 3d shapes," IEEE Computer Graphics and Applications, no. 6, pp. 18-26, 1991.
9 S. Snibbe, S. Anderson, and B. Verplank, "Springs and constraints for 3d drawing," in Proceedings of the Third Phantom Users Group Workshop, 1998.
10 D. Keefe, R. Zeleznik, and D. Laidlaw, "Drawing on air: Input techniques for controlled 3d line illustration," IEEE Transactions on Visualization and Computer Graphics, vol. 13, no. 5, pp. 1067-1081, 2007.   DOI
11 B. Baxter, V. Scheib, M. C. Lin, and D. Manocha, "Dab: interactive haptic painting with 3d virtual brushes," in Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, 2001, pp. 461-468.
12 D. F. Keefe, D. A. Feliz, T. Moscovich, D. H. Laidlaw, and J. J. LaViola Jr, "Cavepainting: a fully immersive 3d artistic medium and interactive experience," in Proceedings of the 2001 symposium on Interactive 3D graphics. Citeseer, 2001, pp. 85-93.
13 S. Schkolne, M. Pruett, and P. Schroder, "Surface drawing: creating organic 3d shapes with the hand and tangible tools," in Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 2001, pp. 261-268.
14 G. Wesche and H.-P. Seidel, "Freedrawer: a free-form sketching system on the responsive workbench," in Proceedings of the ACM symposium on Virtual reality software and technology. ACM, 2001, pp. 167-174.
15 B. G. Witmer and P. B. Kline, "Judging perceived and traversed distance in virtual environments," Presence, vol. 7, no. 2, pp. 144-167, 1998.   DOI
16 R. Schmidt, A. Khan, G. Kurtenbach, and K. Singh, "On expert performance in 3d curve-drawing tasks," in Proceedings of the 6th eurographics symposium on sketch-based interfaces and modeling. ACM, 2009, pp. 133-140.
17 M. D. B. Machuca, P. Asente, W. Stuerzlinger, J. Lu, and B. Kim, "Multiplanes: Assisted freehand vr sketching," in Proceedings of the Symposium on Spatial User Interaction. ACM, 2018, pp. 36-47.
18 3DSystems, "Touch Haptic Device," https://3dsystems.com/haptics-devices/touch, 2019.
19 M. Kim and Y. J. Kim, "Haptic interfaces for tangible digital painting in VR (extended abstract)," in Proceedings of the Korea Computer Graphics Society, 2019, pp. 20-22.
20 Mozilla, "A-Painter," https://aframe.io/a-painter/, 2019.
21 M. O. Rudel, J. Ganser, R. Weller, and G. Zachmann, "Unrealhaptics: A plugin-system for high fidelity haptic rendering in the unreal engine," in International Conference on Virtual Reality and Augmented Reality. Springer, 2018, pp. 128-147.
22 B. Laugwitz, T. Held, and M. Schrepp, "Construction and evaluation of a user experience questionnaire," in Symposium of the Austrian HCI and Usability Engineering Group. Springer, 2008, pp. 63-76.
23 B. G. Witmer and M. J. Singer, "Measuring presence in virtual environments: A presence questionnaire," Presence, vol. 7, no. 3, pp. 225-240, 1998.   DOI