Browse > Article

Implementation of Virtual Violin with a Kinect  

Shin, Young-Kyu (울산대학교)
Kang, Dong-Gil (울산대학교)
Lee, Jung-Chul (울산대학교)
Publication Information
Journal of the Institute of Convergence Signal Processing / v.15, no.3, 2014 , pp. 85-90 More about this Journal
Abstract
In this paper, we propose a virtual violin implementation using the detection of bowing and finger dropping position from the estimated finger tip and finger board information with the 3D image data from a Kinect. Violin finger board pattern and depth information are extracted from the color image and depth image to detect the touch event on the violin finger board and to identify the touched position. Final decision of activated musical alphabet is carried out with the finger drop position and bowing information. Our virtual violin uses PC MIDI to output synthesized violin sound. The experimental results showed that the proposed method can detect finger drop position and bowing detection with high accuracy. Virtual violin can be utilized for the easy and convenient interface for a beginner to learn playing violin with the PC-based learning software.
Keywords
String Instrumnet; Kinect; Image Processing; Virtual Reality;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 J. Hall, S. Kean, and P. Perry, Meet the Kinect: An Introduction to Programming Natural User Interfaces, Apress, 2011.
2 G. Bradski, Learning Opencv: Computer Vision with the Opencv Library, O'REILLY, 2008.
3 R.C. Gonzalez, Digital Image Processing, 3rd edition, Pearson, 2009.
4 P. Messick, Maximum MIDI: Music Applications in C++, Manning Publications, 1998.
5 http://takelessons.com/blog/apps-for-violinists
6 https://itunes.apple.com/us/app/learn-violin/id534046897?mt=8
7 http://www.violinlab.com/
8 http://www.amazon.com/eMedia-EV12090-My-Violin/dp/B000VPRFSE/ref=sr_1_3?s=software&ie=UTF8&qid=1404390359&sr=1-3
9 http://www.doyac.com/new/01info/lect_list.php?lect_mode=violin
10 K.M. Cho, J.H. Jang, and K.S. Hong, "Adaptive Skin-Color Filter," Pattern Recognition, vol.34, no.5, pp.1067-1073, May 2001.   DOI   ScienceOn
11 J.M. Jeong, J.R. Jang, Y.I. Kim, J.W. Park, and W.J. Lee, "Development of the Hand Recognition System for the Mouse Control," Proceeding of Winter Conference of KSCI, vol.19, no.1, pp.173-174, Jan. 2011.
12 S.W. Jang, Y.J. Park, and G.Y. Kim, "Human Skin Region Detection Utilizing Depth Information," Journal of The Korea Society of Computer and Information, vol.17, no.6, pp.29-36, June 2012.
13 S.Y. Cho, H.R. Byun, H.K. Lee, and J.H. Cha, "Hand Gesture Recognition from Kinect Sensor Data," Journal of Broadcast Engineering, vol.17, no.3, pp.447-458, May 2012.   DOI   ScienceOn
14 J.C. Lee and M.S. Kim, "Implementation of Paper Keyboard Piano with a Kinect," Journal of The Korea Society of Computer and Information, vol.17, no.12, pp.221-230, December 2012.
15 D. Catuhe, Programming with the Kinect for Windows Software Development Kit, Microsoft Press, 2012.
16 J. Webb and J. Ashley, Beginning Kinect Programming with the Microsoft Kinect SDK, Apress, 2012.