Browse > Article
http://dx.doi.org/10.3745/KTSDE.2015.4.9.403

A Study on a Feedback-Centric Piano Education System Using Kinect Sensors  

Park, So Hyun (숙명여자대학교 멀티미디어과학과)
Ihm, Sun Young (숙명여자대학교 멀티미디어과학과)
Park, Eun Young (협성대학교 시각디자인학과)
Son, Jong Seo (숙명여자대학교 글로벌서비스학부 앙트러프러너십전공)
Park, Young Ho (숙명여자대학교 멀티미디어과학과)
Publication Information
KIPS Transactions on Software and Data Engineering / v.4, no.9, 2015 , pp. 403-408 More about this Journal
Abstract
Kinect sensors have the ability to recognize the behavior and voice of the user. Due to its low-cost and high accessibility, Kinect sensors have been used in various fields, including healthcare, education and so on. In this paper, we propose to use Kinect in piano education. Specifically, the proposed method first recognizes the coordinate values of user's posture, compares them with coordinate values of teacher's posture and provide real-time feedbacks to the user. This enables user to keep the correct posture even when he is learning piano without a teacher. However, since the piano education is a long process, it is difficult to achieve the correct posture as a teacher immediately. Thus, we propose a user-oriented method to measure the error tolerance rate. The proposed method is the first feedback based piano education system that uses Kinect sensors.
Keywords
Kinect Sensor; Piano Education System; Motion Recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Wikipedia Kinect [Internet], https://en.wikipedia.org/wiki/Kinect_for_Xbox_One.
2 D. Gonzalez-Ortega, F. J. Diaz-Pernas, M. Martinex-Zarzuela, and M. Anton-Rodriguez, "A Kinect-based system for cognitive rehabilitation exercises monitoring," International Journal of Computer Methods and Programs in Biomedicine, Vol.113, Issue.2, pp.620-631.
3 B. Lange, C. Y. Chang, E. Suman, B. Newman, A. S. Rizzo, and M. Bolas, "Development and Evaluation of Low Cost Game-Based Balance Rehabilitation Tool Using the Microsoft Kinect Sensor," International Conference of the IEEE EMBS, Massachusetts, USA, pp.1831-1934, 2011.
4 A. Hadjakos, E. Aitenbichler, and M. Muhlhauser, "The Elbow Piano: Sonification of Piano Playing Movements," Domestic Conference on New Interfaces for Musical Expression (NIME08), Genova, Italy, pp.285-288, 2008.
5 P. Payeur, J. Beacon, and A. M. Cretu, "Human Gesture Quantification: an Evaluation Tool for Somatic Training and Piano Performance," International Conference on Haptic, Audio and Visual Environments and Games(HAVE), Texas, USA, pp.100-105, 2014.
6 J. Dancs, R. Sivalingam, G. Somasundaram, V. Morellas, and N. Papanikolopoulos, "Recognition of Ballet Micro-Movements for Use in Choreography," International Conference on Intelligent Robots and Systems(IROS), Tokyo, Japan, pp. 1162-2267, 2013.
7 J. Mora, W. S. Lee, and G. Comeau, "3D Visual Feedback in Learning of Piano Posture," International Journal of Technologies for E-Learning and Digital Entertainment, Vol.4469, pp.763-771, 2007.   DOI
8 J. L. Song, "Piano Performance and Pedagogy," Eumagchunchu Publishing Company, 2006.
9 F. Seymour, "Mastering Piano Technique," Amadeus Press, 1992.
10 C. J. Yang, "An Analysis on Physical Roles related With Piano Technic," The Institute of Human Science Anyang University, Vol.7, ISSN: 1598-7396, 1999.
11 MDS Technology [Internet], http://www.mdstec.com.
12 Microsoft Kinect [Internet], http://www.microsoft.com/enus/kinectforwindows.