• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.13 no.11
• /
• pp.2273-2276
• /
• 2009

As parents are interested in music education for infants in these days, they require systems to help these infants to actively play music. In this paper, we propose a keyboard solo system using a real time hand recognition method. In order to enable the infants to use the system easily, the proposed system plays some sounds whenever the infants move their fingers on a paper piano. For the purpose of minimizing cost to play music, the proposed system utilizes a general PC with only a paper piano, a web camera, and a speaker. With the aim of precisely and efficiently recognizing both a hand and each key on keyboard, the proposed system divides a recognition step into a hand recognition step and a keyboard recognition step. Also, the hand recognition step considers only skin color, and the keyboard recognition step considers only black and white without other colors.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.9 no.9
• /
• pp.999-1004
• /
• 2014

This intelligent keyboard instrument self learning system developed in this study consists of smartphone based learning application and keyboard-instrument auxiliary module. The keyboard instrument auxiliary module receives playing information of the instrument through smartphone application and bluetooth communication. Then the module shows it through LED display so that the relationship between the keyboard and scale could be easily recognized even for beginners. Also, this system provides saving function and analyzing function of user's performance data, making learning more effective.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2009.10a
• /
• pp.171-172
• /
• 2009

Nowadays the music market is getting bigger while students are losing their creativity because of the cramming education even in the music class. Based on the growing music market, we made a project for students to play the musical instruments more easily. The suggested program is different from any other system because, with this program, we can play the musical instruments if only we have a keyboard made of paper and Webcam, which made us save money. When an user put his finger on the paper keyboard, Webcam makes a sound recognizing the position of the finger on the keyboard. We can choose one instrument out of four; Piano, drum, base and guitar. With this system, we can get an opportunity to learn many sounds of musical instruments and make our own melody.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.12
• /
• pp.219-228
• /
• 2012

In this paper, we propose a paper keyboard piano implementation using the finger movement detection with the 3D image data from a kinect. Keyboard pattern and keyboard depth information are extracted from the color image and depth image to detect the touch event on the paper keyboard and to identify the touched key. Hand region detection error is unavoidable when using the simple comparison method between input depth image and background depth image, and this error is critical in key touch detection. Skin color is used to minimize the error. And finger tips are detected using contour detection with area limit and convex hull. Finally decision of key touch is carried out with the keyboard pattern information at the finger tip position. The experimental results showed that the proposed method can detect key touch with high accuracy. Paper keyboard piano can be utilized for the easy and convenient interface for the beginner to learn playing piano with the PC-based learning software.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2012.07a
• /
• pp.271-272
• /
• 2012

현재 컴퓨터 기반 악기 연주장치에 사용되는 입력장치로는 키보드, 마우스 등의 기본장치, 스마트폰에 널리 사용되는 터치방식, 그리고 전자악기의 MIDI 인터페이스 등과 같이 다양하다. 본 연구에서는 Kinect의 3차원 영상데이터를 이용하여 효율적으로 손가락 움직임을 검출하는 방법을 제안하고 이 정보를 이용하여 피아노 연주 입력장치를 구현함으로써 PC기반 피아노 연주시스템 구현의 편리성을 보였다.