• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.11 no.6
• /
• pp.1170-1175
• /
• 2007

This paper presents techniques to recognize music using back propagation network one of the neural network algorithms, and to preprocess technique for music mage. Music symbols and music notes are segmented by preprocessing such as binarization, slope correction, staff line removing, etc. Segmented music symbols and music notes are recognized by music note recognizing network and non-music note recognizing network. We proved correctness of proposed music recognition algorithm though experiments and analysis with various kind of musics.

• Journal of Internet Computing and Services
• /
• v.16 no.1
• /
• pp.29-37
• /
• 2015

In this paper, we propose a robust pre-processing module for camera-based Optical Music Score Recognition (OMR) on mobile device. The captured images likely suffer for recognition from many distortions such as illumination, blur, low resolution, etc. Especially, the complex background music sheets recognition are difficult. Through any symbol recognition system, the staff line height and staff line space are used many times and have a big impact on recognition module. A robust and accurate staff line height and staff line space are essential. Some staff line height and staff line space are proposed for binary image. But in case of complex background music sheet image, the binarization results from common binarization algorithm are not satisfactory. It can cause incorrect staff line height and staff line space estimation. We propose a robust staff line height and staff line space estimation by using run-length encoding technique on edge image. Proposed method is composed of two steps, first step, we conducted the staff line height and staff line space estimation based on edge image using by Sobel operator on image blocks. Each column of edge image is encoded by run-length encoding algorithm Second step, we detect the staff line using by Stable Path algorithm and removal the staff line using by adaptive Line Track Height algorithm which is to track the staff lines positions. The result has shown that robust and accurate estimation is possible even in complex background cases.

• Journal of IKEEE
• /
• v.23 no.1
• /
• pp.249-253
• /
• 2019

Most of music-transcription systems that have been commercialized operate based on audio information. However, these conventional systems have disadvantages of environmental dependency, equipment dependency, and time latency. This paper studied a vision-based music-transcription system that utilizes video information rather than audio information, which is a traditional method of music-transcription programs. Computer vision technology is widely used as a field for analyzing and applying information from equipment such as cameras. In this paper, we created a program to generate MIDI file which is electronic music notes by using smart-phone cameras to record the play of piano.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.19 no.5
• /
• pp.959-970
• /
• 1994

In this thesis, a printed score is read by using handy scanner and the recognition process is excuted in parallel, finally, on Mesh-Connected Computer. What is read is classified into certain patterns and is recognized, based on knowledge. The preprocessing steps are minimized and simple operations are used in the algorithm proposed in this thesis. The score symbols on a printed score can be recognized irrespective of their sizes but their diversity males it difficult to recognize them all, so it is programmed so as to recognize some symbols that is used necessarily and frequently. The recognized result is transformed into the MIDI standard file format. It is required to use a parallel processing system with multiprocessors because the high speed image processing is required. A digitized two-dimensional image is appropriate in processing on the SIMD Mesh-Connected Computer(MCC). Therefore, we explain this architecture and present parallel algorithm using SIMD MCC with n processors that achieves time complexity0(n).

• The Journal of the Korea Contents Association
• /
• v.8 no.11
• /
• pp.85-93
• /
• 2008

For music score recognition, several approaches have been proposed including shape matching, statistical methods, neural network based methods and structural methods. In this paper, we deal with recognition for low resolution images which are captured by the digital camera of a mobile phone. Considerable distortions are included in these low resolution images, so when existing technology is used, many problems appear. First, captured images are not stable in the sense that they contain lots of distortions or non-uniform illumination changes. Therefore, notes or symbols in the music score are damaged and recognition process gets difficult. This paper presents recognition technology to overcome these problems. First, musical note to head, stick, tail part are separated. Then template matching on head part of musical note, and remainder part is applied. Experimental results show nearly 100% recognition rate for music scores with single musical notes.

• KIPS Transactions on Software and Data Engineering
• /
• v.8 no.1
• /
• pp.19-26
• /
• 2019

In this paper, the classification performance of learning algorithms is compared for TAB digit recognition. The TAB digits that are segmented from TAB musical notes contain TAB lines and musical symbols. The labeling method and non-linear filter are designed and applied to extract fret digits only. The shift operation of the 4 directions is applied to generate more data. The selected models are Bayesian classifier, support vector machine, prototype based learning, multi-layer perceptron, and convolutional neural network. The result shows that the mean accuracy of the Bayesian classifier is about 85.0% while that of the others reaches more than 99.0%. In addition, the convolutional neural network outperforms the others in terms of generalization and the step of the data preprocessing.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2021.11a
• /
• pp.1148-1151
• /
• 2021

1 인 미디어 산업의 성장으로 다양한 콘텐츠 제작의 증가와 함께 영상의 분위기를 좌우하는 BGM 의 수요도 급증하고 있다. 그러나 무료 음원은 한정되어 있으며 이미 많은 영상에 쓰여 시청자에게 흔한 느낌을 준다. 특히 MCN 에 소속되지 않은 콘텐츠 크리에이터들은 개성 있고 영상에 어울리는 음원 확보에 어려움을 겪고 있다. 본 연구는 이러한 콘텐츠 제작 환경을 개선하기 위해 창작자가 직접 녹음하거나 악보를 스캔해 자신만의 음원을 제작할 수 있는 웹 애플리케이션 '플랫'을 제안한다. 본 연구를 통해 콘텐츠 크리에이터들은 독창적이고 풍성한 콘텐츠를 만들 수 있으며, 음악적 숙련도와 관계없이 쉽게 음원을 만들 수 있어 작곡에 대한 접근성이 좋아질 것으로 보인다. 또한, 딥러닝을 활용해 음악을 창작함으로써 인공지능 작곡 분야를 활성화하고 디지털 음악 시장의 새로운 분야를 개척하는 데 이바지할 것으로 기대한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2012.07a
• /
• pp.267-268
• /
• 2012

본 논문에서는 Google사의 Project glass를 이용한 피아노 연습 어플리케이션을 제안한다. 하지만 아직 이 기기는 발매되지 않았기 때문에 안드로이드 모바일에서 제작중이다. 사용자악보를 database로 간단하게 관리하고, OpenCV라이브러리를 통해 실제 피아노의 위치와 건반을 인식하고, 손가락의 위치 파악과 소리 인식을 통하여 서로 인식한 정보의 일치여부를 확인한다. 그리고 증강현실 기술을 이용하여 게임적인 요소를 추가시켜서 보다 쉽고, 재미있게 실제 피아노 연습을 할 수 있다. 본 논문에서는 기존에 피아노 연주 연습하는 방식에서 IT기술을 접목시켜서, 교육과 기술발전에 기여할 수 있음을 보인다. 그리고 앞으로 영상처리 기술이 널리 사용될 것으로 예상되어 미리 기술을 학습하는 효과도 있다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.10a
• /
• pp.526-528
• /
• 2022

In this study, through the capstone design project, an IoT based piano training system was developed after identifying problems in piano learning. The piano training system recognizes sheet music through image processing technology and checks whether the correct keyboard is struck through FFT transformation during piano practicing. By providing a visual effect and score display function using a rhythm game, it was possible to arouse interest in boring piano practice and increase the effect of piano learning.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.3
• /
• pp.43-50
• /
• 2022

Claude Debussy's is a solo piano piece written in 1894. However, for unknown reasons, the entire piece was not published until 1977, despite clear evidence that Debussy intended to publish it during his lifetime. Interestingly, the second movement of the three pieces comprised in the work was published independently in February 1896 through the Parisian periodical Le Grand Journal. Partly because the work was recently published, it remains relatively more unknown to pianists and music lovers than other piano solo pieces by Debussy. Thus, this article addresses in detail the compositional background of this work, focusing on why the work was not published during Debussy's lifetime. Furthermore, by analyzing this piece in detail, this article intends to discuss the stylistic characteristics of the work regarding its melody, phrase structure, harmony, and form. This survey, which would help understand the musical style embodied in this piece, aims to contribute to improving the awareness of the work.