• The Journal of the Acoustical Society of Korea
• /
• v.21 no.2
• /
• pp.128-133
• /
• 2002

We developed a electronic music glove (BMG) system that plays musical scores in real time processing. The EMG system interfaces with the signal coming from the controller to the sound card in the computer, The computer, according to the status of the fingers and foot switches, generates the sound signals and sends them to the speaker systems through the application C++ program and MIDI message. The EMG systems control the velocity and duration of sound and several musical performance expressions such as chorus, reverberation, rhythm, and volume. Finally, we implemented the digital drum set using: the EMG system as example.

• Journal of KIISE:Computing Practices and Letters
• /
• v.6 no.6
• /
• pp.580-587
• /
• 2000

In this paper, we present a design method of a digital filter converting humming voice melody into MIDI data and a method of adapting it to a distributed multimedia I/O server. MuX uses device-independent DLMs(Dynamic Linking Module) for the inteliace with various I/O devices, and has wave-form audio DLM and MIDI DLM for audio interfaces. In order to expand the audio device interfacing ability of MuX system, we have designed and implemented a filter transforming human voice into MIDI messages. As the methods to input MIDI data are expanded to human voice in addition to MIDI files and MIDI instrument, someone who is not good at playing instruments can also generate the MIDI data, which enables our media interfaces to be used in various applications.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.4
• /
• pp.1869-1886
• /
• 2018

This paper proposes a MIDI- and audio-based music genre classification method for Korean traditional music. There are many traditional instruments in Korea, and most of the traditional songs played using the instruments have similar patterns and rhythms. Although music information processing such as music genre classification and audio melody extraction have been studied, most studies have focused on pop, jazz, rock, and other universal genres. There are few studies on Korean traditional music because of the lack of datasets. This paper analyzes raw audio and MIDI phrases in Korean traditional music, performed using Korean traditional musical instruments. The classified samples and MIDI, based on our classification system, will be used to construct a database or to implement our Kontakt-based instrument library. Thus, we can construct a management system for a Korean traditional music library using this classification system. Appropriate feature sets for raw audio and MIDI phrases are proposed and the classification results-based on machine learning algorithms such as support vector machine, multi-layer perception, decision tree, and random forest-are outlined in this paper.

• Proceedings of the Korean Information Science Society Conference
• /
• 2011.06b
• /
• pp.405-408
• /
• 2011

기존의 작곡가, 곡명 등의 질의어로 대표될 수 있는 메타 데이터 기반 음악 검색은 음악 데이터의 양이 급증함에 따라 탐색 근거가 되는 사항을 모를 경우 사용자의 요구를 충족시켜 줄 수 없는 단점을 가지고 있다 [1]. 반면 음악의 내용을 기반으로 한 검색의 경우 이러한 제약에서 보다 자유로울 수 있다. 내용 기반 검색[2]의 연구에 있어서 음악 데이터로부터 사용자의 질의를 처리해주기 위한 멜로디를 추출해주는 것이 중요한 문제가 되는데, 데이터의 추출과 편집이 용이한 MIDI 파일이 많이 사용되고 있다. 본 논문에서는 사용자의 질의를 바탕으로 한 QBH system상에서의 음악 데이터 구축을 위해 MIDI파일에서 추출해 낼 수 있는 특징들을 이용해 MIDI파일의 멜로디 트랙 멜로디 트랙과 반주 트랙을 자동으로 구분하는 것을 목적으로, MIDI트랙에서 추출해서 이용할 수 있는 특징들에 대해 알아보고 그에 따른 간단한 분류 알고리즘의 제안과 실험 결과에 대해 소개한다.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2014.04a
• /
• pp.533-535
• /
• 2014

본 논문은 교수-학생 음악학습 방식의 단점인 학생의 흥미가 낮아져 참여도가 저하되는 것을 개선하기 위해 멀티미디어를 활용한 교육방법을 제시한다. 제안하는 시스템은 악보를 읽을 수 없는 사람을 위해 악보를 MIDI 로 변환하여 연주해주는 악보인식 기능이 있다 휘파람을 통해 음정 인식하는 기능을 제공하며. 악보의 생성과 편집 기능을 통하여 작곡을 지원하는 기능도 있다. 또한 3D 피아노를 통해 연주법을 시각적으로 학습하는 기능을 제공한다. 이러한 MIDI 를 활용한 소프트웨어 도구를 통하여 기존의 학습 방법인 교수-학생지도 방식을 개선할 수 있다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2017.11a
• /
• pp.1051-1054
• /
• 2017

이 논문에서는 인공지능 기반의 드럼 연습 시스템을 설명하고 있다. 먼저 사용자의 드럼 신로를 MIDI 파일로 변환하고, 이를 DB에 저장되어있던 추천곡의 MIDI 파일과 비교하여 가장 유사한 것을 추천해준다. 또한 실시간으로 사용자의 드럼 연습을 도와주는 전문가 시스템역할을 함으로써 연주의 숙련도를 높여준다.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.427-434
• /
• 2016

This paper focuses on a real-time hardware processing by implementing the ARM Cortex-M4 based embedded system, using a conversion algorithm from a muscular sense to both visual and auditory elements, which recognizes rotations of a human body, directional changes and motion amounts out of human senses. As an input method of muscular sense, AHRS(Attitude Heading Reference System) was used to acquire roll, pitch and yaw values in real time. These three input values were converted into three elements of HSI color model such as intensity, hue and saturation, respectively. Final color signals were acquired by converting HSI into RGB color model. In addition, Three input values of muscular sense were converted into three elements of sound such as octave, scale and velocity, which were synthesized to give an output sound using MIDI(Musical Instrument Digital Interface). The analysis results of both output color and sound signals revealed that input signals of muscular sense were correctly converted into both color and sound in real time by the proposed conversion method.

• Journal of IKEEE
• /
• v.22 no.2
• /
• pp.362-368
• /
• 2018

This paper has implemented a mutual conversion system that mutually converts between body motion signals and both visual and auditory signals. The present study is based on intentional synesthesia that can be perceived by learning. The Euler's angle was used in body movements as the output of a wearable armband(Myo). As a muscle sense, roll, pitch and yaw signals were used in this study. As visual and auditory signals, MIDI(Musical Instrument Digital Interface) signals and HSI(Hue, Saturation, Intensity) color model were used respectively. The method of mutual conversion between body motion signals and both visual and auditory signals made it easy to infer by applying one-to-one correspondence. Simulation results showed that input motion signals were compared with output simulation ones using ROS(Root Operation System) and Gazebo which is a 3D simulation tool, to enable the mutual conversion between body motion information and both visual and auditory information.

• Journal of the Korea Society of Computer and Information
• /
• v.16 no.6
• /
• pp.79-88
• /
• 2011

In this paper, We propose real-time sound editing and playback systems which is based on Augmented Reality. The proposed system are composed with music maker which is based on AR maker and music board. By using music marker's contents, the proposed system selects the kinds of musical instruments and pre-defined midi track and by calculating the relative location of music marker on 2-dimensional plane, we set the spatial relative parameter in midi track. For performance evaluation, we check the jitter value of in various resolutions by using CAM which supports $1600{\pm}1200$ as the maximum resolution. As a result, when we set the configuration value of CAM as $860{\pm}600$ pixels and process two frames per minute, the success ratio of recognizing music markers and jitter values are accegnable. It can be utilized in the fields of alternative cmacine which is based on music and also be utilized in the educational aspects because child or elderly who don't know enough musical theory can easily handle it.