• Journal of Korea Game Society
• /
• v.15 no.2
• /
• pp.115-122
• /
• 2015

In this paper we propose a serious game for experience of music performance, which allows users to readily enjoy musical playing, even if the player has little or no experience in playing musical instruments. This game makes it easier for users to correctly perform given melodies along with standard performance, using a score-adjusting algorithm that can cope with the particular errors commonly made by beginners. This music performance is achieved by the agent to interpret the gestural sign of the user. We understands the interaction of the user and the agent as a communication model from the Peircean Semiotic perspectives.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2015.10a
• /
• pp.949-951
• /
• 2015

컴퓨터의 활용 범위가 다양화되면서 음악 분야에도 컴퓨터의 역할이 점점 커지고 있다. 기존의 악보 인식 방법들은 대부분 특정 프로그램에서 작성된 악보만 편집과 재생이 가능하고 다른 프로그램에서 작성된 악보는 수정과 재생이 어려운 문제가 있었다. 본 논문에서는 이러한 단점을 보완하여 이미 작성된 악보를 자동으로 인식하고 재생할 수 있는 스마트폰 애플리케이션을 설계하고 구현한다. 스마트폰 소지자는 언제 어디서나 원하는 악보를 획득할 수 있으며, 폰에 내장된 카메라를 이용하여 악보를 인식시킨 후 연주 기능을 이용하여 음악을 즐길 수 있다.

• Journal of Music and Human Behavior
• /
• v.8 no.1
• /
• pp.1-16
• /
• 2011

This study was to investigate the influence of using Therapeutic Instrumental Music Performance (TIMP) in uninvolved hand function for children with spastic cerebral palsy. Participants were recruited from a welfare center for people with cerebral palsy(CP). Ages ranged from 11 to 12, and a total of 15 TIMP sessions were provided for 3 weeks. Hand function tests were used including Jebsen Hand Function Test for hand function, Box and Block Test for dexterity of uninvolved hand, and MIDI (Musical Instrument Digital Interface) evaluation for velocity of fingers. The TIMP program consisted of hand percussion playing and keyboard playing with changes of timbre and tempo. While the scores of Jebsen test and Box and Block test were improved for all participants, outcomes of MIDI analysis showed differences among participants. Overall, hand function improvements were observed after the completion of using the TIMP program, and the results implies that the TIMP program can be applied in upper extremity rehabilitation for children with CP.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2008.08a
• /
• pp.165-168
• /
• 2008

이 논문에서는 멀티미디어 컴퓨터에 연결된 미디키보드를 사용하여 피아노 연주를 혼자서 배우고 연습할 수 있도록 하기 위한 지능형 교습 시스템을 개발하기 위하여, 시스템 구조 및 모듈별 기능과 기본적인 사용자 인터페이스를 설계하였다. 시스템의 구조는 미디 키보드의 실시간 연주 샘플링 모듈, 미디 데이타의 시퀀싱 모듈, 사운드 합성 모듈과 연결된 지능형 교습 시스템이 된다. 세분화된 모듈별 기능에서는 학습 콘텐츠, 학습자 모델, 진단 평가 모듈, 진도 관리 모듈, 등의 세부적인 기능 설계가 필요하다. 학습자 모델을 기반으로 진단 편가 및 진도 관리를 지능적으로 처리하기 위해서 CLIPS를 사용한 전문가시스템 접근을 사용한다. 컴퓨터 화면상의 악보 디스플레이, 실시간 연주 화면, 진단 평가 디스플레이를 위한 GUI 설계가 필요하다. 그리고, 향후 콘텐츠 구축 및 시스템 구현 시에 예상되는 문제점과 해결 방안을 논의한다.

• Journal of Digital Contents Society
• /
• v.12 no.4
• /
• pp.575-583
• /
• 2011

Due to the development of mobile devices and communication technology, cell phones have radically evolved from portable phones into smartphones and provided variety of services to a society. This paper presents Multi-user Musical Instrument application for smart phones based on band instruments such as piano, guitar, bass guitar, and drum. This application makes music playing from smartphone to integrative music data stream using the synchronization function of server. In addition, user can play it of smartphone efficiently by implementing a graphic user interface similar to real musical instruments.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2014.04a
• /
• pp.533-535
• /
• 2014

본 논문은 교수-학생 음악학습 방식의 단점인 학생의 흥미가 낮아져 참여도가 저하되는 것을 개선하기 위해 멀티미디어를 활용한 교육방법을 제시한다. 제안하는 시스템은 악보를 읽을 수 없는 사람을 위해 악보를 MIDI 로 변환하여 연주해주는 악보인식 기능이 있다 휘파람을 통해 음정 인식하는 기능을 제공하며. 악보의 생성과 편집 기능을 통하여 작곡을 지원하는 기능도 있다. 또한 3D 피아노를 통해 연주법을 시각적으로 학습하는 기능을 제공한다. 이러한 MIDI 를 활용한 소프트웨어 도구를 통하여 기존의 학습 방법인 교수-학생지도 방식을 개선할 수 있다.

• Journal of Music and Human Behavior
• /
• v.10 no.1
• /
• pp.1-23
• /
• 2013

Upper extremity dysfunction is a common consequence following stroke. Spontaneous recovery during the first six months post-stroke is rigorous and considered as a significant indicator of potential long-term progress. Various approaches have been utilized to regain functional upper limb movement necessary for independent living; however, conventional therapy approaches have failed to prove consistency, especially for subacute stroke patients. There is, thus, a need for innovative therapeutic strategies that motivate stroke survivors to facilitate neural and functional recovery during the critical window immediately following stroke. The effect of music on physical enhancement has been frequently reported in the field of medicine as well as neurorehabilitation. The efficacy of rhythm on lower extremity deficits has been well established. Yet, the rationale for using instrumental music making enhancing subacute upper extremities rehabilitation is not clearly described to date. Based on the key mechanism of music as sensori-motor movement facilitator, this paper reviews previous empirical research that utilized music-based interventions for upper extremity rehabilitation for stroke patients, either in the form of receptive or expressive activity. This paper, further, focuses on the current research trends in subacute stroke upper limb rehabilitation and provides applicable rationale of using instrumental music playing.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2021.05a
• /
• pp.238-241
• /
• 2021

가상현실은 시·공간을 초월하는 경험이 가능하며 아이들의 몰입감과 학습효과를 높일 수 있어 교육 도구로서의 가치를 인정받고 있다. 정부는 VR 기기를 전국의 초등학교에 보급하고 있지만, 양질의 교육용 실감형 콘텐츠는 부족한 상황이다. 따라서, 본 논문에서는 가상현실 기술을 활용한 국악기 연주 체험 프로그램을 제안하였다. Unity의 물리 엔진과 Oculus의 햅틱 기능을 이용하여 전통 국악기 중 편경을 실감 나게 연주할 수 있도록 가상환경을 구현하였다. 리듬 게임 형식을 적용하여 아이들의 흥미 또한 유발하였다. 이 프로그램을 통해 국악기를 직접 연주하며 해당 국악기에 대한 지식을 자연스럽게 습득할 수 있을 것이라 기대한다.

• The Journal of the Korea Contents Association
• /
• v.10 no.6
• /
• pp.213-221
• /
• 2010

Recently, as the scale of the cultural content business market is being growed, it required that we should introduce the Korean music culture which is unique and competitive cultural contents to the worldwide. This paper proposes a Samulnori Ensemble System (SES), using a touch interface which plays the Korean traditional musical instruments. A SES consists of the Control Device which supports touch functions, the Performance Manager that detects signals from the Control Device and plays a melody, and the Communication Manager making a ensemble among the possible devices. Also, using the Network Time Protocol which is part of Synchronization Manager can be paly different speed communication environments. We utilized multi-touch functions to operate the system. We also implemented multi-touch interface and multi-play with other player for fun and interesting who are not interested Samulnori.

• Journal of Music and Human Behavior
• /
• v.19 no.2
• /
• pp.81-103
• /
• 2022

The effects of therapeutic instrumental music performance (TIMP) using a ukulele were examined in adults with central nervous system damage and impaired hand functions. The participants were three adults with neurological damage who participated in 30-min sessions twice a week over 6 weeks. Changes in hand function was measured by the Box and Block Test (BBT), the 9-Hole Peg Test (9-HPT), and the Jebsen-Taylor Hand Function Test (JTHFT). Following the intervention, all three participants showed increases in the BBT and 9-HPT scores, indicating positive changes in fine motor coordination and dexterity. In terms of the JTHFT, all three participants showed increases in the "writing" and "card flipping" subtask scores, indicating that the intervention was effective in improving more coordinated finger movements. All participants reported the satisfaction with the intervention. They also pointed out that they were motivated to play the ukulele and that following the intervention used their affected hand more frequently in daily activities. These findings suggest that TIMP with a ukulele for patients with central nervous system damage can have positive effects on their functional hand movements and motivate these patients to practice their rehabilitation exercises.