• 감성과학
• /
• 제16권2호
• /
• pp.187-194
• /
• 2013

본 연구는 컬러영상에서 특정소리를 연상시킬 수 있는 공감각 인지현상에 기반하여 컬러이미지에서 음악요소로 변환하는 시스템의 구현을 최종 목표로 한다. 이는 빛과 소리의 물리적 주파수정보사이의 유사도를 기반으로 이루어진다. 입력 컬러영상은 우선 컬러모델변환이론에 기초하여 색상(Hue), 채도(Saturation) 및 명도(Intensity)영역으로 변환된다. 음계, 옥타브, 크기 및 시간길이 등의 음악적 성분들이 HSI 컬러모델의 각 영역으로부터 추출된다. 기본주파수(F0, Fundamental Frequency)는 색상 및 명도 히스토그램에서 추출되고, 크기 및 시간길이성분은 명도와 채도 히스토그램에서 추출된다. 실험에서, 제안된 시스템은 표준 C 및 VC++ 기반에서 실현되었고, 최종적으로 WAV 포맷의 사운드파일이 생성되었다. 시뮬레이션 결과를 통해서 입력 컬러영상에서 추출된 음악적 요소들이 출력 사운드신호에 반영됨을 알 수 있었다.

• 스마트미디어저널
• /
• 제7권2호
• /
• pp.23-33
• /
• 2018

A musical sheet is read by optical music recognition (OMR) systems that automatically recognize and reconstruct the read data to convert them into a machine-readable format such as XML so that the music can be played. This process, however, is very challenging due to the large variety of musical styles, symbol notation, and other distortions. In this paper, we present a model for the recognition of musical symbols through the use of a mobile application, whereby a camera is used to capture the input image; therefore, additional difficulties arise due to variations of the illumination and distortions. For our proposed model, we first generate a line adjacency graph (LAG) to remove the staff lines and to perform primitive detection. After symbol segmentation using the primitive information, we use a covariance-matching method to estimate the similarity between every symbol and pre-defined templates. This method generates the three hypotheses with the highest scores for likelihood measurement. We also add a global consistency (time measurements) to verify the three hypotheses in accordance with the structure of the musical sheets; one of the three hypotheses is chosen through a final decision. The results of the experiment show that our proposed method leads to promising results.

• 한국멀티미디어학회논문지
• /
• 제17권10호
• /
• pp.1239-1252
• /
• 2014

The OST (Original Sound Track) in the film plays a vital role in increasing consensus and concentration to the storyline. The selected 4 animations are classified into 17 Narrative Processes (NP) by using NP Classification Model [1]. For the NPs each having OSTs, the authors have investigated 6 kinds of objective musical elements of the OST such as sound (speech, music, effect), tonality, tempo, range, intensity, and instrumentation. It is found that there are 33.3% common musical elements among all of them for the NPs with OSTs commonly. Among them, it is also found that there are 71.9% of common properties of the musical element. This research is meaningful by firstly showing that there are common properties of objective musical elements in each NP and the corresponding OST.

• 한국실내디자인학회논문집
• /
• 제21권5호
• /
• pp.162-170
• /
• 2012

This study aims to show the possibility of approaching artistic design through the Bergsonian concept of musical vitality by grasping the expression of his musical vitality at the Chapel at Ronchamp. For the purpose of this study, the aesthetic significance of Bergson's philosophy of life was first contemplated, and a case study analysis was conducted on the vitality of music as temporality at the Chapel at Ronchamp. On this basis, the examples of his musical vitality as metaphysical reality at the Chapel were analyzed. The results of analysis are as follows: First, the Bergsonian vitality of music as temporality at the Chapel is expressed as a sense of movement-through the acoustic form, the modulor corresponding to the scale of the music, the opposite composition of musical changes, the fluid space of the music, and the light and shadow of counterpoint-as having been intended by Le Corbusier in the very process of design. Second, the vitality of music as Bergson's metaphysical reality at the Chapel at Ronchamp is expressed in the image and rhythm of music created by intuitive reminiscences. The acoustic form, the form created by the modulor, the opposite form of composition, the fluid space and the light and shadow as the melody and image of music present continuous diversity as vital flow in a uniform direction. The vitality of music as aesthetical reality is imitated by the rhythm of the music deriving from repetitive movements sensed here. Consequentry, the Chapel at Ronchamp can be seen as a vital design that expresses Bergson's notion of musical vitality, indicating that an approach toward artistic design can be realized through his musical vitality. This study holds significance as basic research on artistic design with philosophy and music as its origin.

• 방송공학회논문지
• /
• 제26권7호
• /
• pp.838-843
• /
• 2021

This paper presents an algorithm for effective retrieval of score information to an input score image. The originality of the proposed algorithm is that it is designed to be robust to recognition errors by an OMR (Optical Music Recognition), while existing methods such as pitch histogram requires error induced OMR result be corrected before retrieval process. This approach helps people to retrieve score without training on music score for error correction. OMR takes a score image as input, recognizes musical symbols, and produces structural symbolic notation of the score as output, for example, in MusicXML format. Among the musical symbols on a score, it is observed that filled noteheads are rarely detected with errors with its simple black filled round shape for OMR processing. Barlines that separate measures also strong to OMR errors with its long uniform length vertical line characteristic. The proposed algorithm consists of a descriptor for a score and a similarity measure between a query score and a reference score. The descriptor is based on note-count, the number of filled noteheads in a measure. Each part of a score is represented by a sequence of note-count numbers. The descriptor is an n-gram sequence of the note-count sequence. Simulation results show that the proposed algorithm works successfully to a certain degree in score image-based retrieval for an erroneous OMR output.

• 한국음향학회:학술대회논문집
• /
• 한국음향학회 1994년도 FIFTH WESTERN PACIFIC REGIONAL ACOUSTICS CONFERENCE SEOUL KOREA
• /
• pp.752-757
• /
• 1994

Very often, one would like to have visual image of mechanical or acoustical events such as musical sound and transient vibrations. Conventional methods to visualize the signal, such as power spectrum, do not normally allow to cultivate the signal of interests due to their inherent limitation on transient signals. Other than the conventional method, one could use an instantaneous frequency which can reveal the variation of frequency in terms of time. Nevertheless it is quite sensitive to noise and can not resolve the frequency components of signals; normally produces additional components other than those of the signals. In this paper, we introduce the Wigner-Ville spectrum to see the transient characteristics of signal, especially musical sound and transient mechanical vibration signatures. For musical sound, several popular western classic music have been selected for the analysis. For the transient mechanical signature, the signals obtained from the car door experiment and the beam experiment are interpreted in terms of Wigner-Ville spectrum. Results demonstrate the visual expressions of transient signals; musical sound and vibrations.

• 한국콘텐츠학회논문지
• /
• 제15권12호
• /
• pp.50-60
• /
• 2015

주제가 'Let it go'로 세계적인 열품을 주도한 애니메이션 영화 <겨울왕국 (Frozen), 2013> 은 전미박스 오피스 1위를 넘어 역대 디즈니 애니메이션 중 최고의 흥행을 거두었다. 뮤지컬 애니메이션으로 재창조된 <겨울왕국, 2013>이 세계적인 흥행 효과를 거두는 이유에 대해 뮤지컬 애니메이션의 혼성적 영상연출 기법을 중심으로 분석코자 한다. 이에 대해 알아보기 위해, 첫째, 뮤지컬 애니메이션에 대해 문헌을 중심으로 고찰하고, 둘째, 뮤지컬의 음악적 특성과 애니메이션의 연출기법을 중심으로 분석기준을 도출하였다. 셋째, 이를 바탕으로 뮤지컬 애니메이션 <겨울왕국, 2013>을 사례로 하여 혼성적 영상연출기법에 대해 분석 및 검증한다. 본 연구를 통해 <겨울왕국, 2013>은 '연기의 과장성', '상황의미 전달', '감성의 극적인 표출' 등의 뮤지컬의 음악적 특성이 애니메이션 캐릭터를 통해 구현되고 있으며, 배경음악과 노래는 뮤지컬적 구성을 통해 '서사적 기능'이 이루어지고 있음을 알 수 있다. 또한, 애니메이션의 VFX를 통한 눈의 효과가 뮤지컬의 음악적 특성과 함께 장면을 구성하면서 혼성적 영상연출이 구현되었다. 이를 통해, 혼종적 접목을 통한 뮤지컬 애니메이션의 영상 연출적 효과와 영상미학적 특성이 범세계적인 대중적 기호에 부합하고 있음을 알 수 있다.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 1992년도 하계학술대회 논문집 A
• /
• pp.427-430
• /
• 1992

In this paper, we proposed an algorithm for the musical note recognition. Firstly, a given bit-mapped music score image is converted to a set of individual note pattern images via vertical projection. Then, the pitch of a note is determinal by comparison in the note-head position with the reference five-lines. Also, the length of a note is found via leader clustering with a set of normalized note patterns. Finally, a datafile to play the music is obtained using the pitch and length of musical notes. Experimental results with a simple musical score image show that the proposed scheme is performed well.

• 한국컴퓨터정보학회논문지
• /
• 제21권9호
• /
• pp.19-25
• /
• 2016

This paper is to recognize and play tab chords from guitar musical sheets. The musical chord area of an input image is segmented by changing the image in saturation and applying the Grabcut algorithm. Based on a template matching, our approach detects tab starting sections on a segmented musical area. The virtual block method is introduced to search blanks over chord lines and extract tab fret segments, which doesn't cause the computation loss to remove tab lines. In the experimental tests, the prototype based classification outperforms Bayesian method and the nearest neighbor rule with the whole set of training data and its performance is similar to that of the support vector machine. The experimental result shows that the prediction rate is about 99.0% and the number of selected prototypes is below 3.0%.

• 만화애니메이션 연구
• /
• 통권12호
• /
• pp.27-43
• /
• 2007

이 연구는 만화 원작을 소재로 한 뮤지컬의 기획과 스토리텔링 및 마케팅체계를 분석하여 만화의 뮤지컬화 과정에서 만화의 특성이 어떻게 고려되고 있는가를 분석하는데 초점을 두었다. 이를 위하여 만화 '위대한 캣츠비'가 '뮤지컬 '위대한 캣츠비'로 재구성된 사례를 미디어믹스 관점에서 분석하였다. 사례분석은 만화를 활용한 뮤지컬의 기획 체계, 스토리텔링구조, 캐릭터설정, 마케팅 체계를 중심으로 이루어졌다. 분석결과, 만화의 세계관과 스토리텔링 체계는 뮤지컬의 기획 및 마케팅 과정에서도 중요한 요소로 고려되고 있지만, 작가주의 관점보다는 관객의 수요와 몰입을 유도하기 위한 관점에서 강조와 생략 및 변형을 통해 재구조화되는 것으로 나타났다. 뮤지컬의 비주얼스토리텔링 구조는 디지털영상과 무대관리, 그리고 음악을 활용하여 서사적 스토리텔링과 연결되는 종합적인 체계로 이루어져 있다. 그리고 만화뮤지컬은 스토리텔링과 캐릭터 설정과정에서 명확하고 대립적인 부분을 부각시키고, 갈등과 해소, 극적 반전, 코믹요소 활동 등을 통해 관객의 몰입을 유도하고 있다. 또한 만화의 시각적 이미지와 상징기호들은 뮤지컬의 디지털영상과 무대장치 및 소품 등 무대연출을 통해 뮤지컬특성에 맞게 재구성되고 있는 것을 나타났다. 결론적으로 만화의 뮤지컬화 작업은 기획, 제작, 마케팅 과정 전반에 걸쳐서 만화의 특성을 중심축으로 뮤지컬의 특성과 산업구조를 고려하여 이루어진다고 볼 수 있다.