• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.187-194
• /
• 2013

The final aim of the present study is to build a system of converting a color image into musical elements based on a synesthetic perception, emulating human synesthetic skills, which make it possible to associate a color image with a specific sound. This can be done on the basis of the similarities between physical frequency information of both light and sound. As a first step, an input true color image is converted into hue, saturation, and intensity domains based on a color model conversion theory. In the next step, musical elements including note, octave, loudness, and duration are extracted from each domain of the HSI color model. A fundamental frequency (F0) is then extracted from both hue and intensity histograms. The loudness and duration are extracted from both intensity and saturation histograms, respectively. In experiments, the proposed system on the conversion of a color image into musical elements was implemented using standard C and Microsoft Visual C++(ver. 6.0). Through the proposed system, the extracted musical elements were synthesized to finally generate a sound source in a WAV file format. The simulation results revealed that the musical elements, which were extracted from an input RGB color image, reflected in its output sound signals.

• Smart Media Journal
• /
• v.7 no.2
• /
• pp.23-33
• /
• 2018

A musical sheet is read by optical music recognition (OMR) systems that automatically recognize and reconstruct the read data to convert them into a machine-readable format such as XML so that the music can be played. This process, however, is very challenging due to the large variety of musical styles, symbol notation, and other distortions. In this paper, we present a model for the recognition of musical symbols through the use of a mobile application, whereby a camera is used to capture the input image; therefore, additional difficulties arise due to variations of the illumination and distortions. For our proposed model, we first generate a line adjacency graph (LAG) to remove the staff lines and to perform primitive detection. After symbol segmentation using the primitive information, we use a covariance-matching method to estimate the similarity between every symbol and pre-defined templates. This method generates the three hypotheses with the highest scores for likelihood measurement. We also add a global consistency (time measurements) to verify the three hypotheses in accordance with the structure of the musical sheets; one of the three hypotheses is chosen through a final decision. The results of the experiment show that our proposed method leads to promising results.

• Journal of Korea Multimedia Society
• /
• v.17 no.10
• /
• pp.1239-1252
• /
• 2014

The OST (Original Sound Track) in the film plays a vital role in increasing consensus and concentration to the storyline. The selected 4 animations are classified into 17 Narrative Processes (NP) by using NP Classification Model [1]. For the NPs each having OSTs, the authors have investigated 6 kinds of objective musical elements of the OST such as sound (speech, music, effect), tonality, tempo, range, intensity, and instrumentation. It is found that there are 33.3% common musical elements among all of them for the NPs with OSTs commonly. Among them, it is also found that there are 71.9% of common properties of the musical element. This research is meaningful by firstly showing that there are common properties of objective musical elements in each NP and the corresponding OST.

• Korean Institute of Interior Design Journal
• /
• v.21 no.5
• /
• pp.162-170
• /
• 2012

This study aims to show the possibility of approaching artistic design through the Bergsonian concept of musical vitality by grasping the expression of his musical vitality at the Chapel at Ronchamp. For the purpose of this study, the aesthetic significance of Bergson's philosophy of life was first contemplated, and a case study analysis was conducted on the vitality of music as temporality at the Chapel at Ronchamp. On this basis, the examples of his musical vitality as metaphysical reality at the Chapel were analyzed. The results of analysis are as follows: First, the Bergsonian vitality of music as temporality at the Chapel is expressed as a sense of movement-through the acoustic form, the modulor corresponding to the scale of the music, the opposite composition of musical changes, the fluid space of the music, and the light and shadow of counterpoint-as having been intended by Le Corbusier in the very process of design. Second, the vitality of music as Bergson's metaphysical reality at the Chapel at Ronchamp is expressed in the image and rhythm of music created by intuitive reminiscences. The acoustic form, the form created by the modulor, the opposite form of composition, the fluid space and the light and shadow as the melody and image of music present continuous diversity as vital flow in a uniform direction. The vitality of music as aesthetical reality is imitated by the rhythm of the music deriving from repetitive movements sensed here. Consequentry, the Chapel at Ronchamp can be seen as a vital design that expresses Bergson's notion of musical vitality, indicating that an approach toward artistic design can be realized through his musical vitality. This study holds significance as basic research on artistic design with philosophy and music as its origin.

• Journal of Broadcast Engineering
• /
• v.26 no.7
• /
• pp.838-843
• /
• 2021

This paper presents an algorithm for effective retrieval of score information to an input score image. The originality of the proposed algorithm is that it is designed to be robust to recognition errors by an OMR (Optical Music Recognition), while existing methods such as pitch histogram requires error induced OMR result be corrected before retrieval process. This approach helps people to retrieve score without training on music score for error correction. OMR takes a score image as input, recognizes musical symbols, and produces structural symbolic notation of the score as output, for example, in MusicXML format. Among the musical symbols on a score, it is observed that filled noteheads are rarely detected with errors with its simple black filled round shape for OMR processing. Barlines that separate measures also strong to OMR errors with its long uniform length vertical line characteristic. The proposed algorithm consists of a descriptor for a score and a similarity measure between a query score and a reference score. The descriptor is based on note-count, the number of filled noteheads in a measure. Each part of a score is represented by a sequence of note-count numbers. The descriptor is an n-gram sequence of the note-count sequence. Simulation results show that the proposed algorithm works successfully to a certain degree in score image-based retrieval for an erroneous OMR output.

• Proceedings of the Acoustical Society of Korea Conference
• /
• 1994.06a
• /
• pp.752-757
• /
• 1994

Very often, one would like to have visual image of mechanical or acoustical events such as musical sound and transient vibrations. Conventional methods to visualize the signal, such as power spectrum, do not normally allow to cultivate the signal of interests due to their inherent limitation on transient signals. Other than the conventional method, one could use an instantaneous frequency which can reveal the variation of frequency in terms of time. Nevertheless it is quite sensitive to noise and can not resolve the frequency components of signals; normally produces additional components other than those of the signals. In this paper, we introduce the Wigner-Ville spectrum to see the transient characteristics of signal, especially musical sound and transient mechanical vibration signatures. For musical sound, several popular western classic music have been selected for the analysis. For the transient mechanical signature, the signals obtained from the car door experiment and the beam experiment are interpreted in terms of Wigner-Ville spectrum. Results demonstrate the visual expressions of transient signals; musical sound and vibrations.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.50-60
• /
• 2015

The animation film , which became a worldwide sensation with its theme song 'Let it go', did not only rank first in the U.S. box office - it was also the greatest box office hit in the history of Disney animation. Why did , recreated into a musical animation, become a worldwide success and what were the characteristics of its materialized hybrid visual direction technique? In order to look into this, firstly, literature on musicals and animations were studied, and secondly, analysis standards were drawn for musical characteristics of musicals and direction techniques of animations. Thirdly, analyzation and investigation will be conducted on hybrid visual direction techniques based on the research above with as the example. Through this study, it's known that realizes its musical features such as 'exaggerated acting,' 'delivering the meaning of circumstances', 'dramatic expression of emotion' and etc. through animated characters and that its background music is aided by 'narrative features' through its musical composition. Besides, its snow effect through animated VFX composing scenes along with its musical characteristics realizes hybrid image direction. It can be said that image directing effects of musical animations through hybrid grafting and the characteristics of image aesthetics generate public demands worldwide.

• Proceedings of the KIEE Conference
• /
• 1992.07a
• /
• pp.427-430
• /
• 1992

In this paper, we proposed an algorithm for the musical note recognition. Firstly, a given bit-mapped music score image is converted to a set of individual note pattern images via vertical projection. Then, the pitch of a note is determinal by comparison in the note-head position with the reference five-lines. Also, the length of a note is found via leader clustering with a set of normalized note patterns. Finally, a datafile to play the music is obtained using the pitch and length of musical notes. Experimental results with a simple musical score image show that the proposed scheme is performed well.

• Journal of the Korea Society of Computer and Information
• /
• v.21 no.9
• /
• pp.19-25
• /
• 2016

This paper is to recognize and play tab chords from guitar musical sheets. The musical chord area of an input image is segmented by changing the image in saturation and applying the Grabcut algorithm. Based on a template matching, our approach detects tab starting sections on a segmented musical area. The virtual block method is introduced to search blanks over chord lines and extract tab fret segments, which doesn't cause the computation loss to remove tab lines. In the experimental tests, the prototype based classification outperforms Bayesian method and the nearest neighbor rule with the whole set of training data and its performance is similar to that of the support vector machine. The experimental result shows that the prediction rate is about 99.0% and the number of selected prototypes is below 3.0%.

• Cartoon and Animation Studies
• /
• s.12
• /
• pp.27-43
• /
• 2007

The article concerns the continuity and transformation of the cartoon strip for the musical performance. Recently, the cartoon strip has been considered as a resource for creating the musical performance. However, There are a few articles on the relationship of the cartoon strip and the musical performance. In this respect, the article seeks to examine the characteristics of the cartoon strip and the musical performance in terms of planning system, storytelling structure, character formation and marketing strategies. The case on the musical entitled 'The Great Catsby', which is rooted in the cartoon strip entitled 'The Great Catsby', is examined. As a result, on the one hand, the characteristics of the cartoon strip has continuously affected the process of creating the musical performance in terms of storytelling, character formation, stage management and the marketing activities. On the other hand, the musical performance considers the music and sound, the moving image and stage management, performance of the actors as an essential part in comparison with the cartoon strip. In addition, the musical performance simplifies and recontructs the cartoon strip according to the principles of the musical performance.