• The Journal of the Convergence on Culture Technology
• /
• v.8 no.5
• /
• pp.171-176
• /
• 2022

This paper examines the historical meaning and value of sound art curating as a key type of interdisciplinary and convergence art practice that has been unfolding since the mid-20th century. Accordingly, this paper summarizes the developmental process from the beginning of 'sound art' to the present, but examines the context of visual art in which the material 'sound' functioned in chronological order, and focuses on curating cases of major sound art exhibitions. The purpose of this study is to analyze the impact and contemporary significance of the provided aesthetic experience. To this end, the text is divided into three sections and developed. The first section recognizes that the late 19th century futurist and Dadaist sound poetry, followed by Marcel Duchamp's 1913 attempt to combine musical score with visual art, had a profound influence on the visual music of avant-garde composer John Cage. This explains why this background caused the emergence of exhibitions dealing with 'sound' as a new medium. The second section explains that in the 1970s, sound as an artistic medium played a role in reflecting the critical relationship with the exhibition space dominated by visuality. In the third section, we analyze the curatorial methodology that allows the audience to experience sound as if it were a visual object within the organization of the exhibition hall from the 1980s to the present. Through this process, this paper critically treats the historical practice of customizing the perceptual structure in the exhibition hall, and considers the meaningful methodology of sound art curating considering the role of sound full of vitality in the contemporary art scene.

• The Journal of the Acoustical Society of Korea
• /
• v.42 no.2
• /
• pp.102-111
• /
• 2023

Automatic Music Transcription (AMT) is a task that detects and recognizes musical note events from a given audio recording. In this paper, we focus on reducing the latency of real-time AMT systems on piano music. Although neural AMT models have been adapted for real-time piano transcription, they suffer from high latency, which hinders their usefulness in interactive scenarios. To tackle this issue, we explore several techniques for reducing the intrinsic latency of a neural network for piano transcription, including reducing window and hop sizes of Fast Fourier Transformation (FFT), modifying convolutional layer's kernel size, and shifting the label in the time-axis to train the model to predict onset earlier. Our experiments demonstrate that combining these approaches can lower latency while maintaining high transcription accuracy. Specifically, our modified model achieved note F1 scores of 92.67 % and 90.51 % with latencies of 96 ms and 64 ms, respectively, compared to the baseline model's note F1 score of 93.43 % with a latency of 160 ms. This methodology has potential for training AMT models for various interactive scenarios, including providing real-time feedback for piano education.

• The Journal of the Acoustical Society of Korea
• /
• v.28 no.2
• /
• pp.112-118
• /
• 2009

This paper proposes a rapid detection algorithm of a salient region for music video browsing system, which can be applied to mobile device and digital video recorder (DVR). The input music video is decomposed into the music and video tracks. For the music track, the music highlight including musical chorus is detected based on structure analysis using energy-based peak position detection. Using the emotional models generated by SVM-AdaBoost learning algorithm, the music signal of the music videos is classified into one of the predefined emotional classes of the music automatically. For the video track, the face scene including the singer or actor/actress is detected based on a boosted cascade of simple features. Finally, the salient region is generated based on the alignment of boundaries of the music highlight and the visual face scene. First, the users select their favorite music videos from various music videos in the mobile devices or DVR with the information of a music video's emotion and thereafter they can browse the salient region with a length of 30-seconds using the proposed algorithm quickly. A mean opinion score (MOS) test with a database of 200 music videos is conducted to compare the detected salient region with the predefined manual part. The MOS test results show that the detected salient region using the proposed method performed much better than the predefined manual part without audiovisual processing.

• Cartoon and Animation Studies
• /
• s.39
• /
• pp.321-348
• /
• 2015

The purpose of this study was to find a system and a progression principle in orchestral piece based on the outcome after comparatively analyzing the orchestral operation technique in "Battle for The Glory" out of the background music in the animation "Dragon Quest IV" by Koichi Sugiyama(1931~), who is a leading runner of Japan's animation music, based on functional parts daccord & Instrumentation Pattern, Rhythm Pattern, Voicing Pattern, and harmonic ratio by progression section devised by the writer. As a result, first, five themes in this music have specific instrumentation pattern, respectively. In a passage that is shown exposition, reprise, and representation in theme, the unity was emphasized by maintaining the same instrumentation pattern. On the contrary to this, a passage of being suggested new theme is being used the exchange method and addition & subtraction in musical instrument in order to strengthen diversity. Second, the voicing pattern is forming the vertical contrasting relationship of "thinness-thickness" on the whole. However, the diversity is being intensified that is changed into the structure of "thickness-thinness" in the third theme and of "thinness-thickness" that has two melodies in the fourth theme. Third, the rhythm pattern is forming the vertical contrasting relationship of "big-small" on the whole. However, the fifth theme is being given diversity with being changed into the structure of "small-big." Fourth, the harmony by progression section from the horizontal perspective is shown to be high in the proportion of unity in the section of being repeated and represented the theme and to be high in the proportion of diversity in the section of being suggested new theme. In this study, the balanced orchestral operation technique through the operation technique, which was used in this work, is what extracts the relationship of diverse proportions in the horizontal progression section based on the technique of vertical perspective. In this aspect, this analytical study is desired to be positioned as a new paradigm in establishing a theoretical system and an educational method in orchestration.