Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2010.17B.1.069

Baleen Whale Sound Synthesis using a Modified Spectral Modeling  

Jun, Hee-Sung (울산대학교 컴퓨터정보통신공학부)
Dhar, Pranab K. (울산대학교 컴퓨터정보통신공학부)
Kim, Cheol-Hong (전남대학교 전자컴퓨터공학부)
Kim, Jong-Myon (울산대학교 컴퓨터정보통신공학부)
Publication Information
The KIPS Transactions:PartB / v.17B, no.1, 2010 , pp. 69-78 More about this Journal
Abstract
Spectral modeling synthesis (SMS) has been used as a powerful tool for musical sound modeling. This technique considers a sound as a combination of a deterministic plus a stochastic component. The deterministic component is represented by the series of sinusoids that are described by amplitude, frequency, and phase functions and the stochastic component is represented by a series of magnitude spectrum envelopes that functions as a time varying filter excited by white noise. These representations make it possible for a synthesized sound to attain all the perceptual characteristics of the original sound. However, sometimes considerable phase variations occur in the deterministic component by using the conventional SMS for the complex sound such as whale sounds when the partial frequencies in successive frames differ. This is because it utilizes the calculated phase to synthesize deterministic component of the sound. As a result, it does not provide a good spectrum matching between original and synthesized spectrum in higher frequency region. To overcome this problem, we propose a modified SMS that provides good spectrum matching of original and synthesized sound by calculating complex residual spectrum in frequency domain and utilizing original phase information to synthesize the deterministic component of the sound. Analysis and simulation results for synthesizing whale sounds suggest that the proposed method is comparable to the conventional SMS in both time and frequency domain. However, the proposed method outperforms the SMS in better spectrum matching.
Keywords
Whale Sound Synthesis; Spectral Modeling; Short Time; Fourier Transform(STFT); Additive Synthesis; Phase Variation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 R. J. McAulay and T. F. Quatieri, “Speech Analysis/Synthesis based on a Sinusoidal Representation,” IEEE transaction on Acoustics, Speech and Signal Processing, Vol.34, No.4, pp. 744-754, 1986.   DOI
2 E. B. George and M. J. T. Smith, “Analysis-by-Synthesis/Overlap-add Sinusoidal Modeling applied to the Analysis and Synthesis of Musical Tones,” Journal of Audio Engineering Society, Vol.40, No.6, pp.497-516, 1992.
3 Ph. Depalle, G. Garcia and X. Rodet, “Tracking of Partials for Additive Sound Synthesis Using Hidden Markov Models,” in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vol.1, pp.225-228, 1993.   DOI
4 X. Serra, 'Musical Sound Modeling with Sinusoid plus Noise,' Musical Sound Processing, published in C. Roads, S. Pope, A. Picialli, G.De Poli editors by Sweets and Zeitlinger Publishers, pp.91-122, 1997.
5 X. Serra, “A System for Sound Analysis/Transformation/Synthesis based on a Deterministic plus Stochastic Decomposition,” Ph.D Thesis, Stanford University, 1989.
6 J. B. Allen and R. Lawrenc, “A Unified Approach to Short-Time Fourier analysis and Synthesis,” in Proceedings of IEEE, Vol.65, pp.1556-1564, 1977.
7 J. B Allen, “Short term spectral analysis, synthesis and modification by discrete Fourier transform,” IEEE transaction on Acoustics, Speech and Signal Processing, Vol. ASSP-25, pp.235-238, 1977.
8 D. M. Green et. Al., 'Low-frequency Sound and Marine Mammals: Current Knowledge and Research needs,' National Academy Press, 1994.
9 X., Serra and J. Smith, “Spectral Modeling Synthesis: A sound Analysis/Synthesis system based on a Deterministic plus Stochastic Decomposition,” Computer Music Journal, Vol.14, No.4, pp.12-24, 1990.   DOI