Browse > Article
http://dx.doi.org/10.4218/etrij.14.2113.0065

Sensorial Information Extraction and Mapping to Generate Temperature Sensory Effects  

Kim, Sang-Kyun (Department of Computer Engineering, Myongji University)
Yang, Seung-Jun (Broadcasting & Telecommunications Media Research Laboratory, ETRI)
Ahn, Chung Hyun (Broadcasting & Telecommunications Media Research Laboratory, ETRI)
Joo, Yong Soo (Department of Computer Engineering, Myongji University)
Publication Information
ETRI Journal / v.36, no.2, 2014 , pp. 224-231 More about this Journal
Abstract
In this paper, a method to extract temperature effect information using the color temperatures of video scenes with mapping to temperature effects is proposed to author temperature effects of multiple sensorial media content automatically. An authoring tool to apply the proposed method is also introduced. The temperature effects generated by the proposed method are evaluated by a subjective test to measure the level of satisfaction. The mean opinion score results show that most of the test video sequences receive an average of approximately four points (in a five-point scale), indicating that test video sequences (with the temperature effects generated by the proposed method) enhance levels of satisfaction.
Keywords
Sensory effects; MPEG-V; MulSeMedia content; MulSeMedia authoring; sensorial information extraction; sensorial information mapping; temperature effect;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 ITU-T Rec. P.911, Subjective Audiovisual Quality Assessment Methods for Multimedia Applications, Dec. 1998.
2 ISO/IEC 23005-3:2011, Information Technology - Media Context and Control - Part 3: Sensory Information, July 2011.
3 ISO/IEC 23005-4:2011, Information Technology - Media Context and Control - Part 4: Virtual World Objects and Characteristics, July 2011.
4 ISO/IEC 23005-5:2011, Information Technology - Media Context and Control - Part 5: Data Formats for Interaction Devices, July 2011.
5 M. Waltl, C. Timmerer, and H. Hellwagner, "A Test-bed for Quality of Multimedia Experience Evaluation of Sensory Effects," Proc. Int. Workshop Quality Multimedia Exp., San Diego, CA, USA, July 29-31, 2009, pp. 145-150.
6 B. Choi, E.-S. Lee, and K. Yoon, "Streaming Media with Sensory Effect," Proc. Int. Conf. Inf. Sci. Appl., Jeju Island, Rep. of Korea, Apr. 26-29, 2011, pp. 1-6.
7 Y.-S. Joo and S.-K. Kim, "Sensory Effect Authoring Tool for Sensible Media," J. Broadcast Eng., vol. 16, no. 5, Sept. 2011, pp. 693-893.   DOI   ScienceOn
8 S.-K. Kim, "Authoring Multisensorial Content," Signal Process., Image Commun., vol. 28, issue 2, Feb. 2013, pp. 162-167.   DOI   ScienceOn
9 C. Timmerer et al., "Assessing the Quality of Sensory Experience for Multimedia Presentations," Signal Process., Image Commun., Sept. 2012, pp. 909-916.
10 S.-K. Kim, Y.-S. Joo, and Y. Lee, "Sensible Media Simulation in an Automobile Application and Human Responses to Sensory Effects," ETRI J., vol. 35, no. 6, Dec. 2013, pp. 1001-1010.   DOI   ScienceOn
11 G. Wyszecki and W.S. Stiles, Color Science, Concepts and Methods, Quantitative Data and Formulae, 2nd ed., New York: John Wiley & Sons, Inc., 1982, pp. 224-225.
12 ISO/IEC JTC1/SC29/WG11 M7265, "Report of VCE-6 on MPEG-7 Color Temperature Browsing Descriptors," Sydney, Australia, July 2001.
13 ISO/IEC JTC1/SC29/WG11 M7712, "Report of VCE-6 on MPEG-7 Color Temperature Browsing Descriptors," Pattaya, Thailand, Dec. 2001.
14 ISO/IEC JTC1/SC29/WG11 M7993, "Report of VCE-6 on MPEG-7 Color Temperature Descriptor for Display Preference," Jeju Island, Rep. of Korea, Mar. 2002.
15 ITU-T Rec. P.910, Subjective Video Quality Assessment Methods for Multimedia Applications, Apr. 2008.
16 R. Kannan, S.R. Balasundaram, and F. Andres, "The Role of Mulsemedia in Digital Content Ecosystem Design," Proc. Int. Conf. Manag. Emergent Digital EcoSyst., 2010, pp. 264-266.
17 ISO/IEC 23005-2:2011, Information Technology - Media Context and Control - Part 2: Control Information, July 2011.