Browse > Article
http://dx.doi.org/10.13088/jiis.2014.20.3.059

An Interactive Cooking Video Query Service System with Linked Data  

Park, Woo-Ri (Department of Computer and Information Engineering, Inha University)
Oh, Kyeong-Jin (Department of Computer and Information Engineering, Inha University)
Hong, Myung-Duk (Department of Computer and Information Engineering, Inha University)
Jo, Geun-Sik (Department of Computer and Information Engineering, Inha University)
Publication Information
Journal of Intelligence and Information Systems / v.20, no.3, 2014 , pp. 59-76 More about this Journal
Abstract
The revolution of smart media such as smart phone, smart TV and tablets has brought easiness for people to get contents and related information anywhere and anytime. The characteristics of the smart media have changed user behavior for watching the contents from passive attitude into active one. Video is a kind of multimedia resources and widely used to provide information effectively. People not only watch video contents, but also search for related information to specific objects appeared in the contents. However, people have to use extra views or devices to find the information because the existing video contents provide no information through the contents. Therefore, the interaction between user and media is becoming a major concern. The demand for direct interaction and instant information is much increasing. Digital media environment is no longer expected to serve as a one-way information service, which requires user to search manually on the internet finding information they need. To solve the current inconvenience, an interactive service is needed to provide the information exchange function between people and video contents, or between people themselves. Recently, many researchers have recognized the importance of the requirements for interactive services, but only few services provide interactive video within restricted functionality. Only cooking domain is chosen for an interactive cooking video query service in this research. Cooking is receiving lots of people attention continuously. By using smart media devices, user can easily watch a cooking video. One-way information nature of cooking video does not allow to interactively getting more information about the certain contents, although due to the characteristics of videos, cooking videos provide various information such as cooking scenes and explanation for each recipe step. Cooking video indeed attracts academic researches to study and solve several problems related to cooking. However, just few studies focused on interactive services in cooking video and they still not sufficient to provide the interaction with users. In this paper, an interactive cooking video query service system with linked data to provide the interaction functionalities to users. A linked recipe schema is used to handle the linked data. The linked data approach is applied to construct queries in systematic manner when user interacts with cooking videos. We add some classes, data properties, and relations to the linked recipe schema because the current version of the schema is not enough to serve user interaction. A web crawler extracts recipe information from allrecipes.com. All extracted recipe information is transformed into ontology instances by using developed instance generator. To provide a query function, hundreds of questions in cooking video web sites such as BBC food, Foodista, Fine cooking are investigated and analyzed. After the analysis of the investigated questions, we summary the questions into four categories by question generalization. For the question generalization, the questions are clustered in eleven questions. The proposed system provides an environment associating UI (User Interface) and UX (User Experience) that allow user to watch cooking videos while obtaining the necessary additional information using extra information layer. User can use the proposed interactive cooking video system at both PC and mobile environments because responsive web design is applied for the proposed system. In addition, the proposed system enables the interaction between user and video in various smart media devices by employing linked data to provide information matching with the current context. Two methods are used to evaluate the proposed system. First, through a questionnaire-based method, computer system usability is measured by comparing the proposed system with the existing web site. Second, the answer accuracy for user interaction is measured to inspect to-be-offered information. The experimental results show that the proposed system receives a favorable evaluation and provides accurate answers for user interaction.
Keywords
Linked Data; Interaction; Cooking Video; Interactive Video; UI/UX;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Cordier, A., E. Gaillard, and E. Nauer, "Man-Machine Collaboration to Acquire Cooking Adaptation Knowledge for the TAAABLE Case-Based Reasoning System," Proceedings of the 21st international conference companion on World Wide web, (2012), 1113-1120.
2 Baltrunas, L., B. Ludwig, S. Peer, and F. Ricci, "Context relevance assessment and exploitation in mobile recommender systems," Journal of Personal and Ubiquitous Computing, Vol.16, No.5(2012), 507-526.   DOI
3 Batista, F., J. Paulo, N. Mamede, and P. Vaz, "Ontology construction: cooking domain," Technical Report, INESC-ID, Lisbon, 2006.
4 Cairns, K., J. Johnston, and S. Baumann, "Caring About Food Doing Gender in the Foodie Kitchen," Gender & Society, Vol.24, No.5 (2010), 591-615.   DOI   ScienceOn
5 Ha, I., K.-J. Oh, M.-D. Hong, Y.-H. Lee, A. N. Rosli, and G.-S. Jo, "Ontology-driven visualization system for semantic searching," Multimedia Tools and Applications, Vol.71, No.2(2011), 947-965.
6 Hamada, R., I. Ide, and S. Sakai, "Associating cooking video with related textbook," Proceedings of the 2000 ACM workshops on Multimedia, (2000), 237-241.
7 Hamada, R., J. Okabe, I. Ide, S. Satoh, S. Sakai, and H. Tanaka, "Cooking navi: Assistant for daily cooking in kitchen," Proceedings of the 13th annual ACM international conference on Multimedia, (2005), 371-374.
8 Martins, F., J. P. Pardal, L. Franqueira, P. Arez, and N. J. Mamede, "Starting to cook a tutoring dialogue system," Proceedings of the Spoken Language Technology Workshop, (2008), 145-148.
9 Irizarry, J., M. Gheisari, G. Williams, and B. N. Walker, "InfoSPOT: A mobile Augmented Reality mehod for accessing building information through a situation awareness approach," Automation in Construction, Vol. 33, (2013), 11-23.   DOI   ScienceOn
10 Lewis, J. R., "IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use," International Journal of Human-Computer Interaction, Vol.7, No.1(1995), 57-78.   DOI   ScienceOn
11 Madathil, K. C., R. Koikkara, J. Obeid, J. S. Greenstein, I. C. Sanderson, K. Fryar, J. Moskowitz, and A. K. Gramopadhye, "An investigation of the efficacy of electronic consenting interfaces of research permissions management system in a hospital setting," International Journal of Medical Informatics, Vol.82, No.9(2013), 854-863.   DOI   ScienceOn
12 Ribeiro, R., F. Batista, J. P. Pardal, N. J. Manede, and H. S. Pinto, "Cooking an ontology," Proceedings of the 12th International Conference on Artificial Intelligence: Methodology, Systems, and Applications (AIMSA), Vol.4183, (2006), 213-221.
13 Snae, C. and M. Bruckner, "FOODS: A Food-oriented Ontology-Driven System," Proceedings of the Second IEEE International Conference on Digital Ecosystems and Technologies, (2008), 168-176.
14 Sonesson, U., B. Mattsson, T. Nybrant, and T. Ohlsson, "Industrial Processing versus Home Cooking: An Environmental Comparison between Three Ways to Prepare a Meal," A Journal of the Human Environment, Vol.34, No.4(2005), 414-421.   DOI
15 Yu, L., Q. Li, H. Xie, and Y. Cai, "Exploring Folksonomy and Cooking Procedures to Boost Cooking Recipe Recommendation," Proceedings of the 13th Asia-Pacific Web Conference on Web Technologies and Applications, Vol.6612, (2011), 119-130.
16 Schafer, U., F. Arnold, S. Ostermann, and S. Reifers, "Ingredients and Recipe for a Robust Mobile Speech-enabled Cooking Assistan for German," Proceedings of the 36th Annual German Conference on AI, Vol.8077, (2013), 212-223.
17 Vildjiounaite, E., J. Kantorovitch, V. Kyllonen, I. Niskanen, M. Hillukkala, K. Virtanen, O. Vuorinen, S.-M. Makela, T. Keranen, J. Peltola, J. Mantyjarvi, and A. Tokmakoff, "Designing Socially Acceptable Multimodal Interaction in Cooking Assistants," Proceedings of 16th international conference on Intelligent user interfaces, (2011), 415-418.