• Journal of KIISE
• /
• v.42 no.4
• /
• pp.451-458
• /
• 2015

Previous multimodal learning methods focus on problem-solving aspects, such as image and video search and tagging, rather than on knowledge acquisition via content modeling. In this paper, we propose the Multimodal Concept Hierarchy (MuCH), which is a content modeling method that uses a cartoon video dataset and a character-based subtitle generation method from the learned model. The MuCH model has a multimodal hypernetwork layer, in which the patterns of the words and image patches are represented, and a concept layer, in which each concept variable is represented by a probability distribution of the words and the image patches. The model can learn the characteristics of the characters as concepts from the video subtitles and scene images by using a Bayesian learning method and can also generate character-based subtitles from the learned model if text queries are provided. As an experiment, the MuCH model learned concepts from 'Pororo' cartoon videos with a total of 268 minutes in length and generated character-based subtitles. Finally, we compare the results with those of other multimodal learning models. The Experimental results indicate that given the same text query, our model generates more accurate and more character-specific subtitles than other models.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.18 no.4
• /
• pp.512-517
• /
• 2008

It is show that increasing of aged and handicapped people requires development of Ubiquitous computing technique to offer the specialized service for handicapped-people. For this, we need a development of Context Awareness and Service Reasoning Technique that the technique is supplied interaction between user and U-environment instead of the old unilateral relation. The old research of context awareness needed probabilistic presentation model like a Bayesian Network based on expert Systems for recognize given circumstance by a domain of uncertain real world. In this article, we define a domain of disorder activity assistant service application and context model based on ontology in diversified environment and minimized intervention of user and developer. By use this context model, we apply the structure learning of Bayesian Network and decide the service and activity to development of application service for handicapped people. Finally, we define the proper Conditional Probability Table of the structured Bayesian Network and if random situation is given to user, then present state variable of Activity and Service by given Causal relation of Bayesian Network based on Conditional Probability Table and it can be result of context awareness.

• Journal of the Society of Disaster Information
• /
• v.19 no.1
• /
• pp.161-172
• /
• 2023

Safety education delivered to construction workers in a lecture manner has limitations in concentration and immersion, so delivery power and interest are low. In order to improve unstable behavior through education and prevent safety accidents, it is necessary to change the paradigm to hands-on education. Purpose: Experiential safety education aims to contribute to preventing accidents for construction workers by quickly recognizing risks, improving emergency response skills, and verifying the effectiveness of pre- and post-learning. Method: Based on a survey of workers who experienced the same work environment as the actual construction site, an opinion survey on the pre- and post-safety experience education and a variable measurement tool were planned, and a research hypothesis was established. Results: The Bayesian theory and MC simulation analysis were used to analyze the structural equation model, and the change in construction worker behavior was confirmed through the intended safety (A), non-experiential education in the sub-area of anxiety (B), average, standard deviation, and minimum and maximum values. Conclusion: The effect of education and industrial accidents are reduced only when construction workers are motivated to participate.