• Journal of the Institute of Electronics and Information Engineers
• /
• v.53 no.4
• /
• pp.159-166
• /
• 2016

In this paper, an active object tracking system basing on the pan/tilt-embedded stereo camera system is suggested and implemented. In the proposed system, once the face area of a target is detected from the input stereo image by using a YCbCr color model and phase-type correlation scheme and then, using this data as well as the geometric information of the tracking system, the distance and 3D information of the target are effectively extracted in real-time. Basing on these extracted data the pan/tilted-embedded stereo camera system is adaptively controlled and as a result, the proposed system can track the target adaptively under the various circumstance of the target. From some experiments using 480 frames of the test input stereo image, it is analyzed that a standard variation between the measured and computed the estimated target's height and an error ratio between the measured and computed 3D coordinate values of the target is also kept to be very low value of 1.03 and 1.18% on average, respectively. From these good experimental results a possibility of implementing a new real-time intelligent stereo target tracking and surveillance system using the proposed scheme is finally suggested.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.31 no.2C
• /
• pp.156-165
• /
• 2006

In this paper, a new intelligent moving target tracking and surveillance system basing on the pan/tilt-embedded stereo camera system is suggested and implemented. In the proposed system, once the face area of a target is detected from the input stereo image by using a YCbCr color model and phase-type correlation scheme and then, using this data as well as the geometric information of the tracking system, the distance and 3D information of the target are effectively extracted in real-time. Basing on these extracted data the pan/tilted-imbedded stereo camera system is adaptively controlled and as a result, the proposed system can track the target adaptively under the various circumstance of the target. From some experiments using 480 frames of the test input stereo image, it is analyzed that a standard variation between the measured and computed the estimated target's height and an error ratio between the measured and computed 3D coordinate values of the target is also kept to be very low value of 1.03 and 1.18$\%$ on average, respectively. From these good experimental results a possibility of implementing a new real-time intelligent stereo target tracking and surveillance system using the proposed scheme is finally suggested.

• Journal of Intelligence and Information Systems
• /
• v.21 no.1
• /
• pp.83-98
• /
• 2015

Many TV viewers use mainly portal sites in order to retrieve information related to broadcast while watching TV. However retrieving information that people wanted needs a lot of time to retrieve the information because current internet presents too much information which is not required. Consequentially, this process can't satisfy users who want to consume information immediately. Interactive video is being actively investigated to solve this problem. An interactive video provides clickable objects, areas or hotspots to interact with users. When users click object on the interactive video, they can see additional information, related to video, instantly. The following shows the three basic procedures to make an interactive video using interactive video authoring tool: (1) Create an augmented object; (2) Set an object's area and time to be displayed on the video; (3) Set an interactive action which is related to pages or hyperlink; However users who use existing authoring tools such as Popcorn Maker and Zentrick spend a lot of time in step (2). If users use wireWAX then they can save sufficient time to set object's location and time to be displayed because wireWAX uses vision based annotation method. But they need to wait for time to detect and track object. Therefore, it is required to reduce the process time in step (2) using benefits of manual annotation method and vision-based annotation method effectively. This paper proposes a novel annotation method allows annotator to easily annotate based on face area. For proposing new annotation method, this paper presents two steps: pre-processing step and annotation step. The pre-processing is necessary because system detects shots for users who want to find contents of video easily. Pre-processing step is as follow: 1) Extract shots using color histogram based shot boundary detection method from frames of video; 2) Make shot clusters using similarities of shots and aligns as shot sequences; and 3) Detect and track faces from all shots of shot sequence metadata and save into the shot sequence metadata with each shot. After pre-processing, user can annotates object as follow: 1) Annotator selects a shot sequence, and then selects keyframe of shot in the shot sequence; 2) Annotator annotates objects on the relative position of the actor's face on the selected keyframe. Then same objects will be annotated automatically until the end of shot sequence which has detected face area; and 3) User assigns additional information to the annotated object. In addition, this paper designs the feedback model in order to compensate the defects which are wrong aligned shots, wrong detected faces problem and inaccurate location problem might occur after object annotation. Furthermore, users can use interpolation method to interpolate position of objects which is deleted by feedback. After feedback user can save annotated object data to the interactive object metadata. Finally, this paper shows interactive video authoring system implemented for verifying performance of proposed annotation method which uses presented models. In the experiment presents analysis of object annotation time, and user evaluation. First, result of object annotation average time shows our proposed tool is 2 times faster than existing authoring tools for object annotation. Sometimes, annotation time of proposed tool took longer than existing authoring tools, because wrong shots are detected in the pre-processing. The usefulness and convenience of the system were measured through the user evaluation which was aimed at users who have experienced in interactive video authoring system. Recruited 19 experts evaluates of 11 questions which is out of CSUQ(Computer System Usability Questionnaire). CSUQ is designed by IBM for evaluating system. Through the user evaluation, showed that proposed tool is useful for authoring interactive video than about 10% of the other interactive video authoring systems.

• Journal of Intelligence and Information Systems
• /
• v.29 no.3
• /
• pp.185-209
• /
• 2023

With the advent of the 4th industrial revolution, various technologies have received much attention. Technologies related to the 4th industry include the Internet of Things (IoT), big data, artificial intelligence, virtual reality (VR), 3D printers, and robotics, and these technologies are often converged. In particular, the robotics field is combined with technologies such as big data, artificial intelligence, VR, and digital twins. Accordingly, much research using robotics is being conducted, which is applied to distribution, airports, hotels, restaurants, and transportation fields. In the given situation, research on human-robot interaction is attracting attention, but it has not yet reached the level of user satisfaction. However, research on robots capable of perfect communication is steadily being conducted, and it is expected that it will be able to replace human emotional labor. Therefore, it is necessary to discuss whether the current human-robot interaction technology can be applied to business. To this end, this study first examines the trend of human-robot interaction technology. Second, we compare LDA (Latent Dirichlet Allocation) topic modeling and BERTopic topic modeling methods. As a result, we found that the concept of human-robot interaction and basic interaction was discussed in the studies from 1992 to 2002. From 2003 to 2012, many studies on social expression were conducted, and studies related to judgment such as face detection and recognition were conducted. In the studies from 2013 to 2022, service topics such as elderly nursing, education, and autism treatment appeared, and research on social expression continued. However, it seems that it has not yet reached the level that can be applied to business. As a result of comparing LDA (Latent Dirichlet Allocation) topic modeling and the BERTopic topic modeling method, it was confirmed that BERTopic is a superior method to LDA.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.17 no.2
• /
• pp.141-146
• /
• 2017

New infectious diseases such as MERS have been in need of many measures such as initial discovery, isolation, and crisis response. In addition, the culture of hospitals is changing, such as the general public 's visiting and Nursing Care Integration Services. However, as the qualifications and regulations of medical personnel in hospitals become rigid, overseas such as linens, wastes movements are replacing possible works with robots. we have developed a hospital logistics robot that can carry out various goods delivery within a hospital, and can move various kinds of objects safely to a desired location. In this thesis, we have studied a hospital logistics robot that can carry out various kinds of goods delivery within the hospital, and can move various kinds of objects such as waste, and linen safely to a desired location. The movement of a robot in a hospital may cause a collision between a person and an object, so that the collision must be prevented. In order to prevent collision, it is necessary to recognize whether or not an object exists in the movement path of the robot. And if there is an object, it should recognize whether it moves or not. In order to recognize human beings and objects, we recognize the person with face/body recognition technology and generate the context awareness of the object using 3D Vision image segmentation technology. We use the generated information to create a map that considers objects and person in the robot moving range. Thus, the robot can be operated safely and efficiently.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.18 no.6
• /
• pp.754-761
• /
• 2008

As the automobile industry and technologies are developed, driver's tend to more concern about service matters than mechanical matters. For this reason, interests about recognition of human knowledge and emotion to make safe and convenient driving environment for driver are increasing more and more. recognition of human knowledge and emotion are emotion engineering technology which has been studied since the late 1980s to provide people with human-friendly services. Emotion engineering technology analyzes people's emotion through their faces, voices and gestures, so if we use this technology for automobile, we can supply drivels with various kinds of service for each driver's situation and help them drive safely. Furthermore, we can prevent accidents which are caused by careless driving or dozing off while driving by recognizing driver's gestures. the purpose of this paper is to develop a system which can recognize states of driver's emotion and attention for safe driving. First of all, we detect a signals of driver's emotion by using bio-motion signals, sleepiness and attention, and then we build several types of databases. by analyzing this databases, we find some special features about drivers' emotion, sleepiness and attention, and fuse the results through Multi-Modal method so that it is possible to develop the system.

• Journal of Broadcast Engineering
• /
• v.25 no.6
• /
• pp.973-979
• /
• 2020

This study aims to objectively and quantitatively determine the social emotion of empathy by collecting pupillary response. 52 subjects (26 men and 26 women) voluntarily participated in the experiment. After the measurement of the reference of 30 seconds, the experiment was divided into the task of imitation and spontaneously self-expression. The two subjects were interacted through facial expressions, and the pupil images were recorded. The pupil data was processed through binarization and circular edge detection algorithm, and outlier detection and removal technique was used to reject eye-blinking. The pupil size according to the empathy was confirmed for statistical significance with test of normality and independent sample t-test. Statistical analysis results, the pupil size was significantly different between empathy (M ± SD = 0.050 ± 1.817)) and non-empathy (M ± SD = 1.659 ± 1.514) condition (t(92) = -4.629, p = 0.000). The rule of empathy according to the pupil size was defined through discriminant analysis, and the rule was verified (Estimation accuracy: 75%) new 12 subjects (6 men and 6 women, mean age ± SD = 22.84 ± 1.57 years). The method proposed in this study is non-contact camera technology and is expected to be utilized in various virtual reality with smart glasses.

• Conservation Science in Museum
• /
• v.30
• /
• pp.47-70
• /
• 2023

In 2019, the first excavation survey was conducted at the Temple Site No. 4 of Yaksugok Vally in Namsan Mountain, Gyeongju to determine the original location of the headless stone Buddha statue and the structure of the temple site. The survey excavated a stone Buddha head that was confirmed in a comparative analysis to be petrologically and mineralogically identical to a headless stone seated Buddha statue found derelict nearby. Traces of gold leaf and black adhesive were found on a portion of the right side of the face of the Buddha head buried in the ground. Since it is exceedingly rare for lacquer and gilding techniques to have been applied to a large stone Buddha statue without a base layer, this study examines the gilding techniques of the time by analyzing the characteristics of the materials used. In this process, the structure of the gold foil was observed through analytical microscopy and scanning electron microscopy with energy dispersive X-ray spectrometry, and the gold (Au) component was identified. As a result of analyzing the black adhesive using pyrolysis-gas chromatograph/mass spectrometry (pyrolysis-GC/MS), pyrolysis compounds such as hydrocarbons, fatty acids, catechol, and catechol oxidation products were detected. This was identical to the characteristics identified upon analyzing lacquer collected from species of lacquer tree whose main component is urushiol. Therefore, it was confirmed that the stone Buddha head excavated from the Temple Site No. 4 of Yaksugok Valley was separated from a nearby stone seated Buddha statue, and that the gold foil was attached using lacquer sap collected from lacquer trees, which grow in Korea, China, and Japan.

• Smart Media Journal
• /
• v.13 no.3
• /
• pp.9-17
• /
• 2024

Due to the recent pandemic and the development of ICT technology, the use of non-face-to-face and unmanned systems is expanding, and it is very important to understand emotions in communication in non-face-to-face situations. As emotion recognition methods for various facial expressions are required to understand emotions, artificial intelligence-based research is being conducted to improve facial expression emotion recognition in image data. However, existing research on facial expression emotion recognition requires high computing power and a lot of learning time because it utilizes a large amount of data to improve accuracy. To improve these limitations, this paper proposes a method of recognizing facial expressions using age and gender, which are image meta information, as a method of recognizing facial expressions with even a small amount of data. For facial expression emotion recognition, a face was detected using the Yolo Face model from the original image data, and age and gender were classified through the VGG model based on image meta information, and then seven emotions were recognized using the EfficientNet model. The accuracy of the proposed data classification learning model was higher as a result of comparing the meta-information-based data classification model with the model trained with all data.

• The Korean Journal of Pesticide Science
• /
• v.18 no.4
• /
• pp.247-257
• /
• 2014

Assessment for operator's dermal and inhalation exposure to acetamiprid during cultivation of water melon in greenhouse was carried out. For dermal exposure measurement, whole body dosimetry (WBD) was performed as the first trial in Korea. WBD consists of cotton/polyester outer clothes and cotton inner clothes. Hand exposure was measured by washing of nitrile gloves and hands while head exposure was monitored by face/neck wipe technique. Inhalation exposure was monitored with personal air sampling pumps and IOM sampler (glass fiber filter). Analytical limit of quantitation was 2.5 ng/mL. Good reproducibility (C.V < 8.7%), linearity ($R^2$ > 0.99) and recovery (70~119%) were obtained. Field recovery of acetamiprid was 77~95%. During mixing/loading, hand exposure of acetamiprid was about 10 times ($229.7{\mu}g$) more than that of application case ($20.9{\mu}g$). During application, total dermal exposure was $1207.4{\mu}g$. Exposure of lower legs was $1132.1{\mu}g$, which is 93.8% of the total dermal exposure. Inhalation exposure during mixing/loading and application was not detected. Margin of safety (MOS) was calculated for risk assessment using male Korean average body weight (70 kg) and acceptable operator exposure level ($124{\mu}g/kg/day$) to give 140, suggesting that health risk of operator during treatment of acetamiprid for water melon in greenhouse could be safe.