• Journal of the Korea Society of Computer and Information
• /
• v.18 no.11
• /
• pp.167-174
• /
• 2013

TIn this paper, we find the face in color images and the ability to track the face was implemented. Face tracking is the work to find face regions in the image using the functions of the computer system and this function is a necessary for the robot. But such as extracting skin color in the image face tracking can not be performed. Because face in image varies according to the condition such as light conditions, facial expressions condition. In this paper, we use the skin color pixel extraction function added lighting compensation function and the entire processing system was implemented, include performing finding the features of eyes, nose, mouth are confirmed as face. Lighting compensation function is a adjusted sine function and although the result is not suitable for human vision, the function showed about 4% improvement. Face features are detected by amplifying, reducing the value and make a comparison between the represented image. The eye and nose position, lips are detected. Face tracking efficiency was good.

• Journal of Digital Convergence
• /
• v.15 no.2
• /
• pp.173-181
• /
• 2017

In this paper, we have studied tracking as a training stage of considering the position and the scale of a person given its previous position, scale, as well as next and forward image fraction. Unlike other learning methods, CNN is thereby learning combines both time and spatial features from the image for the two consecutive frames. We introduce multiple path ways in CNN to better fuse local and global information. A creative shift-variant CNN architecture is designed so as to alleviate the drift problem when the distracting objects are similar to the target in cluttered environment. Furthermore, we employ CNNs to estimate the scale through the accurate localization of some key points. These techniques are object-independent so that the proposed method can be applied to track other types of object. The capability of the tracker of handling complex situations is demonstrated in many testing sequences. The accuracy of the SVM classifier using the features learnt by the CNN is equivalent to the accuracy of the CNN. This fact confirms the importance of automatically optimized features. However, the computation time for the classification of a person using the convolutional neural network classifier is less than approximately 1/40 of the SVM computation time, regardless of the type of the used features.

• Journal of the Korea Society for Simulation
• /
• v.32 no.3
• /
• pp.43-53
• /
• 2023

In this detailed and comprehensive study, our primary focus has been placed on accurately gauging the number of visitors and their real-time locations in commercial spaces. Particularly, in a real cafe, using security cameras, we have developed a system that can offer live updates on available seating and predict future congestion levels. By employing YOLO, a real-time object detection and tracking algorithm, the number of visitors and their respective locations in real-time are also monitored. This information is then used to update a cafe's indoor map, thereby enabling users to easily identify available seating. Moreover, we developed a model that predicts the congestion of a cafe in real time. The sophisticated model, designed to learn visitor count and movement patterns over diverse time intervals, is based on Long Short Term Memory (LSTM) to address the vanishing gradient problem and Sequence-to-Sequence (Seq2Seq) for processing data with temporal relationships. This innovative system has the potential to significantly improve cafe management efficiency and customer satisfaction by delivering reliable predictions of cafe congestion to all users. Our groundbreaking research not only demonstrates the effectiveness and utility of indoor location tracking technology implemented through security cameras but also proposes potential applications in other commercial spaces.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.1777-1778
• /
• 2007

In this paper, We design and implement a humanoid robot, With Educational purpose, which can collaborate and communicate with human. We present an affective human-robot communication system for a humanoid robot, D2, which we designed to communicate with a human through dialogue. D2 communicates with humans by understanding and expressing emotion using facial expressions, voice, gestures and posture. Interaction between a human and a robot is made possible through our affective communication framework. The framework enables a robot to catch the emotional status of the user and to respond appropriately. As a result, the robot can engage in a natural dialogue with a human. According to the aim to be interacted with a human for voice, gestures and posture, the developed Educational humanoid robot consists of upper body, two arms, wheeled mobile platform and control hardware including vision and speech capability and various control boards such as motion control boards, signal processing board proceeding several types of sensors. Using the Educational humanoid robot D2, we have presented the successful demonstrations which consist of manipulation task with two arms, tracking objects using the vision system, and communication with human by the emotional interface, the synthesized speeches, and the recognition of speech commands.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2018.05a
• /
• pp.700-702
• /
• 2018

In this abstract, introduces a system that enables communication by tracking the pupils of Lou Gehrig's disease patients who are unable to move their bodies. Face and eye pupil tracking perform using OpenCV, and eye movement recognition and character selection by eye movement is obtained using Python. In this paper, you will use the webcams, track your eyes, determine eye movements based on the coordinates of your pupils, and print characters that meet your preferences. It can easily output text messages using Bluetooth.

• Transactions on Control, Automation and Systems Engineering
• /
• v.3 no.4
• /
• pp.229-235
• /
• 2001

Recently, service area has been emerging field f robotic applications. Even though assistant robots play an important role for the disabled and the elderly, they still suffer from operating the robots using conventional interface devices such as joysticks or keyboards. In this paper we propose an efficient computer interface using real-time eye-gaze tracking system. The inputs to the proposed system are images taken by a camera and data from a magnetic sensor. The measured data is sufficient to describe the eye and head movement because the camera and the receiver of a magnetic sensor are stationary with respect to the head. So the proposed system can obtain the eye-gaze direction in spite of head movement as long as the distance between the system and the transmitter of a magnetic position sensor is within 2m. Experimental results show the validity of the proposed system in practical aspect and also verify the feasibility of the system as a new computer interface for the disabled.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.1
• /
• pp.69-76
• /
• 2010

The segmentation of moving object in video sequence is a core technique of intelligent image processing system such as video surveillance, traffic monitoring and human tracking. A typical method to segment a moving region from the background is the background subtraction. The steps of background subtraction involve calculating a reference image, subtracting new frame from reference image and then thresholding the subtracted result. One of famous background modeling is Gaussian mixture model (GMM). Even though the method is known efficient and exact, GMM suffers from a problem that includes false pixels in ROI (region of interest), specifically shadow pixels. These false pixels cause fail of the post-processing tasks such as tracking and object recognition. This paper presents a method for removing false pixels included in ROT. First, we subdivide a ROI by using shape characteristics of detected objects. Then, a method is proposed to classify pixels from using histogram characteristic and comparing difference of energy that converts the color value of pixel into grayscale value, in order to estimate whether the pixels belong to moving object area or shadow area. The method is applied to real video sequence and the performance is verified.

• Journal of electromagnetic engineering and science
• /
• v.11 no.4
• /
• pp.298-303
• /
• 2011

A capsular endoscope (CE) for inspection of the large intestine requires a motor for backward navigation against the autonomous travel in the intestine. This study proposes an HF power system for generating a magnetic field and for delivering wireless power to the internal or implanted medical devices. The magnetic field is generated by a wound coil (L) around a wooden frame, and the current is driven to the coil through a resonating capacitor (C). The characteristics of the resonance frequency shifting of the L-C series circuit are analyzed. A stable magnetic field intensity in the field coil is maintained by a specially designed frequency tracking system that automatically follows the L-C resonance frequency. Testing confirmed that the oscillation system tracks well the parameter changes of the electric components caused by the operating conditions or environmental variations.

• Proceedings of the IEEK Conference
• /
• 2002.07c
• /
• pp.1897-1900
• /
• 2002

This paper proposes a novel computer-human interface, named invisible Messenger. It integrates face detection and tracking, and speaker array signal processing. By speaker array it is possible to form acoustic focus at the arbitrary location that is measured by the face tracking. Thus the proposed system can whisper in a person's ear as if an invisible virtual messenger were standing by the person. Not only speculative discussion, the authors have implemented a working prototype system based upon the proposed idea. This paper also describes about this prototype. In order to confirm effectiveness of the proposed idea, the authors conduct experiments using the implemented system. Experimental results demonstrate the effectivenss of the proposed idea.

• Journal of Institute of Control, Robotics and Systems
• /
• v.8 no.11
• /
• pp.954-962
• /
• 2002

In a park or street, we can see many people jogging or walking with their dogs tracking their masters. In this study, an entertainment robot that imitates a dog's behavior is created. The robot's task is tracking a moving target that is recognized as the master. In order to design the robot, the ecological approach. in which the robot's goals and surroundings heavily influence its design, is used. A three-wheel type locomotion system is designed as the robot's physical structure which can follow a human jogging in outdoor space like a park. A sensor system which can detect the position of a master for the robot in the outdoor space, is developed. This sensor system consists of a signal transmitter which is at the hand of a master and some sensors which are mounted on the robot. The transmitter emits RF(radio frequency) and ultrasonic signals and the sensors detect the direction and distance from the robot to the transmitter by using the received signals. For the control architecture of the robot, a purely reactive behavior-based method is used in order to increase speed of response. The developed robot is evaluated through experiments conducted in indoor and outdoor environments.