• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.46 no.9
• /
• pp.39-48
• /
• 2009

Human face tracking has gradually become an important issue in applications for portable multimedia devices such as digital camcorder, digital still camera and cell phone. Current embedded face tracking software implementations lack the processing abilities to track faces in real time mobile video processing. In this paper, we propose a power efficient hardware-based face tracking architecture operating in real time. The proposed system was verified by FPGA prototyping and ASIC implementation using Samsung 65nm CMOS process. The implementation result shows that tracking speed is less than 8.4 msec with 150K gates and 20 mW average power consumption. Consequently it is validated that the proposed system is adequate for portable multimedia device.

• International Journal of Contents
• /
• v.10 no.1
• /
• pp.1-11
• /
• 2014

In the current generation of smart mobile devices, object tracking is one of the most important research topics for computer vision. Because human face tracking can be widely used for many applications, collecting a dataset of face videos is necessary for evaluating the performance of a tracker and for comparing different approaches. Unfortunately, the well-known benchmark datasets of face videos are not sufficiently diverse. As a result, it is difficult to compare the accuracy between different tracking algorithms in various conditions, namely illumination, background complexity, and subject movement. In this paper, we propose a new dataset that includes 91 face video clips that were recorded in different conditions. We also provide a semi-automatic ground-truth generation tool that can easily be used to evaluate the performance of face tracking systems. This tool helps to maintain the consistency of the definitions for the ground-truth in each frame. The resulting video data set is used to evaluate well-known approaches and test their efficiency.

• Korean Institute of Interior Design Journal
• /
• v.22 no.6
• /
• pp.212-219
• /
• 2013

This study uses a fashion shop facade design to track human gaze, find gaze frequency for gaze time for the gaze points along the path of sight, and expose the importance of facade design and figure out the value through theoretical systematization. Thus, this study employed the measurement method in physiological psychology which is sight-tracking device with eye-tracking to perform effective data evaluation. To find gaze frequency and study the contents to reflect on the facade, precedent study review, and case study of facade design to collect stimulants to be used in eye-tracking experiment were executed. And the eye-tracking experiment which traces the movement of eye[pupil] was performed. As the result of analyzing gaze frequency, The characteristics of such gaze path formation made the characteristics for gaze frequency even clearer. What was characteristic in the analysis result according to 'average value for gaze time' was that only 8 out of 2000 areas showed over 1 second of frequency and, and all other shoed less than 1 second of gaze time. This indicates that human sight endlessly jumps around, and that it 'Stay' where it has interest. This study found the average of the frequency of this 'Stay' in facade design. This study well presents the major points to add value to the design of the space of facade based on scientific measurement/analysis data obtained through visual understanding. Through such, this study is thought to be able to have a positive interaction with marketing by forming a theoretical background bringing utility to purchase environment and assisting in sales increase.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.18 no.5
• /
• pp.1171-1176
• /
• 2014

The eye-tracking [ET] is used on the human computer interaction [HCI] analysing the movement status as well as finding the gaze direction of the eye by tracking pupil's movement on a human face. Nowadays, the ET is widely used not only in market analysis by taking advantage of pupil tracking, but also in grasping intention, and there have been lots of researches on the ET. Although the vision based ET is known as convenient in application point of view, however, not robust in changing environment such as illumination, geometrical rotation, occlusion and scale changes. This paper proposes two steps in the ET, at first, face and eye regions are discriminated by Haar classifier on the face, and then the pupils from the discriminated eye regions are tracked by CAMShift as well as Template matching. We proved the usefulness of the proposed algorithm by lots of real experiments in changing environment such as illumination as well as rotation and scale changes.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.18 no.2
• /
• pp.187-192
• /
• 2008

The Intelligent Space(ISpace) provides challenging research fields for surveillance, human-computer interfacing, networked camera conferencing, industrial monitoring or service and training applications. ISpace is the space where many intelligent devices, such as computers and sensors, are distributed. According to the cooperation of many intelligent devices, the environment, it is very important that the system knows the location information to offer the useful services. In order to achieve these goals, we present a method for representing, tracking and human Jollowing by fusing distributed multiple vision systems in ISpace, with application to pedestrian tracking in a crowd. This paper describes appearance based unknown object tracking with the distributed vision system in intelligent space. First, we discuss how object color information is obtained and how the color appearance based model is constructed from this data. Then, we discuss the global color model based on the local color information. The process of learning within global model and the experimental results are also presented.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.11 no.11
• /
• pp.2179-2184
• /
• 2007

The Intelligent Space(ISpace) provides challenging research fields for surveillance, human-computer interfacing, networked camera conferencing, industrial monitoring or service and training applications. ISpace is the space where many intelligent devices, such as computers and sensors, are distributed. According to the cooperation of many intelligent devices, the environment, it is very important that the system knows the location information to offer the useful services. In order to achieve these goals, we present a method for representing, tracking and human following by fusing distributed multiple vision systems in ISpace, with application to pedestrian tracking in a crowd. This paper described appearance based unknown object tracking with the distributed vision system in intelligent space. First, we discuss how object color information is obtained and how the color appearance based model is constructed from this data. Then, we discuss the global color model based on the local color information. The process of learning within global model and the experimental results are also presented.

• Journal of KIISE:Software and Applications
• /
• v.32 no.5
• /
• pp.449-460
• /
• 2005

This paper proposes a method to track persons robustly in illumination changes and partial occlusions in color video frames acquired from a fixed camera. To solve a problem of changing appearance by illumination change, a time-independent intrinsic image is used to remove noises in an frame and is adaptively updated frame-by-frame. We use a hierarchical human model including body color information in order to track persons in occlusion. The tracked human model is recorded into a persons' list for some duration after the corresponding person's exit and is recovered from the list after her reentering. The proposed method was experimented in several indoor and outdoor scenario. This demonstrated the potential effectiveness of an adaptive model-base method that corrected distorted person's color information by lighting changes, and succeeded tracking of persons which was overlapped in a frame.

• Proceedings of the ESK Conference
• /
• 1998.04a
• /
• pp.167-172
• /
• 1998

Methods of evaluating the physiological activity of the living body are EEG, EOG, Heart rate, and Rectal temperature, etc. In the study of Hagiwara and Araki(1993), they found positive correlations among performance test, physiological measurement, and subjective feeling measurement. Human alertness of pilot directly influences on the flight performance that accomplishes a lot of vigilance task and procedure execution in flight. Accordingly, this paper deals with the quantitative and objective performance test based on tracking error and reaction time by means of the new computer test program into which the perception-motion system of human beings is applies. Throughout this experiment using performance thst, the results suggest that performance capability in state of sleep deprivation 2 hours and alcoholic 0.05 .apaprox. 0.06% in blood were more impaired than one in a normal state, and they further showed statistically significant differences between them, which were influenced by impairment factors of body regulation and pilot's grade. We also obtained the prediction value and the 95% confidence interval of tracking error and reaction time at the normal state for the purpose of distinguishing performance capability between the normal state and the abnormal state. And it is ecpected that the evaluation of human alertness using performance test will be applied to the quantitative assessment of an each pilot's realistic consciousness/attention, and will lead a flight commander to the accurate decision of mission approval prior to a flight.

• Electronics and Telecommunications Trends
• /
• v.36 no.4
• /
• pp.92-102
• /
• 2021

Outdoor sports activities have been restricted by serious air pollution, such as fine dust and yellow dust, and abnormal meteorological change, such as heatwave and heavy snow. These environmental problems have rapidly increased the demand for indoor sports activities. Virtual sports, such as virtual golf, virtual baseball, virtual soccer, etc., allow playing various sports games without going outdoors. Indoor sports industries and markets have seen rapid growth since the advent of virtual sports. Most virtual sports platforms use screen-based virtual reality techniques, which are why they are called screen sports. However, these platforms cannot support various sports games, especially virtual match games, such as squash, boxing, and so on, because existing screen-based virtual reality sports techniques use real balls and players. This article presents screen-based haptic-augmented reality technologies for a new virtual sports platform. The new platform does not use real balls and players to solve the limitations of previous platforms. Here, various technologies, including human motion tracking, human action recognition, haptic feedback, screen-based augmented-reality systems, and augmented-reality sports content, are unified for the new virtual sports platform. From these haptic-augmented reality technologies, the proposed platform supports sports games, including indoor virtual matches, that existing virtual sports platforms cannot support.

• The Journal of Korea Robotics Society
• /
• v.18 no.4
• /
• pp.463-471
• /
• 2023

This paper proposes a method to estimate the level of interest shown by visitors towards a specific target, a guide robot, in spaces where a large number of visitors, such as exhibition halls and museums, can show interest in a specific subject. To accomplish this, we apply deep learning-based behavior recognition and object tracking techniques for multiple visitors, and based on this, we derive the behavior analysis and interest level of visitors. To implement this research, a personalized dataset tailored to the characteristics of exhibition hall and museum environments was created, and a deep learning model was constructed based on this. Four scenarios that visitors can exhibit were classified, and through this, prediction and experimental values were obtained, thus completing the validation for the interest estimation method proposed in this paper.