• Transactions on Control, Automation and Systems Engineering
• /
• v.4 no.4
• /
• pp.341-346
• /
• 2002

When a construction company builds a high structure. many piles should be driven into the ground by a hammer whose weight is 7,000 kg in order to make the ground under the structure safe and strong. So. it is essential to determine whether a pile is penetrated into the ground enough to support the weight of the structure since ground characteristics at different locations are different each other. This paper proposes a visual measurement system for pile rebound and penetration movement including vibration using a high-speed line-scan camera and a specially designed mark to recognize two-dimensional motion parameters of the mark using only a line-scan camera. A mark stacking white and black right-angled triangles is used for the measurement, and movement information for vertical distance, horizontal distance and rotational angle is determined simultaneously. Especially- by adopting a line-scan CCD camera whose line rate is 20 ㎑. the measurement performance of dynamic characteristics of the pile at impact instant is improved dramatically.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.808-811
• /
• 2009

Robovie-R2 [1], developed by ATR, is a 110cm high, 60kg weight, two wheel drive, human like robot. It has two arms with dynamic fingers. It also has a position sensitive detector sensor and two cameras as eyes on his head for recognizing his surrounding environment. Recent years, we have carried out a project to integrate new functions into Robovie-R2 so as to make it possible to be used in a dining room in healthcare center for helping serving meal for elderly. As a new function, we have developed software system for adaptive movement control of Robovie-R2 that is primary important since a robot that cannot autonomously control its movement would be a dangerous object to the people in dining room. We used the cameras on Robovie-R2's head to catch environment images, applied our original algorithm for recognizing obstacles such as furniture or people, so as to control Roboie-R2's movement. In this paper, we will focus our algorithm and its results.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.63 no.6
• /
• pp.813-819
• /
• 2014

The purpose of this study was to extract accurate parameters of facial movement features using 3-D motion capture system in speech recognition technology through lip-reading. Instead of using the features obtained through traditional camera image, the 3-D motion system was used to obtain quantitative data for actual facial movements, and to analyze 11 variables that exhibit particular patterns such as nose, lip, jaw and cheek movements in monosyllable vocalizations. Fourteen subjects, all in 20s of age, were asked to vocalize 11 types of Korean vowel monosyllables for three times with 36 reflective markers on their faces. The obtained facial movement data were then calculated into 11 parameters and presented as patterns for each monosyllable vocalization. The parameter patterns were performed through learning and recognizing process for each monosyllable with speech recognition algorithms with Hidden Markov Model (HMM) and Viterbi algorithm. The accuracy rate of 11 monosyllables recognition was 97.2%, which suggests the possibility of voice recognition of Korean language through quantitative facial movement analysis.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.44 no.4
• /
• pp.169-176
• /
• 2021

Maritime monitoring requirements have been beyond human operators capabilities due to the broadness of the coverage area and the variety of monitoring activities, e.g. illegal migration, or security threats by foreign warships. Abnormal vessel movement can be defined as an unreasonable movement deviation from the usual trajectory, speed, or other traffic parameters. Detection of the abnormal vessel movement requires the operators not only to pay short-term attention but also to have long-term trajectory trace ability. Recent advances in deep learning have shown the potential of deep learning techniques to discover hidden and more complex relations that often lie in low dimensional latent spaces. In this paper, we propose a deep autoencoder-based clustering model for automatic detection of vessel movement anomaly to assist monitoring operators to take actions on the vessel for more investigation. We first generate gridded trajectory images by mapping the raw vessel trajectories into two dimensional matrix. Based on the gridded image input, we test the proposed model along with the other deep autoencoder-based models for the abnormal trajectory data generated through rotation and speed variation from normal trajectories. We show that the proposed model improves detection accuracy for the generated abnormal trajectories compared to the other models.

• Journal of Korea Multimedia Society
• /
• v.25 no.10
• /
• pp.1535-1545
• /
• 2022

Sign language has completely different meaning depending on the direction of the hand or the change of facial expression even with the same gesture. In this respect, it is crucial to capture the spatial-temporal structure information of each movement. However, sign language translation studies based on Sign2Gloss2Text only convey comprehensive spatial-temporal information about the entire sign language movement. Consequently, detailed information (facial expression, gestures, and etc.) of each movement that is important for sign language translation is not emphasized. Accordingly, in this paper, we propose Spatial-temporal Keypoints Centered Sign2Gloss2Text Translation, named STKC-Sign2 Gloss2Text, to supplement the sequential and semantic information of keypoints which are the core of recognizing and translating sign language. STKC-Sign2Gloss2Text consists of two steps, Spatial Keypoints Embedding, which extracts 121 major keypoints from each image, and Temporal Keypoints Embedding, which emphasizes sequential information using Bi-GRU for extracted keypoints of sign language. The proposed model outperformed all Bilingual Evaluation Understudy(BLEU) scores in Development(DEV) and Testing(TEST) than Sign2Gloss2Text as the baseline, and in particular, it proved the effectiveness of the proposed methodology by achieving 23.19, an improvement of 1.87 based on TEST BLEU-4.

• The Journal of the Korea Contents Association
• /
• v.11 no.1
• /
• pp.113-122
• /
• 2011

Visual images are very close to our living and we make decisions and choose behavioral options with the visual images on mass media. In current-affair documentary programs, interviews have potential effects that can change public opinions on important issues. Therefore, it's a consequence that the study examined how different expressions of visual images in documentary. Using preceding research methods, this study focus on form, color, movement and depth of visual images. This study analyzed quantitatively all interview shots with 15 current-affair documentary programs from major TV stations such as KBS, MBC and SBS. The findings of the study are 1) half of interview shots used the visual image expressions to hide interviewees' face according to the shield law, 2) choosing close-up shots in company with bust shots, 3) using natural lights and hand-held camera techniques for interviews, and 4) showing wide angles without depths of visual image.

• Journal of the Korean Institute of Telematics and Electronics S
• /
• v.36S no.11
• /
• pp.79-88
• /
• 1999

In this paper we address the tracking method which tracks only target object in image sequence including moving object. We use a contour tracking algorithm based on intensity and motion boundaries. The motion of the moving object contour in the image is assumed to be well describable by an affine motion model with a translation, a change in scale and a rotation. The moving object contour is represented by B-spline, the position and motion of which is estimated along the image sequence. we use pattern recognition to identify target object. In order to use linear Kalman Filters we decompose the estimation process into two filters. One is estimating the affine motion parameters and the other the shape of moving object contour. In some experiments with dial plate we show that this method enables us to obtain the robust motion estimates and tracking trajectories even in case of including obstructive object.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.44 no.6
• /
• pp.24-34
• /
• 2007

Application systems that easy to access a information have been developed by IT growth and a human life variation. In this paper, we propose a application system to register a 3D footwear model using a monocular camera. In General, a human motion analysis research to body movement. However, this system research a new method to use a foot movement. This paper present a system process and show experiment results. For projection to 2D foot plane from 3D shoe model data, we construct processes that a foot tracking, a projection expression and pose estimation process. This system divide from a 2D image analysis and a 3D pose estimation. First, for a foot tracking, we propose a method that find fixing point by a foot characteristic, and propose a geometric expression to relate 2D coordinate and 3D coordinate to use a monocular camera without a camera calibration. We make a application system, and measure distance error. Then, we confirmed a registration very well.

• Journal of the Architectural Institute of Korea Planning & Design
• /
• v.34 no.6
• /
• pp.23-30
• /
• 2018

Gordon Cullen, who tried to understand urban landscapes in terms of visual attention, introduced a concept called 'Space and Infinity' in his book 'Townscape'. According to him, urban images like infinity spreading across the sky are more effectively created when we happen to see an open space while walking along a ground-level street than when we look at the sky. This study aims to quantitatively examine if urban observers pay more attention to spaces like pilotis on the bottom of a building. Thus, this study collected observers on actual urban landscape images and partially-edited images and conducted an experiment by adopting Eye-movement Tracking to find out if they actually pay more visual attention to a space like pilotis. This study selected a total of 50 people as research subjects and divided them into two groups. Image 1 was shown to one group, and Image 2 with the pilotis space edited was shown to the other group. As an experiment to find objective evidences on Gordon Cullen's 'Space and Infinity', this study analyzed difference between Image 1 and Image 2, and it was found that the domain of pilotis showed a value five times higher than the average visual attention since it attracted much visual attention although it was very small in area. That is, it has objectively clarified that people get most fascinated with a place with infinite images in the background like a pilotis space out of all the urban landscapes as Gordon Cullen's theory. In addition, the differences in visual concentration of pilotis space by sex, by subject was examined, and there was no significant difference in visual concentration of pilotis space by gender. As a result of examining the difference of visual concentration by classifying the subjects into architectural related major, the major group showed higher frequency of viewing than the non - major group.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.10 no.6
• /
• pp.209-214
• /
• 2010

In this paper, We analyzes the image along the platform (Open Eye), through prevention of dementia or stroke patients and cognitive rehabilitation for the proposed system. This way through the camera image according to user's movement gained OpenCV image processing library, which is based on motion analysis, a part of this rehabilitation is to apply to cognitive rehabilitation. Therefore, this paper proposes a new image analysis system has been exposed to the elderly or stroke patients with dementia, their hand gestures through which patients can detect the image of the cognitive rehabilitation to help them in the analysis of the image analysis system is proposed.