• Journal of the Semiconductor & Display Technology
• /
• v.22 no.1
• /
• pp.72-77
• /
• 2023

In many manufacturing settings, including the semiconductor industry, products are completed by producing and assembling various components. Sorting out from randomly mixed parts and classification operations takes a lot of time and labor. Recently, many efforts have been made to select and assemble correct parts from mixed parts using robots. Automating the sorting and classification of randomly mixed components is difficult since various objects and the positions and attitudes of robots and cameras in 3D space need to be known. Previously, only objects in specific positions were grasped by robots or people sorting items directly. To enable robots to pick up random objects in 3D space, bin picking technology is required. To realize bin picking technology, it is essential to understand the coordinate system information between the robot, the grasping target object, and the camera. Calibration work to understand the coordinate system information between them is necessary to grasp the object recognized by the camera. It is difficult to restore the depth value of 2D images when 3D restoration is performed, which is necessary for bin picking technology. In this paper, we propose to use depth information of RGB-D camera for Z value in rotation and movement conversion used in calibration. Proceed with camera calibration for accurate coordinate system conversion of objects in 2D images, and proceed with calibration of robot and camera. We proved the effectiveness of the proposed method through accuracy evaluations for camera calibration and calibration between robots and cameras.

• The Journal of the Korea Contents Association
• /
• v.17 no.2
• /
• pp.439-448
• /
• 2017

Facial expression is important factor on social interaction. Facial muscle movement provides emotion information to develop social network. However, facial movement has less determined to recognize social emotion. This study is to analyze facial micro-movements and to recognize the social emotion such as intimacy, empathy, and valence. 76 university students were presented to the stimuli for social emotions and was measure their facial expression using camera. As a results, facial micro-movement. showed significant difference of social emotion. After extracting the movement amount of 3 unconscious muscles and 18 conscious muscles, Dominant Frequency band was confirmed. While muscle around the nose and cheek showed significant difference in the intimacy, one around mouth did in the empathy and one around jaw in the valence. The results proposed new facial movement to express social emotion in virtual avatars and to recognize social emotion.

• Journal of Sensor Science and Technology
• /
• v.10 no.1
• /
• pp.52-61
• /
• 2001

We propose a new saccadic eye movement system with visual selective attention. Saliency map models generate the scan pathways in a natural scene, of which the output makes an attended location. Saccadic eye movement model is used for producing the target trajectories to move the attended locations very rapidly. To categorize human saccadic eye movement, saccadic eye movement model was divided into three parts, each of which was then individually modeled using different neural networks to reflect a principal functionality of brain structures related with the saccadic eye movement in our brain. Based on the proposed saliency map models and the saccadic eye movement model, an active vision system using a CCD type camera and BLDC motor was developed and demonstrated with experimental results.

• Journal of The Korean Society of Integrative Medicine
• /
• v.11 no.2
• /
• pp.207-219
• /
• 2023

Purpose : This study was conducted to investigate the changes in trunk movement and ground reaction during sit to stand motion using visual feedback. Methods : Fifteen adults (average age: 23.53±1.77 years) participated in this study. An infrared reflective marker was attached to the body each participant for motion analysis, and the participants performed sit to stand motion while wearing a hat attached with a laser pointer, which provided visual feedback. First, the sit to stand action was repeated thrice without obtaining any visual feedback, followed by a three minute break. Next, the laser pointers attached to hats were irradiated on a whiteboard, located at a distance of 5 m in front of the chairs, on which the participants sat; a baseline was set, and the participants performed stand up movements three times under this condition. A visual feedback was provided to the participants to prevent the laser pointers from crossing the set baseline. During each stand-up movement, the position of the reflective marker attached to the subject's body was recorded in real time using an infrared camera for motion analysis. The trunk movement and ground reaction force were extracted through recorded data and analyzed according to the presence or absence of visual feedback. Results : The results indicated that in the presence of a visual feedback during the sit-to-stand movements, the range of motion of the trunk and hip joints decreased, whereas that of the knee and ankle joints increased in the sagittal plane. The rotation angle of the trunk in the horizontal plane decreased. The left and right movement speed of the center of pressure increased, the pressing force decreased, and the forward and backward movement speed of the trunk decreased. Conclusion : The results suggest that the efficiency and stability of the stand up movement of a body increase when a visual feedback is provided.

• Proceedings of the IEEK Conference
• /
• 2003.07c
• /
• pp.2529-2532
• /
• 2003

The quality of agricultural products is represented a degree of freshness and a special qualify that has a close relation to commercial value. To grade tomatoes, it used to nondestructive equipment of a charge-coupled device(CCD) camera and near-infrared(NIR) spectrum analysis method. The NIR spectrum analysis method is used to determine internal qualities such as a brix and an acidity. The CCD camera is used to measure external qualities like color and a size of tomatoes. This paper explaines the structure and movement of the automatic grade system and applies the algorithm for deformed tomtatoes and characteristics of tomatoes through image processing to the grade system.

• International Journal of Internet, Broadcasting and Communication
• /
• v.12 no.3
• /
• pp.171-176
• /
• 2020

This paper presents an implementation of a gesture recognition platform that can be used in a factory workplaces. The platform consists of signages that display worker's job orders and a control center that is used to manage work orders for factory workers. Each worker does not need to bring work order documents and can browse the assigned work orders on the signage at his/her workplace. The contents of signage can be controlled by worker's hand and arm gestures. Gestures are extracted from body movement tracked by 3D depth camera and converted to the commandsthat control displayed content of the signage. Using the control center, the factory manager can assign tasks to each worker, upload work order documents to the system, and see each worker's progress. The implementation has been applied experimentally to a machining factory workplace. This flatform provides convenience for factory workers when they are working at workplaces, improves security of techincal documents, but can also be used to build smart factories.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.17 no.9
• /
• pp.2373-2380
• /
• 1993

This paper addresses the design procedure and testing result of a servo driven pan/tilt device which is capable of tracking arbitrary movement of a specified target object. In order to achieve real-time acquisition of feedback signal, a 2 degree-of freedom non-contact type displacement follower has been employed in stead of vision camera. The performance of the designed system is tested for different target velocities and control gains. The test result shows the satisfactory performance to be adopted as an effective tool for visual transfer in the context of teleoperation.

• Proceedings of the KSME Conference
• /
• 2004.11a
• /
• pp.788-792
• /
• 2004

In this study, the performance of the DPRMs is evaluated and the measurement precision for the pile driving is presented. The DPRMs is a visual-measurement system for the pile rebound and the penetration movement using a high speed line-scan camera. But the measurement errors of the DPRMs are caused by the strong impact for the pile driving. Therefore, the DPRMs should guarantee its measurement values for the pile driving. For this reason, the performance of the DPRMs by the vibration signal analysis is studied. It is found from this study that the measurement values of the DPRMs are reliable.

• Journal of information and communication convergence engineering
• /
• v.6 no.3
• /
• pp.331-336
• /
• 2008

In this paper, we propose a real-time people tracking system with multiple CCD cameras for security inside the building. To achieve this goal, we present a method for 3D walking human tracking based on the IMPRESARIO framework incorporating cascaded classifiers into hypothesis evaluation. The efficiency of adaptive selection of cascaded classifiers has been also presented. The camera is mounted from the ceiling of the laboratory so that the image data of the passing people are fully overlapped. The implemented system recognizes people movement along various directions. To track people even when their images are partially overlapped, the proposed system estimates and tracks a bounding box enclosing each person in the tracking region. The approximated convex hull of each individual in the tracking area is obtained to provide more accurate tracking information. We have shown the improvement of reliability for likelihood calculation by using cascaded classifiers. Experimental results show that the proposed method can smoothly and effectively detect and track walking humans through environments such as dense forests.

• Proceedings of the KIEE Conference
• /
• 2005.05a
• /
• pp.33-35
• /
• 2005

We propose an eye gaze tracking system under natural head movements. The system consists of one CCD camera and two front-surface mirrors. The mirrors rotate to follow head movements in order to keep the eye within the view of the camera. However, the mirror controller cannot guarantee the fast head movements, because the frame rate is generally 30Hz. To overcome this problem, we applied Kalman predictor to estimate next eye position from the current eye image. In the results, our system allows the subjects head to move 50cm horizontally and 40cm vertically, with the speed about 10cm/sec and 6cm/sec, respectively. And spatial gaze resolutions are about 4.5 degree and 4.5 degree, respectively, and the gaze estimation accuracy is 92% under natural head movements.