• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.26 no.2
• /
• pp.223-229
• /
• 2017

Recently, robotic bin-picking tasks have drawn considerable attention, because flexibility is required in robotic assembly tasks. Generally, stereo camera systems have been used widely for robotic bin-picking, but these have two limitations: First, computational burden for solving correspondence problem on stereo images increases calculation time. Second, errors in image processing and camera calibration reduce accuracy. Moreover, the errors in robot kinematic parameters directly affect robot gripping. In this paper, we propose a method of correcting the bin-picking error by using trinocular vision system which consists of two stereo cameras andone hand-eye camera. First, the two stereo cameras, with wide viewing angle, measure object's pose roughly. Then, the 3rd hand-eye camera approaches the object, and corrects the previous measurement of the stereo camera system. Experimental results show usefulness of the proposed method.

• Journal of Practical Engineering Education
• /
• v.16 no.2
• /
• pp.115-119
• /
• 2024

With the increase in the number of ICT industry workers, there is a demand for research on preventing VDT syndrome. However, existing posture correction products mostly rely heavily on cameras or sensors in wearable devices. In this paper, we have developed a posture correction system that utilizes built-in cameras and circular pressure sensors to collect posture information. Additionally, the system provides a personalized service by capturing the correct posture of the user initially and monitoring the user's posture based on that input. By precisely correcting postures during users' daily tasks, this system aims to prevent and improve VDT syndrome, ultimately enhancing the efficiency of ICT industry workers.

• Journal of Broadcast Engineering
• /
• v.26 no.3
• /
• pp.247-257
• /
• 2021

This paper proposes a new technique for calibrating a multi-view RGB-D camera using a 3D (dimensional) skeleton. In order to calibrate a multi-view camera, consistent feature points are required. In addition, it is necessary to acquire accurate feature points in order to obtain a high-accuracy calibration result. We use the human skeleton as a feature point to calibrate a multi-view camera. The human skeleton can be easily obtained using state-of-the-art pose estimation algorithms. We propose an RGB-D-based calibration algorithm that uses the joint coordinates of the 3D skeleton obtained through the posture estimation algorithm as a feature point. Since the human body information captured by the multi-view camera may be incomplete, the skeleton predicted based on the image information acquired through it may be incomplete. After efficiently integrating a large number of incomplete skeletons into one skeleton, multi-view cameras can be calibrated by using the integrated skeleton to obtain a camera transformation matrix. In order to increase the accuracy of the calibration, multiple skeletons are used for optimization through temporal iterations. We demonstrate through experiments that a multi-view camera can be calibrated using a large number of incomplete skeletons.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.7-14
• /
• 2006

본 논문에서는 3D 복원과 카메라 측정과정 없이 정확하게 카메라 자세를 계산하고 가상객체를 비디오에 합성하기 위한 단일 프레임 기반의 고속 계산 기법을 제안한다. 객체의 로컬 좌표와 단일 이미지에서의 대응되는 이미지 좌표로부터 카메라 자세를 계산한다. 정사영 투영모델에서의 분해기법에 기반한 구조 계산 방법으로 카메라 자세의 고속 추정이 가능하다. 정사영 투영모델에 기반하기 때문에 참조점의 설정에 따라 정확도가 달라진다. 객체에 따라 참조점을 설정하여 정확한 카메라 자세를 계산하는 방법을 제안한다. 카메라 자세 및 물체의 형태는 단일 프레임 기반으로 수행되며 카메라 자세 추정 결과가 즉시 비디오 합성에 사용될 수 있도록 하였다. 제안하는 기법의 유효성 입증을 위해 실사 비디오에 기반한 증강현실시스템을 구현하고 카메라 자세 계산과 비디오 합성의 전체 과정을 단일 프레임에 기반하여 실험을 수행하고 제안 기법의 실용성을 보였다.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.2498-2501
• /
• 2003

In this paper, we present a wavelet neural network (WNN) approach to the solution of the path tracking problem for mobile robots that possess complexity, nonlinearity and noise. First, we discuss a WNN based control system where the control signals are directly obtained by minimizing the difference between the reference track and the pose of a mobile robot. This compact network structure is helpful to determine the number of hidden nodes and the initial value of weights. Then, the data with various noises provided by odometric and external sensors are here fused together by means of an Extended Kalman Filter (EKF) approach for the pose estimation problem of mobile robots. This control process is a dynamic on-line process that uses the wavelet neural network trained via the gradient-descent method with estimates from EKF. Finally, we verify the effectiveness and feasibility of the proposed control system through simulations.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2010.07a
• /
• pp.312-314
• /
• 2010

본 논문에서는 하나의 카메라로 일정 영역에서 랜덤하게 촬영되어 얻어진 영상으로 파노라마 영상을 제작하는 방법을 제안한다. 실험 영상으로는 디지털카메라로 일정 영역을 랜덤하게 촬영한 여러 장의 영상을 사용한다. 여러 장의 영상에서 제어점이 될 특징 점들을 검출한 후, 유클리드의 좌표로 바꿔준다. 이 좌표들을 통해 각각의 제어 점에 가장 인접해 있는 좌표 4개를 추출한다. 이 인접 좌표들이 서로 다른 각각의 영상에서 매칭 되는 확률을 계산하여, 가장 높은 매칭 확률을 갖는 영상과 매칭 되는 pose값을 이용하여 각각의 영상을 회전 및 이동하여 매칭시킴으로써 촬영된 영상들의 파노라마 영상을 구현한다.

• The Journal of Korea Robotics Society
• /
• v.2 no.1
• /
• pp.29-39
• /
• 2007

We present an implementation of particle filter algorithm for global localization and kidnap recovery of mobile robot. Firstly, we propose an algorithm for efficient particle initialization using sonar line features. And then, the average likelihood and entropy of normalized weights are used as a quality measure of pose estimation. Finally, we propose an active kidnap recovery by adding new particle set. New and independent particle set can be initialized by monitoring two quality measures. Added particle set can re-estimate the pose of kidnapped robot. Experimental results demonstrate the capability of our global localization and kidnap recovery algorithm.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.11
• /
• pp.1164-1169
• /
• 2014

This paper proposes an angle estimation of Segway robot for the slop driving. Most of Segway robot was controlled by pose control of keeping robot's balance and motor control of driving. In motor control, we analyzed Segway robot kinetically and estimated an angle of inclination using the velocity that depends on input force. In pose control, also, we used PD controller and evaluated a stability of controller through MATLAB simulation. Assuming the robot keeps its balance stably using controller, we could linearize dynamics. We could obtain the result through the experiment which estimates an angle using the velocity of Segway robot that is derived from linearized dynamics.

• The Journal of Korea Robotics Society
• /
• v.5 no.3
• /
• pp.262-269
• /
• 2010

This paper presents a probabilistic head tracking method, mainly applicable to face recognition and human robot interaction, which can robustly track human head against various variations such as pose/scale change, illumination change, and background clutters. Compared to conventional particle filter based approaches, the proposed method can effectively track a human head by regularizing the sample space and sequentially weighting multiple visual cues, in the prediction and observation stages, respectively. Experimental results show the robustness of the proposed method, and it is worthy to be mentioned that some proposed probabilistic framework could be easily applied to other object tracking problems.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.10
• /
• pp.4098-4116
• /
• 2020

Mobile devices such as smartphones are very attractive targets for augmented reality (AR) services, but their limited resources make it difficult to increase the number of objects to be recognized. When the recognition process is scaled to a large number of objects, it typically requires significant computation time and memory. Therefore, most large-scale mobile AR systems rely on a server to outsource recognition process to a high-performance PC, but this limits the scenarios available in the AR services. As a part of realizing large-scale standalone mobile AR, this paper presents a solution to the problem of accuracy, memory, and speed for large-scale object recognition. To this end, we design our own basic feature and realize spatial locality, selective feature extraction, rough pose estimation, and selective feature matching. Experiments are performed to verify the appropriateness of the proposed method for realizing large-scale standalone mobile AR in terms of efficiency and accuracy.