• ETRI Journal
• /
• 제45권5호
• /
• pp.836-846
• /
• 2023

Mobile robots are used in modern life; however, object recognition is still insufficient to realize robot navigation in crowded environments. Mobile robots must rapidly and accurately recognize the movements and shapes of pedestrians to navigate safely in pedestrian-rich spaces. This study proposes real-time, accurate, three-dimensional (3D) multi-pedestrian detection and tracking using a 3D light detection and ranging (LiDAR) point cloud in crowded environments. The pedestrian detection quickly segments a sparse 3D point cloud into individual pedestrians using a lightweight convolutional autoencoder and connected-component algorithm. The multi-pedestrian tracking identifies the same pedestrians considering motion and appearance cues in continuing frames. In addition, it estimates pedestrians' dynamic movements with various patterns by adaptively mixing heterogeneous motion models. We evaluate the computational speed and accuracy of each module using the KITTI dataset. We demonstrate that our integrated system, which rapidly and accurately recognizes pedestrian movement and appearance using a sparse 3D LiDAR, is applicable for robot navigation in crowded spaces.

• Journal of Welding and Joining
• /
• 제14권4호
• /
• pp.79-88
• /
• 1996

For improvement in productivity and weld quality, weld seam tracking and welding parameter control are very essential in the welding of a structure which can not be cxactly fit-up due to mismatch, discontinous gap, deflection, etc.. In this study, an automatic weld seam tracking system is developed for I-butt joint structure, and the system consists of XYZ working table, vision sensor and user interface program. In the developed vision sensor system, an image projection algorithm for weld-line detection and an adaptive current control algorithm for gap variation were implemented. The user interface program developed in this study by basing on the objct oriented concept could provide very convenient way to utilize the tracking system with the pull-down menu driven structure. The developed system showed a good seam tracking and weld quality control capability corresponding to deflected weld lines and gap variations.

• 대한임베디드공학회논문지
• /
• 제16권5호
• /
• pp.163-169
• /
• 2021

In this paper, we implemented a deep learning-based automatic object tracking and handy motion control drone system and analyzed the performance of the proposed system. The drone system automatically detects and tracks targets by analyzing images obtained from the drone's camera using deep learning algorithms, consisting of the YOLO, the MobileNet, and the deepSORT. Such deep learning-based detection and tracking algorithms have both higher target detection accuracy and processing speed than the conventional color-based algorithm, the CAMShift. In addition, in order to facilitate the drone control by hand from the ground control station, we classified handy motions and generated flight control commands through motion recognition using the YOLO algorithm. It was confirmed that such a deep learning-based target tracking and drone handy motion control system stably track the target and can easily control the drone.

• 디지털융복합연구
• /
• 제12권8호
• /
• pp.337-343
• /
• 2014

본 논문은 감지와 통신 데이터 전송량의 관점에서 서베일런스 네트워크에서 움직이는 객체를 추적하기 위하여 전송 데이터를 감소시키는 최소 윤곽선 추적 알고리즘을 제안한다. 이 알고리즘은 객체 추적에 대한 감지를 수행하고 서버와의 영상 데이터 전송 시 영상 데이터 전송량을 줄임으로써 서버와의 통신 부하를 최소화한다. 이 알고리즘은 객체의 운동학을 기초로 최소 추적 영역을 사용한다. 객체의 운동학의 모델링은 예정된 시간 안에서 이동할 수 있는 객체에 의해 운동 역학적으로 방문될 수 없는 추적 영역의 부분을 제거하는 것으로써 시작한다. 실시간으로 객체를 검출하는 응용 분야에서 대량의 영상 데이터를 전송시에 전송 부하를 줄일 수 있는 효과가 있다.

• 한국정보기술학회 영문논문지
• /
• 제10권1호
• /
• pp.15-23
• /
• 2020

In this paper, we propose a new method to detect traffic accidents in video from vehicle-mounted cameras (vehicle black box). We use the distance between vehicles to determine whether an accident has occurred. To calculate the position of each vehicle, we use object detection and tracking method. By the way, in a crowded road environment, it is so difficult to decide an accident has occurred because of parked vehicles at the edge of the road. It is not easy to discriminate against accidents from non-accidents because a moving vehicle and a stopped vehicle are mixed on a regular downtown road. In this paper, we try to increase the accuracy of the vehicle accident detection by using not only the motion of the surrounding vehicle but also ego-motion as the input of the Recurrent Neural Network (RNN). We improved the accuracy of accident detection compared to the previous method.

• 한국정보전자통신기술학회논문지
• /
• 제4권3호
• /
• pp.202-208
• /
• 2011

최근 들어 인간과 컴퓨터의 상호작용을 통해 컴퓨터 시스템을 제어하는 기술에 관한 연구가 진행되고 있다. 이러한 응용분야의 대부분은 얼굴검출을 통해 사용자의 위치를 파악하고 사용자의 제스처를 인식하는 방법을 포함하고 있으나, 얼굴검출 성능은 아직 미흡한 실정이다. 사용자의 위치가 안정적으로 검출되지 못 하는 경우에는 제스처 인식 등의 인터페이스 성능은 현격하게 저하된다. 따라서 본 논문에서는 피부색과 얼굴검출의 누적 분포를 이용하여 동영상에서 안정적으로 얼굴을 검출할 수 있는 알고리즘을 제안하고, 실험을 통해 알고리즘의 유용성을 증명하였다. 제안한 알고리즘은 대응행렬 분석을 적용하여 사람을 추적하는 분야에 응용이 가능하다.

• 로봇학회논문지
• /
• 제16권1호
• /
• pp.49-55
• /
• 2021

Recently, a smart farm technology is drawing attention as an alternative to the decline of farm labor population problems due to the aging society. Especially, there is an increasing demand for automatic harvesting system that can be commercialized in the market. Pre-harvest crop detection is the most important issue for the harvesting robot system in a real-world environment. In this paper, we proposed a real-time tomato instance tracking algorithm by using deep learning and probability models. In general, It is hard to keep track of the same tomato instance between successive frames, because the tomato growing environment is disturbed by the change of lighting condition and a background clutter without a stochastic approach. Therefore, this work suggests that individual tomato object detection for each frame is conducted by YOLOv3 model, and the continuous instance tracking between frames is performed by Kalman filter and probability model. We have verified the performance of the proposed method, an experiment was shown a good result in real-world test data.

• 제어로봇시스템학회논문지
• /
• 제11권4호
• /
• pp.290-296
• /
• 2005

This paper presents the implementation of a crack tracking mobile robot. The crack tracking robot is built for tracking cracks on the pavement. To track cracks, crack must be detected by laser and camera sensors. Laser sensor projects laser on the pavement to detect the discontinuity on the surface and the camera captures the image to find the crack position. Then the robot is commanded to follow the crack. To detect crack position correctly, neural network is used to minimize the positional errors of the captured crack position obtained by transformation from 2 dimensional images to 3 dimensional images.

• Journal of Information Processing Systems
• /
• 제15권1호
• /
• pp.67-90
• /
• 2019

Accurate detection, tracking and analysis of human movement using robots and other visual surveillance systems is still a challenge. Efforts are on to make the system robust against constraints such as variation in shape, size, pose and occlusion. Traditional methods of detection used the sliding window approach which involved scanning of various sizes of windows across an image. This paper concentrates on employing a state-of-the-art, hierarchical graph based method for segmentation. It has two stages: part level segmentation for color-consistent segments and object level segmentation for category-consistent regions. The tracking phase is achieved by employing SIFT keypoint descriptor based technique in a combined matching and tracking scheme with validation phase. Localization of human region in each frame is performed by keypoints by casting votes for the center of the human detected region. As it is difficult to avoid incorrect keypoints, a consensus-based framework is used to detect voting behavior. The designed methodology is tested on the video sequences having 3 to 4 persons.

• 대한인간공학회지
• /
• 제31권4호
• /
• pp.601-607
• /
• 2012

Objective: The aim of this study is to classify between intentional and natural blinks in vision based eye tracking system. Through implementing the classification method, we expect that the great eye tracking method will be designed which will perform well both navigation and selection interactions. Background: Currently, eye tracking is widely used in order to increase immersion and interest of user by supporting natural user interface. Even though conventional eye tracking system is well focused on navigation interaction by tracking pupil movement, there is no breakthrough selection interaction method. Method: To determine classification threshold between intentional and natural blinks, we performed experiment by capturing eye images including intentional and natural blinks from 12 subjects. By analyzing successive eye images, two features such as eye closed duration and pupil size variation after eye open were collected. Then, the classification threshold was determined by performing SVM(Support Vector Machine) training. Results: Experimental results showed that the average detection accuracy of intentional blinks was 97.4% in wearable eye tracking system environments. Also, the detecting accuracy in non-wearable camera environment was 92.9% on the basis of the above used SVM classifier. Conclusion: By combining two features using SVM, we could implement the accurate selection interaction method in vision based eye tracking system. Application: The results of this research might help to improve efficiency and usability of vision based eye tracking method by supporting reliable selection interaction scheme.