• 로봇학회논문지
• /
• 제13권4호
• /
• pp.230-236
• /
• 2018

3D depth perception has played an important role in robotics, and many sensory methods have also proposed for it. As a photodetector for 3D sensing, single photon avalanche diode (SPAD) is suggested due to sensitivity and accuracy. We have researched for applying a SPAD chip in our fusion system of time-of-fight (ToF) sensor and stereo camera. Our goal is to upsample of SPAD resolution using RGB stereo camera. Currently, we have 64 x 32 resolution SPAD ToF Sensor, even though there are higher resolution depth sensors such as Kinect V2 and Cube-Eye. This may be a weak point of our system, however we exploit this gap using a transition of idea. A convolution neural network (CNN) is designed to upsample our low resolution depth map using the data of the higher resolution depth as label data. Then, the upsampled depth data using CNN and stereo camera depth data are fused using semi-global matching (SGM) algorithm. We proposed simplified fusion method created for the embedded system.

• 동력기계공학회지
• /
• 제17권5호
• /
• pp.121-127
• /
• 2013

In this paper, we propose a distance measurement system for automatic berthing control using a stereo camera mounted on a rotation control device, and a radial pattern target. Automatically controlling the position and attitude of a ship aims to prevent maritime accidents due to human error. Our goal is to measure the relative distance between a ship and an onshore or offshore target for berthing. Therefore, the distance should be continuously measured while tracking a fixed point on a target. To this end, we developed a stereo camerabased distance measurement system that satisfied these requirements. This paper describes the structure and principle of the measurement system. We validate the distance error for target incline due to the relative position and attitude between a camera and a target in miniature scale. In addition, the findings of an experiment in an outdoor environment demonstrate that the proposed measurement system has accuracy within 1 m at a range of 20-100 m which is the acceptable accuracy for automatic berthing.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제5권9호
• /
• pp.1613-1631
• /
• 2011

Several metrics have been reported in the literature to assess stereo image quality, mostly based on visual attention or human visual sensitivity based distortion prediction with the help of disparity information, which do not consider the combined aspects of human visual processing. In this paper, visual attention and depth assisted stereo image quality assessment model (VAD-SIQAM) is devised that consists of three main components, i.e., stereo attention predictor (SAP), depth variation (DV), and stereo distortion predictor (SDP). Visual attention is modeled based on entropy and inverse contrast to detect regions or objects of interest/attention. Depth variation is fused into the attention probability to account for the amount of changed depth in distorted stereo images. Finally, the stereo distortion predictor is designed by integrating distortion probability, which is based on low-level human visual system (HVS), responses into actual attention probabilities. The results show that regions of attention are detected among the visually significant distortions in the stereo image pair. Drawbacks of human visual sensitivity based picture quality metrics are alleviated by integrating visual attention and depth information. We also show that positive correlation with ground-truth attention and depth maps are increased by up to 0.949 and 0.936 in terms of the Pearson and the Spearman correlation coefficients, respectively.

• 한국정보통신학회논문지
• /
• 제13권6호
• /
• pp.1194-1199
• /
• 2009

스테레오 비전 시스템(stereo vision system)은 2차원 영상정보를 이용하여 3차원 깊이 정보를 획득하는 데 유용한 방법으로, 그동안 많은 연구가 진행되었다. 3차원 깊이 정보를 획득하기 위해서는 영상의 대응점을 찾아야 하는데, 속도와 정확성을 동시에 만족시키기가 어렵다. 이러한 문제를 해결하기 위해, 본 논문에서는 적응적 가중치(weight)를 적용한 cost aggregation 기반의 스테레오 정합 기법을 제안한다. 이 방법은 스테레오 영상의 특징을 이용하여 가중치를 획득하고, 색상정보, 밝기정보에 거리정보를 이용하여 가중치를 적용한 후, 이를 이용하여 대응점을 찾아 깊이 정보를 추출한다. 제안된 방법의 성능을 평가하기 위하여 ground truth가 존재하는 다양한 스테레오 영상을 이용하여 실험하였으며, 실험 결과 다양한 영상에서도 향상된 결과를 보였다.

• 한국정보통신학회:학술대회논문집
• /
• 한국해양정보통신학회 2009년도 춘계학술대회
• /
• pp.396-399
• /
• 2009

스테레오 비전 시스템(stereo vision system)은 2차원 영상정보를 이용하여 3차원 깊이 정보를 획득하는 데 유용한 방법으로, 그동안 많은 연구가 진행되었다. 3차원 깊이 정보를 획득하기 위해서는 영상의 대응점을 찾아야 하는데, 속도와 정확성을 동시에 만족시키기가 어렵다. 이러한 문제를 해결하기 위해, 본 논문에서는 적응적 가중치(weight)를 적용한 cost aggregation 기반의 스테레오 정합 기법을 제안한다. 이 방법은 스테레오 영상의 특징을 이용하여 가중치를 획득하고, 색상정보, 밝기정보, 거리정보에 가중치를 적용한 후, 이를 이용하여 대응점을 찾아 깊이 정보를 추출한다. 제안된 방법의 성능을 평가하기 위하여 ground truth가 존재하는 다양한 스테레오 영상을 이용하여 실험하였으며, 실험 결과 다양한 영상에서도 향상된 결과를 보였다.

• 한국정보전자통신기술학회논문지
• /
• 제12권6호
• /
• pp.605-611
• /
• 2019

3D Vision system has many applications recently but popularization have many problems that need to be overcome. Volumetric display may process a amount of visual data and design the high efficient vision system for display. In case of stereo system for volumetric display, disparity vectors from the stereoscopic sequences and residual images with the reference images has been transmitted, and the reconstructed stereoscopic sequences have been displayed at the receiver. So central issue for the design of efficient volumetric vision system lies in selecting an appropriate stereo matching and robust vision system. In this paper, we propose high efficient vision system with the reduction of rectification error which can perform the 3D data extraction efficiently with low computational complexity. In experimental results with proposed vision system, the proposed method can perform the 3D data extraction efficiently with reducing rectification error and low computational complexity.

• ETRI Journal
• /
• 제29권3호
• /
• pp.305-310
• /
• 2007

If a virtual object in a virtual environment represented by a stereo vision system could be touched by a user with some tactile feeling on his/her fingertip, the sense of reality would be heightened. To create a visual impression as if the user were directly pointing to a desired point on a virtual object with his/her own finger, we need to align virtual space coordinates and physical space coordinates. Also, if there is no tactile feeling when the user touches a virtual object, the virtual object would seem to be a ghost. Therefore, a haptic interface device is required to give some tactile sensation to the user. We have constructed such a human-computer interaction system in the form of a simple virtual reality game using a stereo vision system, a vibro-tactile device module, and two position/orientation sensors.

• 대한기계학회:학술대회논문집
• /
• 대한기계학회 2004년도 추계학술대회
• /
• pp.766-771
• /
• 2004

In this paper, new exploration mobile robot is presented. This mobile robot, called Robhaz-6W, is able to overcome hazardous terrains, recognize three dimensional terrain information and generate a path toward the destination by itself. We develop the passive four bar linkage mechanism adoptable to such terrain without any active control and the real time stereo vision system for obstacle avoidance, a remote control and a path planning method. And the geometrical information is transmitted to the operator in the remote site via wireless LAN equipment. And finally, experimental results for the passive mechanism, the real time stereo vision system, the path planning are reported, which show the versatility of the proposed mobile robot system to carry out some tasks.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2008년도 하계종합학술대회
• /
• pp.1203-1204
• /
• 2008

In this paper, a new stereo object tracking system using the disparity motion vector is proposed. In the proposed method, the time-sequential disparity motion vector can be estimated from the disparity vectors which are extracted from the sequence of the stereo input image pair and then using these disparity motion vectors, the area where the target object is located and its location coordinate are detected from the input stereo image. Basing on this location data of the target object, the pan/tilt embedded in the stereo camera system can be controlled and as a result, 3D tracking of the target object can be possible.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.128.6-128
• /
• 2001

In this paper, we present a methodology of sensing and control for a robot system designed to be capable of grasping an object and moving it to target point Stereo vision system is employed to determine to depth map which represents the distance from the camera. In stereo vision system we have used a center-referenced projection to represent the discrete match space for stereo correspondence. This center-referenced disparity space contains new occlusion points in addition to the match points which we exploit to create a concise representation of correspondence an occlusion. And from the depth map we find the target object´s pose and position in 3-D space. To find the target object´s pose and position, we use the method of the model-based recognition.