• Title/Summary/Keyword: Stereo Vision Sensor

Search Result 71, Processing Time 0.022 seconds

Bimodal Approach of Multi-Sensor Integration for Telematics Application (텔레매틱스 응용을 위한 다중센서통합의 이중 접근구조)

  • 김성백;이승용;최지훈;장병태;이종훈
    • Proceedings of the IEEK Conference
    • /
    • 2003.11a
    • /
    • pp.525-528
    • /
    • 2003
  • In this paper, we present a novel idea to integrate low cost Inertial Measurement Unit(IMU) and Differential Global Positioning System (DGPS) for Telematics applications. As well known, low cost IMU produces large positioning and attitude errors in very short time due to the poor quality of inertial sensor assembly. To conquer the limitation, we present a bimodal approach for integrating IMU and DGPS, taking advantage of positioning and orientation data calculated from CCD images based on photogrammetry and stereo-vision techniques. The positioning and orientation data from the photogrammetric approach are fed back into the Kalman filter to reduce and compensate IMU errors and improve the performance. Experimental results are presented to show the robustness of the proposed method that can provide accurate position and attitude information for extended period for non-aided GPS information.

  • PDF

Development of a Vision Sensor-based Vehicle Detection System (스테레오 비전센서를 이용한 선행차량 감지 시스템의 개발)

  • Hwang, Jun-Yeon;Hong, Dae-Gun;Huh, Kun-Soo
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.16 no.6
    • /
    • pp.134-140
    • /
    • 2008
  • Preceding vehicle detection is a crucial issue for driver assistance system as well as for autonomous vehicle guidance function and it has to be performed with high reliability to avoid any potential collision. The vision-based preceded vehicle detection systems are regarded promising for this purpose because they require little infrastructure on a highway. However, the feasibility of these systems in passenger car requires accurate and robust sensing performance. In this paper, an preceded vehicle detection system is developed using stereo vision sensors. This system utilizes feature matching, epipoplar constraint and feature aggregation in order to robustly detect the initial corresponding pairs. After the initial detection, the system executes the tracking algorithm for the preceded vehicles including a leading vehicle. Then, the position parameters of the preceded vehicles or leading vehicles can be obtained. The proposed preceded vehicle detection system is implemented on a passenger car and its performances is verified experimentally.

A hardware architecture based on the NCC algorithm for fast disparity estimation in 3D shape measurement systems (고밀도 3D 형상 계측 시스템에서의 고속 시차 추정을 위한 NCC 알고리즘 기반 하드웨어 구조)

  • Bae, Kyeong-Ryeol;Kwon, Soon;Lee, Yong-Hwan;Lee, Jong-Hun;Moon, Byung-In
    • Journal of Sensor Science and Technology
    • /
    • v.19 no.2
    • /
    • pp.99-111
    • /
    • 2010
  • This paper proposes an efficient hardware architecture to estimate disparities between 2D images for generating 3D depth images in a stereo vision system. Stereo matching methods are classified into global and local methods. The local matching method uses the cost functions based on pixel windows such as SAD(sum of absolute difference), SSD(sum of squared difference) and NCC(normalized cross correlation). The NCC-based cost function is less susceptible to differences in noise and lighting condition between left and right images than the subtraction-based functions such as SAD and SSD, and for this reason, the NCC is preferred to the other functions. However, software-based implementations are not adequate for the NCC-based real-time stereo matching, due to its numerous complex operations. Therefore, we propose a fast pipelined hardware architecture suitable for real-time operations of the NCC function. By adopting a block-based box-filtering scheme to perform NCC operations in parallel, the proposed architecture improves processing speed compared with the previous researches. In this architecture, it takes almost the same number of cycles to process all the pixels, irrespective of the window size. Also, the simulation results show that its disparity estimation has low error rate.

3D Range Measurement using Infrared Light and a Camera (적외선 조명 및 단일카메라를 이용한 입체거리 센서의 개발)

  • Kim, In-Cheol;Lee, Soo-Yong
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.14 no.10
    • /
    • pp.1005-1013
    • /
    • 2008
  • This paper describes a new sensor system for 3D range measurement using the structured infrared light. Environment and obstacle sensing is the key issue for mobile robot localization and navigation. Laser scanners and infrared scanners cover $180^{\circ}$ and are accurate but too expensive. Those sensors use rotating light beams so that the range measurements are constrained on a plane. 3D measurements are much more useful in many ways for obstacle detection, map building and localization. Stereo vision is very common way of getting the depth information of 3D environment. However, it requires that the correspondence should be clearly identified and it also heavily depends on the light condition of the environment. Instead of using stereo camera, monocular camera and the projected infrared light are used in order to reduce the effects of the ambient light while getting 3D depth map. Modeling of the projected light pattern enabled precise estimation of the range. Identification of the cells from the pattern is the key issue in the proposed method. Several methods of correctly identifying the cells are discussed and verified with experiments.

The study of improving the accuracy in the 3D data acquisition (3차원 모션 데이터 획득의 성능 향상을 위한 연구)

  • Han, Changho;Oh, Choonsuk;Ryu, Youngkee
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.8 no.5
    • /
    • pp.205-210
    • /
    • 2008
  • In previous paper, we introduced 3d acquisition system with CCD cameras, but it was not distinguished from other 3d acquisition system with PSD camera. In this paper, we introduce the 3d data acquisition system using by stereo method with two cameras, show the calibration method of two cameras, and present 3d acquisition methods. we tried to improve the accuracy of 3d data acquisition and implemented the proposed methods. According to the result, we found that the proposed algorithms can boost the accuracy highly against the previous works. The proposed methods are to remove distortion on input images and adjust z axis. We describes the performance in the result.

  • PDF

A Comparison of System Performances Between Rectangular and Polar Exponential Grid Imaging System (POLAR EXPONENTIAL GRID와 장방형격자 영상시스템의 영상분해도 및 영상처리능력 비교)

  • Jae Kwon Eem
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.2
    • /
    • pp.69-79
    • /
    • 1994
  • The conventional machine vision system which has uniform rectangular grid requires tremendous amount of computation for processing and analysing an image especially in 2-D image transfermations such as scaling, rotation and 3-D reconvery problem typical in robot application environment. In this study, the imaging system with nonuiformly distributed image sensors simulating human visual system, referred to as Ploar Exponential Grid(PEG), is compared with the existing conventional uniform rectangular grid system in terms of image resolution and computational complexity. By mimicking the geometric structure of the PEG sensor cell, we obtained PEG-like images using computer simulation. With the images obtained from the simulation, image resolution of the two systems are compared and some basic image processing tasks such as image scaling and rotation are implemented based on the PEG sensor system to examine its performance. Furthermore Fourier transform of PEG image is described and implemented in image analysis point of view. Also, the range and heading-angle measurement errors usually encountered in 3-D coordinates recovery with stereo camera system are claculated based on the PEG sensor system and compared with those obtained from the uniform rectangular grid system. In fact, the PEC imaging system not only reduces the computational requirements but also has scale and rotational invariance property in Fourier spectrum. Hence the PEG system has more suitable image coordinate system for image scaling, rotation, and image recognition problem. The range and heading-angle measurement errors with PEG system are less than those of uniform rectangular rectangular grid system in practical measurement range.

  • PDF

Obstacle Avoidance of Indoor Mobile Robot using RGB-D Image Intensity (RGB-D 이미지 인텐시티를 이용한 실내 모바일 로봇 장애물 회피)

  • Kwon, Ki-Hyeon;Lee, Hyung-Bong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.10
    • /
    • pp.35-42
    • /
    • 2014
  • It is possible to improve the obstacle avoidance capability by training and recognizing the obstacles which is in certain indoor environment. We propose the technique that use underlying intensity value along with intensity map from RGB-D image which is derived from stereo vision Kinect sensor and recognize an obstacle within constant distance. We test and experiment the accuracy and execution time of the pattern recognition algorithms like PCA, ICA, LDA, SVM to show the recognition possibility of it. From the comparison experiment between RGB-D data and intensity data, RGB-D data got 4.2% better accuracy rate than intensity data but intensity data got 29% and 31% faster than RGB-D in terms of training time and intensity data got 70% and 33% faster than RGB-D in terms of testing time for LDA and SVM, respectively. So, LDA, SVM have good accuracy and better training/testing time to use for obstacle avoidance based on intensity dataset of mobile robot.

The research of implementing safety driving system based on camera vision system (Camera Vision 기반 주행안전 시스템 구현에 관한 연구)

  • Park, Hwa-Beom;Kim, Young-Kil
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.9
    • /
    • pp.1088-1095
    • /
    • 2019
  • The information and communication technology that is being developed recently has been greatly influencing the automobile market. In recent years, devices equipped with IT technology have been installed for the safety and convenience of the driver. However, it has the advantage of increased convenience as well as the disadvantage of increasing traffic accidents due to driver's distraction. In order to prevent such accidents, it is necessary to develop safety systems of various types and ways. In this paper implements a platform that can recognize LDWS and FCWS and PDWS by using a single camera without using radar sensor and camera fusion and stereo camera method using two or more sensors, and proposes to study multi-function driving safety platform using a single camera by analyzing recognition rate evaluation and validity on a vehicle.

Estimation of the Dimensions of Horticultural Products and the Mean Plant Height of Plug Seedlings Using Three-Dimensional Images (3차원 영상을 이용한 원예산물의 크기와 플러그묘의 평균초장 추정)

  • Jang, Dong Hwa;Kim, Hyeon Tae;Kim, Yong Hyeon
    • Journal of Bio-Environment Control
    • /
    • v.28 no.4
    • /
    • pp.358-365
    • /
    • 2019
  • This study was conducted to estimate the dimensions of horticultural products and the mean plant height of plug seedlings using three-dimensional (3D) images. Two types of camera, a ToF camera and a stereo-vision camera, were used to acquire 3D images for horticultural products and plug seedlings. The errors calculated from the ToF images for dimensions of horticultural products and mean height of plug seedlings were lower than those predicted from stereo-vision images. A new indicator was defined for determining the mean plant height of plug seedlings. Except for watermelon with tap, the errors of circumference and height of horticultural products were 0.0-3.0% and 0.0-4.7%, respectively. Also, the error of mean plant height for plug seedlings was 0.0-5.5%. The results revealed that 3D images can be utilized to estimate accurately the dimensions of horticultural products and the plant height of plug seedlings. Moreover, our method is potentially applicable for segmenting objects and for removing outliers from the point cloud data based on the 3D images of horticultural crops.

Distinction of Real Face and Photo using Stereo Vision (스테레오비전을 이용한 실물 얼굴과 사진의 구분)

  • Shin, Jin-Seob;Kim, Hyun-Jung;Won, Il-Yong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.7
    • /
    • pp.17-25
    • /
    • 2014
  • In the devices that leave video records, it is an important issue to distinguish whether the input image is a real object or a photo when securing an identifying image. Using a single image and sensor, which is a simple way to distinguish the target from distance measurement has many weaknesses. Thus, this paper proposes a way to distinguish a simple photo and a real object by using stereo images. It is not only measures the distance to the target, but also checks a three-dimensional effect by making the depth map of the face area. They take pictures of the photos and the real faces, and the measured value of the depth map is applied to the learning algorithm. Exactly through iterative learning to distinguish between the real faces and the photos looked for patterns. The usefulness of the proposed algorithm was verified experimentally.