• Title/Summary/Keyword: Real-time stereo

Search Result 246, Processing Time 0.021 seconds

GPU-Based Optimization of Self-Organizing Map Feature Matching for Real-Time Stereo Vision

  • Sharma, Kajal;Saifullah, Saifullah;Moon, Inkyu
    • Journal of information and communication convergence engineering
    • /
    • v.12 no.2
    • /
    • pp.128-134
    • /
    • 2014
  • In this paper, we present a graphics processing unit (GPU)-based matching technique for the purpose of fast feature matching between different images. The scale invariant feature transform algorithm developed by Lowe for various feature matching applications, such as stereo vision and object recognition, is computationally intensive. To address this problem, we propose a matching technique optimized for GPUs to perform computations in less time. We optimize GPUs for fast computation of keypoints to make our system quick and efficient. The proposed method uses a self-organizing map feature matching technique to perform efficient matching between the different images. The experiments are performed on various image sets to examine the performance of the system under varying conditions, such as image rotation, scaling, and blurring. The experimental results show that the proposed algorithm outperforms the existing feature matching methods, resulting in fast feature matching due to the optimization of the GPU.

Stereo Vision based Human Detection using SVM (SVM을 이용한 스테레오 비전 기반의 사람 탐지)

  • Jung, Sang-Jun;Song, Jae-Bok
    • Proceedings of the KIEE Conference
    • /
    • 2007.10a
    • /
    • pp.117-118
    • /
    • 2007
  • A robot needs a human detection algorithm for interaction with a human. This paper proposes a method that finds people using a SVM (support vector machine) classifier and a stereo camera. Feature vectors of SVM are extracted by HoG (histogram of gradient) within images. After training extracted vectors from the clustered images, the SVM algorithm creates a classifier for human detection. Each candidate for a human in the image is generated by clustering of depth information from a stereo camera and the candidate is evaluated by the classifier. When compared with the existing method of creating candidates for a human, clustering reduces computational time. The experimental results demonstrate that the proposed approach can be executed in real time.

  • PDF

Point Cloud Generation Method Based on Lidar and Stereo Camera for Creating Virtual Space (가상공간 생성을 위한 라이다와 스테레오 카메라 기반 포인트 클라우드 생성 방안)

  • Lim, Yo Han;Jeong, In Hyeok;Lee, San Sung;Hwang, Sung Soo
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.11
    • /
    • pp.1518-1525
    • /
    • 2021
  • Due to the growth of VR industry and rise of digital twin industry, the importance of implementing 3D data same as real space is increasing. However, the fact that it requires expertise personnel and huge amount of time is a problem. In this paper, we propose a system that generates point cloud data with same shape and color as a real space, just by scanning the space. The proposed system integrates 3D geometric information from lidar and color information from stereo camera into one point cloud. Since the number of 3D points generated by lidar is not enough to express a real space with good quality, some of the pixels of 2D image generated by camera are mapped to the correct 3D coordinate to increase the number of points. Additionally, to minimize the capacity, overlapping points are filtered out so that only one point exists in the same 3D coordinates. Finally, 6DoF pose information generated from lidar point cloud is replaced with the one generated from camera image to position the points to a more accurate place. Experimental results show that the proposed system easily and quickly generates point clouds very similar to the scanned space.

A study on pointing device system using stereo vision (스테레오 비전을 이용한 포인팅 디바이스에 관한 연구)

  • Han, Seung-Il;Hwang, Yong-Hyun;Lee, Byung-Gook;Lee, Joon-Jae
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.10 no.2
    • /
    • pp.67-80
    • /
    • 2006
  • In this paper, we propose a new pointing device that is replaced a mouse as the pointing device with. For reducing the existing pointing device's problem which had marker and high-cost, we develop a new pointing device using computer vision like as a similar human vision system. The proposed system first carries out a real-time movement tracking system using image data which are segmented by color modeling, and finally does the pointing action by 3-D coordinate calculated from stereo geometry information resulting from stereo matching of the segmented region.

  • PDF

Depth and Distance Information from Stereo Vision Using Sum of Absolute Differences Algorithm

  • Hai, Le Thanh;Cho, S.H.;Choi, S.;Hwang, H.
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • v.11 no.2
    • /
    • pp.447-453
    • /
    • 2006
  • This paper presents an area-based stereo algorithm suitable to real time applications. The core of the algorithm depends on the uniqueness constraint and on a matching process that allows for rejecting previous matches. The proposed approach is compared with the left right consistency constraint, being the latter the basic method for detecting unreliable matches in many area-based stereo algorithms. We used the watermelon and tomatoes for experiments.

  • PDF

Linear Visual Feedback Conrtol using Binocular Visual Space (양안 시공간을 이용한 Linear Visual Feedback Control)

  • Lim, Seung-Woo;Park, Chang-Kyun
    • The Journal of the Acoustical Society of Korea
    • /
    • v.14 no.6
    • /
    • pp.74-79
    • /
    • 1995
  • This paper proposes the stereo LVFC-Robot which Imitates eyes and arms of man. we derived linear approximation equation between visual space and joint space by minimum square method and then applied it to the proposed stereo LVFC-Robot. As a result of a simulation, its efficency is verified. Compared with the stereo VFC, the stereo LVFC Robot don't need the Image Jacobian and the Robot Jacobian. Thus it is possible to control Robot in real time.

  • PDF

Convergence Control of Moving Object using Opto-Digital Algorithm in the 3D Robot Vision System

  • Ko, Jung-Hwan;Kim, Eun-Soo
    • Journal of Information Display
    • /
    • v.3 no.2
    • /
    • pp.19-25
    • /
    • 2002
  • In this paper, a new target extraction algorithm is proposed, in which the coordinates of target are obtained adaptively by using the difference image information and the optical BPEJTC(binary phase extraction joint transform correlator) with which the target object can be segmented from the input image and background noises are removed in the stereo vision system. First, the proposed algorithm extracts the target object by removing the background noises through the difference image information of the sequential left images and then controlls the pan/tilt and convergence angle of the stereo camera by using the coordinates of the target position obtained from the optical BPEJTC between the extracted target image and the input image. From some experimental results, it is found that the proposed algorithm can extract the target object from the input image with background noises and then, effectively track the target object in real time. Finally, a possibility of implementation of the adaptive stereo object tracking system by using the proposed algorithm is also suggested.

A Design and Implementation of Remote Monitoring and Control Environments Using 3-Dimensional Camera Multimedia System Based on RTLinux (RTLinux기반의 3차원 입체 카메라 멀티미디어 시스템을 이용한 원격 감시 및 제어 환경 설계 및 구현)

  • Lee Jeong-Bae;Choi Gil-Lim;Kim Tae-Gyun;Kim Sam-Ryong
    • Journal of Korea Multimedia Society
    • /
    • v.7 no.10
    • /
    • pp.1412-1420
    • /
    • 2004
  • This thesis is dealing with conveyer remote monitoring and control system for shoes process formed by client/server, which is based on Web. Modules for watching and controlling images in a remote by client is manufactured under JAVA, and conveyer server for real-time controlling is founded on RTLinux. And device driver and APIs are developed based on it. Through both manufacturing these software and LEGO-based prototyping, it would present the real-time conveyer controlling system founded on Web and 3-dimensional stereo camera to be applied to industrial spots.

  • PDF

Implementation of Real-time Stereo Frequency Demodulator Using RTL-SDR (RTL-SDR을 이용한 스테레오 주파수 변조 방송의 실시간 수신기 구현)

  • Kim, Young-Ju
    • Journal of Broadcast Engineering
    • /
    • v.24 no.3
    • /
    • pp.485-494
    • /
    • 2019
  • A software-driven real-time frequency de-modulator is implemented with the aid of universal-serial-bus (USB) type software defined radio dongle. An analog stereo frequency modulation (FM) broadcast signal is down-converted to the basedband analog signal then converted to digital bit streams in the USB dongle. Computer software such as Matlab, Python, and GNU Radio manipulates the incoming bit streams with the technique of digital signal processing. Low pass filtering, band pass filtering, decimation, frequency discriminator, double sideband amplitude demodulation, phase locked loop, and deemphasis function blocks are implemented using such computer languages. Especially, GNU Radion is employed to realize the real-time demodulator.

DETAILS OF PRACTICAL IMPLEMENTATION OF REAL-TIME 3D TERRAIN MODELING

  • Young Suk Kim;Seungwoo Han;Hyun-Seok Yoo;Heung-Soon Lim;Jeong-Hoon Lee;Kyung-Seok Lee
    • International conference on construction engineering and project management
    • /
    • 2009.05a
    • /
    • pp.487-492
    • /
    • 2009
  • A large-scaled research project titled "Intelligent Excavating System (IES)" sponsored by Korean government has launched in 2006. An issue of real-time 3D terrain modeling has become a crucial point for successful implementation of IES due to many application limitations of state-of-the-art techniques developed in various high-technology fields. Many feasible technologies such as laser scanning, structured lighting and so on were widely reviewed by professionals and researchers for one year. Various efforts such as literature reviews, interviews, and indoor experiments make us select a structural light technique and stereo vision technique as appropriate techniques for accomplishment of real-time 3D terrain modeling. It, however, revealed that off-the-shelf products of structural light and stereo-vision technique had many technical problems which should be resolved for practical applications in IES. This study introduces diverse methods modifying off-the-shelf package of the structural light method, one of feasible techniques and eventually allowing this technique to be successfully utilized for achieving fundamental research goals. This study also presents many efforts to resolve practical difficulties of this technique considering basic characteristics of excavating operations and particular environment of construction sites. Findings showed in this study would be beneficial for other researchers to conduct new researches for application of vision techniques to construction fields by provision of detail issues about practical application and diverse practical methods as solutions overcoming these issues.

  • PDF