• Title/Summary/Keyword: Stereo Vision System

Search Result 304, Processing Time 0.029 seconds

Vision-based Human-Robot Motion Transfer in Tangible Meeting Space (실감만남 공간에서의 비전 센서 기반의 사람-로봇간 운동 정보 전달에 관한 연구)

  • Choi, Yu-Kyung;Ra, Syun-Kwon;Kim, Soo-Whan;Kim, Chang-Hwan;Park, Sung-Kee
    • The Journal of Korea Robotics Society
    • /
    • v.2 no.2
    • /
    • pp.143-151
    • /
    • 2007
  • This paper deals with a tangible interface system that introduces robot as remote avatar. It is focused on a new method which makes a robot imitate human arm motions captured from a remote space. Our method is functionally divided into two parts: capturing human motion and adapting it to robot. In the capturing part, we especially propose a modified potential function of metaballs for the real-time performance and high accuracy. In the adapting part, we suggest a geometric scaling method for solving the structural difference between a human and a robot. With our method, we have implemented a tangible interface and showed its speed and accuracy test.

  • PDF

Hand Gesture Recognition for Understanding Conducting Action (지휘행동 이해를 위한 손동작 인식)

  • Je, Hong-Mo;Kim, Ji-Man;Kim, Dai-Jin
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2007.10c
    • /
    • pp.263-266
    • /
    • 2007
  • We introduce a vision-based hand gesture recognition fer understanding musical time and patterns without extra special devices. We suggest a simple and reliable vision-based hand gesture recognition having two features First, the motion-direction code is proposed, which is a quantized code for motion directions. Second, the conducting feature point (CFP) where the point of sudden motion changes is also proposed. The proposed hand gesture recognition system extracts the human hand region by segmenting the depth information generated by stereo matching of image sequences. And then, it follows the motion of the center of the gravity(COG) of the extracted hand region and generates the gesture features such as CFP and the direction-code finally, we obtain the current timing pattern of beat and tempo of the playing music. The experimental results on the test data set show that the musical time pattern and tempo recognition rate is over 86.42% for the motion histogram matching, and 79.75% fer the CFP tracking only.

  • PDF

The research of implementing safety driving system based on camera vision system (Camera Vision 기반 주행안전 시스템 구현에 관한 연구)

  • Park, Hwa-Beom;Kim, Young-Kil
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.9
    • /
    • pp.1088-1095
    • /
    • 2019
  • The information and communication technology that is being developed recently has been greatly influencing the automobile market. In recent years, devices equipped with IT technology have been installed for the safety and convenience of the driver. However, it has the advantage of increased convenience as well as the disadvantage of increasing traffic accidents due to driver's distraction. In order to prevent such accidents, it is necessary to develop safety systems of various types and ways. In this paper implements a platform that can recognize LDWS and FCWS and PDWS by using a single camera without using radar sensor and camera fusion and stereo camera method using two or more sensors, and proposes to study multi-function driving safety platform using a single camera by analyzing recognition rate evaluation and validity on a vehicle.

An Image Processing System for the Harvesting robot$^{1)}$ (포도수확용 로봇 개발을 위한 영상처리시스템)

  • Lee, Dae-Weon;Kim, Dong-Woo;Kim, Hyun-Tae;Lee, Yong-Kuk;Si-Heung
    • Journal of Bio-Environment Control
    • /
    • v.10 no.3
    • /
    • pp.172-180
    • /
    • 2001
  • A grape fruit is required for a lot of labor to harvest in time in Korea, since the fruit is cut and grabbed currently by hand. In foreign country, especially France, a grape harvester has been developed for processing to make wine out of a grape, not to eat a fresh grape fruit. However, a harvester which harvests to eat a fresh grape fruit has not been developed yet. Therefore, this study was designed and constructed to develope a image processing system for a fresh grape harvester. Its development involved the integration of a vision system along with an personal computer and two cameras. Grape recognition, which was able to found the accurate cutting position in three dimension by the end-effector, needed to find out the object from the background by using two different images from two cameras. Based on the results of this research the following conclusions were made: The model grape was located and measured within less than 1,100 mm from camera center, which means center between two cameras. The distance error of the calculated distance had the distance error within 5mm by using model image in the laboratory. The image processing system proved to be a reliable system for measuring the accurate distance between the camera center and the grape fruit. Also, difference between actual distance and calculated distance was found within 5 mm using stereo vision system in the field. Therefore, the image processing system would be mounted on a grape harvester to be founded to the position of the a grape fruit.

  • PDF

Calibration and INvestigation into Measurement Performance of a Visual Sensing System (시각측정시스템의 캘리브레이션 및 측정성능 검토)

  • Kim, Jin-Young;Cho, Hyung-Suck
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.16 no.8
    • /
    • pp.113-121
    • /
    • 1999
  • It is necessary to calibrate measurement systems to enhance its measurement accuracy. The visual sensing system that is presented in our previous work has to be calibrated, too. It is a multiple mirror system for three-dimensional measurement, which is composed of a camera and a series of mirrors. It is important to calibrate the positions and orientations of the mirrors relative to the camera because they have direct influence on the relationship between the image plane and the task space. This paper presents the calibration method for the visual sensing system. To confirm the measurement performance of the implemented system. its measurement accuracy in measuring the locations in three-dimensional space is investigated. A series of experiments for measuring the locations of the circle-shaped marks are performed. Experimental results show that the sensing system can be effectively used for three-dimensional measurement.

  • PDF

Design and Verification of 3D Digital Image Correlation Systems for Measurement of Large Object Displacement Using Stereo Camera (대면적 대상물 변위계측을 위한 스테레오 카메라 3차원 DIC 시스템 기초설계 및 검증에 관한 연구)

  • Ko, Younghun;Seo, Seunghwan;Lim, Hyunsung;Jin, Tailie;Chung, Moonkyung
    • Explosives and Blasting
    • /
    • v.38 no.2
    • /
    • pp.1-12
    • /
    • 2020
  • Digital Image Correlation is a well-established method for displacements, strains and shape measurements of engineering objects. Stereo-camera 3D Digital Image Correlation (3D-DIC) systems have been developed to match the specific requirements for measurements posed by material and mechanical industries. Although DIC method provides the capabilities of scaling a field-of-view(FOV), dimensions of Geotechnical structure objects in many cases are too big to be measured with DIC based on a single camera pair. It can be the most important issue with applying 3D DIC to the measurement of Geotechnical structures. In this paper, We were present stereo vision conditions in a 3D DIC system that can be measured for large FOV(30×20m) and high precisions(z-displacement 0.5mm) of the ground objects with Stereo-camera DIC systems.

A hardware architecture based on the NCC algorithm for fast disparity estimation in 3D shape measurement systems (고밀도 3D 형상 계측 시스템에서의 고속 시차 추정을 위한 NCC 알고리즘 기반 하드웨어 구조)

  • Bae, Kyeong-Ryeol;Kwon, Soon;Lee, Yong-Hwan;Lee, Jong-Hun;Moon, Byung-In
    • Journal of Sensor Science and Technology
    • /
    • v.19 no.2
    • /
    • pp.99-111
    • /
    • 2010
  • This paper proposes an efficient hardware architecture to estimate disparities between 2D images for generating 3D depth images in a stereo vision system. Stereo matching methods are classified into global and local methods. The local matching method uses the cost functions based on pixel windows such as SAD(sum of absolute difference), SSD(sum of squared difference) and NCC(normalized cross correlation). The NCC-based cost function is less susceptible to differences in noise and lighting condition between left and right images than the subtraction-based functions such as SAD and SSD, and for this reason, the NCC is preferred to the other functions. However, software-based implementations are not adequate for the NCC-based real-time stereo matching, due to its numerous complex operations. Therefore, we propose a fast pipelined hardware architecture suitable for real-time operations of the NCC function. By adopting a block-based box-filtering scheme to perform NCC operations in parallel, the proposed architecture improves processing speed compared with the previous researches. In this architecture, it takes almost the same number of cycles to process all the pixels, irrespective of the window size. Also, the simulation results show that its disparity estimation has low error rate.

A Study on a Stereoscopic Display System Using a Rotary Disk Type Beam Shutter (회전 디스크형 빔 셔터를 이용한 입체영상 디스플레이 시스템에 관한 연구)

  • Lee, Kwang-Hyung;Jang, Tae-Jeong
    • Proceedings of the KIEE Conference
    • /
    • 2006.10c
    • /
    • pp.196-198
    • /
    • 2006
  • In this paper, a stereoscopic display system using a rotary disk tyre beam shutter and two beam projectors is proposed. It is a kind of active stereoscopic display and can be easily converted from passive stereoscopic system using polarizing filters. If it is possible to synchronize the revolution speed of the beam shutter with the integer multiple of the scanning frequency of the beam projectors, we can obtain a comparable performance with our system to an active stereoscopic system using one expensive high performance beam projector. Further, if we rotate the beam shutter at sufficiently high revolution speed, our active stereoscopic system works regardless of synchronization and thus the system is much easier to implement.

  • PDF

A Study on a Stereoscopic Display System Using a Rotary Disk Type Beam Shutter (회전 디스크형 빔 셔터를 이용한 입체영상 디스플레이 시스템에 관한 연구)

  • Lee, Kwang-Hyung;Jang, Tae-Jeong
    • 한국HCI학회:학술대회논문집
    • /
    • 2007.02a
    • /
    • pp.739-743
    • /
    • 2007
  • In this paper, a stereoscopic display system using a rotary disk type beam shutter and two beam projectors is proposed. It is a kind of active stereoscopic display and can be easily converted from passive stereoscopic system using polarizing filters. If it is possible to synchronize the revolution speed of the beam shutter with the integer multiple of the scanning frequency of the beam projectors, we can obtain a comparable performance with our system to an active stereoscopic system using one expensive high performance beam projector. Further, if we rotate the beam shutter at sufficiently high revolution speed, our active stereoscopic system works regardless of synchronization and thus the system is much easier to implement.

  • PDF

Hand/Eye calibration of Robot arms with a 3D visual sensing system (3차원 시각 센서를 탑재한로봇의 Hand/Eye 캘리브레이션)

  • 김민영;노영준;조형석;김재훈
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.76-76
    • /
    • 2000
  • The calibration of the robot system with a visual sensor consists of robot, hand-to-eye, and sensor calibration. This paper describe a new technique for computing 3D position and orientation of a 3D sensor system relative to the end effect of a robot manipulator in an eye-on-hand robot configuration. When the 3D coordinates of the feature points at each robot movement and the relative robot motion between two robot movements are known, a homogeneous equation of the form AX : XB is derived. To solve for X uniquely, it is necessary to make two robot arm movements and form a system of two equation of the form: A$_1$X : XB$_1$ and A$_2$X = XB$_2$. A closed-form solution to this system of equations is developed and the constraints for solution existence are described in detail. Test results through a series of simulation show that this technique is simple, efficient, and accurate fur hand/eye calibration.

  • PDF