• Title/Summary/Keyword: stereo system

Search Result 793, Processing Time 0.021 seconds

A Remote Rehabilitation System using Kinect Stereo Camera (키넥트 스테레오 영상을 이용한 원격 재활 시스템)

  • Kim, Kyungah;Chung, Wan-Young;Kim, Jong-Jin
    • Journal of Sensor Science and Technology
    • /
    • v.25 no.3
    • /
    • pp.196-201
    • /
    • 2016
  • Rehabilitation exercises are the treatments designed to help patients who are in the process of recovery from injury or illness to restore their body functions back to the original status. However, many patients suffering from chronic diseases have found difficulties visiting hospitals for the rehabilitation program due to lack of transportation, cost of the program, their own busy schedules, etc. Also, the program usually contains a few medical check-ups which can cause patients to feel uncomfortable. In this paper, we develop a remote rehabilitation system with bio-signals by a stereo camera. A Kinect stereo camera manufactured by Microsoft corporation was used to recognize the body movement of a patient by using its infrared(IR) camera. Also, we detect the chest area of a user from the skeleton data and process to gain respiratory status. ROI coordinates are created on a user's face to detect photoplethysmography(PPG) signals to calculate heart rate values from its color sensor. Finally, rehabilitation exercises and bio-signal detecting features are combined into a Windows application for the cost effective and high performance remote rehabilitation system.

A Study on the Development of an Center Point Extraction Algorithm of Object Using a Orthogonal Stereo Vision System (직교식 스테레오 비전을 이용한 물체의 중심점 추출 알고리즘 개발에 관한 연구)

  • Lee, Seung-Kyu;Kwak, Sung-Hwan;Lee, Seung-Jae;Kim, Young-Sik;Choi, Joong-Koung;Park, Mu-Hun
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2008.10a
    • /
    • pp.207-212
    • /
    • 2008
  • 최근 공장 자동화가 보편화됨에 따라 무인 운반설비의 자동화 시스템 개발의 한 부분으로써 Stereo Vision 장치를 이용하여 입력된 영상의 에지(Edge)를 추출하고, 추출된 에지를 이용하여 물체의 위치적 특징을 찾고 무인크레인이 이동해야할 위치좌표를 전달한다. 본 연구에서는 실제 산업현장에 가장 보편적인 형상인 판재와 원통을 기준으로 CCD 카메라 2대를 이용하여 물체의 형상을 인식하고, 그 물체의 중심점을 찾는 알고리즘을 제안하였다. 우선 에지를 추출하고 사용자의 선택에 따라 추출된 에지의 특징을 판별하여 판재와 원통을 구분하여 원하는 물체의 위치정보를 찾아낸다. 본 연구는 무인 운반설비의 자동화 시스템 개발에 도움이 될 것으로 기대된다.

  • PDF

Tiled Stereo Display System for Immersive Telemeeting

  • Kim, Ig-Jae;Ahn, Sang-Chul;Kim, Hyoung-Gon
    • Journal of Information Display
    • /
    • v.8 no.4
    • /
    • pp.27-31
    • /
    • 2007
  • In this paper, we present an efficient tiled stereo display system for tangible meeting. For tangible meeting, it is important to provide immersive display with high resolution image to cover up the field of view and provide to the local user the same environment as that of remote site. To achieve these, a high resolution image needs to be transmitted for reconstruction of remote world, and it should be displayed using a tiled display. However, it is hard to transmit high resolution image in real time due to the limit of network bandwidth, and so we receive multiple images and reconstruct a remote world with received images in advance. Then, we update only a specific area where remote user exists by receiving low resolution image in realtime. We synthesize the transmitted image to the existing environmental map of remote world and display it as a stereo image. For this, we developed a new system which supports GPU based real time warping and blending, automatic feature extraction using machine vision technique.

Creepage Distance Measurement Using Binocular Stereo Vision on Hot-line for High Voltage Insulator

  • He, Wenjun;Wang, Jiake;Fu, Yuegang
    • Current Optics and Photonics
    • /
    • v.2 no.4
    • /
    • pp.348-355
    • /
    • 2018
  • How to measure the creepage distance of an insulator quickly and accurately is a problem for the power industry at present, and the noticeable concern is that the high voltage insulation equipment cannot be measured online in the charged state. In view of this situation, we develop an on-line measurement system of creepage distance for high voltage insulators based on binocular stereo vision. We have proposed a method of generating linear structured light using a conical off-axis mirror. The feasibility and effect of two ways to solve the interference problem of strong sunlight have been discussed, one way is to use bandpass filters to enhance the contrast ratio of linear structured light in the images, and the other way is to process the images with adaptive threshold segmentation and feature point extraction. After the system is calibrated, we tested the measurement error of the on-line measurement system with a composite insulator sample. Experimental results show that the maximum relative error is 1.45% and the average relative error is 0.69%, which satisfies the task requirement of not more than 5% of the maximum relative error.

Point Cloud Generation Method Based on Lidar and Stereo Camera for Creating Virtual Space (가상공간 생성을 위한 라이다와 스테레오 카메라 기반 포인트 클라우드 생성 방안)

  • Lim, Yo Han;Jeong, In Hyeok;Lee, San Sung;Hwang, Sung Soo
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.11
    • /
    • pp.1518-1525
    • /
    • 2021
  • Due to the growth of VR industry and rise of digital twin industry, the importance of implementing 3D data same as real space is increasing. However, the fact that it requires expertise personnel and huge amount of time is a problem. In this paper, we propose a system that generates point cloud data with same shape and color as a real space, just by scanning the space. The proposed system integrates 3D geometric information from lidar and color information from stereo camera into one point cloud. Since the number of 3D points generated by lidar is not enough to express a real space with good quality, some of the pixels of 2D image generated by camera are mapped to the correct 3D coordinate to increase the number of points. Additionally, to minimize the capacity, overlapping points are filtered out so that only one point exists in the same 3D coordinates. Finally, 6DoF pose information generated from lidar point cloud is replaced with the one generated from camera image to position the points to a more accurate place. Experimental results show that the proposed system easily and quickly generates point clouds very similar to the scanned space.

Active 3D Shape Acquisition on a Smartphone (스마트폰에서의 능동적 3차원 형상 취득 기법)

  • Won, Jae-Hyun;Yoo, Jin-Woo;Park, In-Kyu
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.27-34
    • /
    • 2011
  • In this paper, we propose an active 3D shape acquisition method based on photometric stereo using camera and flash on a smartphone. Two smartphones are used as the master and slave, in which the slave projects illumination from different locations while the master captures the images and processes photometric stereo algorithm to reconstruct 3D shape. In order to reduce the error, the smartphone's camera is calibrated to overcome the effect of the lens distortion and nonlinear camera sensor response. We apply 5-point algorithm to estimate the pose between smartphone cameras and then estimate lighting direction vector to run the photometric stereo algorithm. Experimental result shows that the proposed system enables us to use smartphone as a 3D camera with low cost and high quality.

Belief propagation stereo matching technique using 2D laser range finder (2차원 레이저 거리측정기를 활용한 신뢰도 전파 스테레오 정합 기법)

  • Kim, Jin-Hyung;Ko, Yun-Ho
    • Journal of Korea Multimedia Society
    • /
    • v.17 no.2
    • /
    • pp.132-142
    • /
    • 2014
  • Stereo camera is drawing attention as an essential sensor for future intelligence robot system since it has the advantage of acquiring not only distance but also other additive information for an object. However, it cannot match correlated point on target image for low textured region or periodic patterned region such as wall of building or room. In this paper, we propose a stereo matching technique that increase the matching performance by fusing belief propagation stereo matching algorithm and local distance measurements of 2D-laser range finder in order to overcome this kind of limitation. The proposed technique adds laser measurements by referring quad-tree based segment information on to the local-evidence of belief propagation stereo matching algorithm, and calculates compatibility function by reflecting over-segmented information. Experimental results of the proposed method using simulation and real test images show that the distance information for some low textured region can be acquired and the discontinuity of depth information is preserved by using segmentation information.

Three Dimensional Vortex Behavior of LEX Delta Wing by Dynamic Stereo PIV (Dynamic Stereo PIV에 의한 델타형 날개에서의 3차원 와류 유동에 관한 연구)

  • Lee Hyun;Kim Mi-Young;Choi Jang-Woon;Choi Min-Seon;Lee Young-Ho
    • 한국가시화정보학회:학술대회논문집
    • /
    • 2003.11a
    • /
    • pp.39-42
    • /
    • 2003
  • Leading edge extension(LEX) in a highly swept shape applied to a delta wing features the modern air-fighters. The LEX vortices generated upon the upper surface of the wing at high angle of attack enhance the lift force of the delta wing by way of increased negative suction pressure over the surfaces. The present 3-D stereo PIV includes the Identification of 2-D cross-correlation equation, stereo matching of 2-D velocity vectors of two cameras, accurate calculation of 3-D velocity vectors by homogeneous coordinate system, removal of error vectors by a statistical method followed by a continuity equation criterion and so on. A delta wing model with or without LEX was immersed in a circulating water channel. Two high-resolution, high-speed digital cameras$(1280pixel\times1024pixel)$ were used to allow the time-resolved animation work. The present dynamic stereo PIV represents the complicated vortex behavior, especially, in terms of time-dependent characteristics of the vortices at given measuring sections. Quantities such as three velocity vector components, vorticity and other flow information can be easily visualized via the 3D time-resolved post-processing to make the easy understanding of the LEX effect or vortex emerging and collapse which are important phenomena occurring in the field of delta wing aerodynamics.

  • PDF

Fuzzy Tracking Control Based on Stereo Images for Tracking of Moving Robot (이동 로봇 추적을 위한 스테레오 영상기반 퍼지 추적제어)

  • Min, Hyun-Hong;Yoo, Dong-Sang;Kim, Yong-Tae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.22 no.2
    • /
    • pp.198-204
    • /
    • 2012
  • Tracking and recognition of robots are required for the cooperation task of robots in various environments. In the paper, a tracking control system of moving robot using stereo image processing, code-book model and fuzzy controller is proposed. First, foreground and background images are separated by using code-book model method. A candidate region is selected based on the color information in the separated foreground image and real distance of the robot is estimated from matching process of depth image that is acquired through stereo image processing. The open and close processing of image are applied and labeling according to the size of mobile robot is used to recognize the moving robot effectively. A fuzzy tracking controller using distance information and mobile information by stereo image processing is designed for effective tracking according to the movement velocity of the target robot. The proposed fuzzy tracking control method is verified through tracking experiments of mobile robots with stereo camera.

A Study on the Unsteady Flow Characteristics of a Delta Wing by 3-D Stereo PIV (3-D Stereo PIV에 의한 비정상 델타윙 유동특성에 대한 연구)

  • Kim, Beom-Seok;Lee, Hyun;Kim, Jeong-Hwan;Lee, Young-Ho
    • Proceedings of the KSME Conference
    • /
    • 2004.04a
    • /
    • pp.1672-1677
    • /
    • 2004
  • Leading edge extension(LEX) in a highly swept shape applied to a delta wing features the modem air-fighters. The LEX vortices generated upon the upper surface of the wing at high angle of attack enhance the lift force of the delta wing by way of increased negative suction pressure over the surfaces. The present 3-D stereo PIV includes the Identification of 2-D cross-correlation equation, stereo matching of 2-D velocity vectors of two cameras, accurate calculation of 3-D velocity vectors by homogeneous coordinate system, removal of error vectors by a statistical method followed by a continuity equation criterion and so on. A delta wing model with or without LEX was immersed in a circulating water channel. Two high-resolution, high-speed digital cameras($1280pixel{\times}1024pixel$) were used to allow the time-resolved animation work. The present dynamic stereo PIV represents the complicated vortex behavior, especially, in terms of time-dependent characteristics of the vortices at given measuring sections. Quantities such as three velocity vector components, vorticity and other flow information can be easily visualized via the 3D time-resolved post-processing to make the easy understanding of the LEX effect or vortex emerging and collapse which are important phenomena occurring in the field of delta wing aerodynamics.

  • PDF