• Title/Summary/Keyword: 3d camera

Search Result 1,632, Processing Time 0.04 seconds

A Study on Intelligent Robot Bin-Picking System with CCD Camera and Laser Sensor (CCD카메라와 레이저 센서를 조합한 지능형 로봇 빈-피킹에 관한 연구)

  • Kim, Jin-Dae;Lee, Jeh-Won;Shin, Chan-Bai
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.23 no.11 s.188
    • /
    • pp.58-67
    • /
    • 2006
  • Due to the variety of signal processing and complicated mathematical analysis, it is not easy to accomplish 3D bin-picking with non-contact sensor. To solve this difficulties the reliable signal processing algorithm and a good sensing device has been recommended. In this research, 3D laser scanner and CCD camera is applied as a sensing device respectively. With these sensor we develop a two-step bin-picking method and reliable algorithm for the recognition of 3D bin object. In the proposed bin-picking, the problem is reduced to 2D intial recognition with CCD camera at first, and then 3D pose detection with a laser scanner. To get a good movement in the robot base frame, the hand eye calibration between robot's end effector and sensing device should be also carried out. In this paper, we examine auto-calibration technique in the sensor calibration step. A new thinning algorithm and constrained hough transform is also studied for the robustness in the real environment usage. From the experimental results, we could see the robust bin-picking operation under the non-aligned 3D hole object.

Development of a Serious Game for Rehabilitation Training using 3D Depth Camera (3D depth 카메라를 이용한 재활훈련 기능성 게임 개발)

  • Kang, Sun-Kyung;Jung, Sung-Tae
    • Journal of Korea Game Society
    • /
    • v.13 no.1
    • /
    • pp.19-30
    • /
    • 2013
  • This paper proposes a serious game for rehabilitation training targeting old persons and patients for rehabilitation. The serious game suggested for rehabilitation training provides the whole body movement recognition-based interface using the 3D depth camera. When the user stands before the camera, it distinguishes the user from the background and then recognizes the user's whole body with 15 joints. By analyzing the changes of location and direction of each joint, it recognizes gestures needed for the game. The game contents consist of the games for upper limb training, lower limb training, whole body training, and balance training, and it was realized in both 2D and 3D games. The system suggested in this article works robustly even with the environmental changes using the 3D depth camera. Even with no separate device, the game recognizes the gestures only using the whole body movement, and this enhances the effect of rehabilitation.

A Kinematics Approach to 3D Graphical Interface (3D 그래픽스 인터페이스에 대한 운동학적 접근)

  • Lee, Joo-Haeng;Jang, Tae-Ik;Kim, Myung-Soo;Kim, Mansoo;Chong, Kyung Taek;Lee, Ee Taek
    • Journal of the Korea Computer Graphics Society
    • /
    • v.2 no.2
    • /
    • pp.53-60
    • /
    • 1996
  • In 3D graphics interface, 3D objects and virtual camera have many degrees of freedom. We interpret the control of 3D objects and virtual camera as a problem of kinematics and inverse kinematics. It is well known that extra degrees of freedom introduce various singularities in inverse kinematics. In this paper, we approach 3D graphics interface problems by reducing redundant degrees of freedom so that the control degrees of freedom matches with the degrees of freedom in the motions of 3D objects and virtual camera.

  • PDF

Construction of Multi-Dimensional Ortho-Images with a Digital Camera and the Multi-Image Connection Method (디지털카메라와 다중영상접합법을 이용한 다차원 정사영상의 구축)

  • Kim, Dong Moon
    • Journal of Digital Convergence
    • /
    • v.12 no.8
    • /
    • pp.295-302
    • /
    • 2014
  • Essential to the establishment of such 3D spatial information are the laser scanning technology to obtain high-precision 3D point group data and the photography-metric camera to obtain high-resolution multispectral image information. The photography-metric camera, however, lacks in usability for its broad scope of utilization due to the high purchase price, difficult purchase channel, and low applicability. This study thus set out to investigate a technique to establish multi-dimensional ortho-image data with a single lens reflex digital camera of high speed and easy accessibility for general users. That is, the study remodeled a single lens reflex digital camera and calibrated the remodeled camera to establish 3D multispectral image information, which is the essential data of 3D spatial information. Multi-dimensional ortho-image data were collected by surveying the reference points for stereo photos, taking multispectral shots of the objects, and converting them into ortho-images.

3D Environment Perception using Stereo Infrared Light Sources and a Camera (스테레오 적외선 조명 및 단일카메라를 이용한 3차원 환경인지)

  • Lee, Soo-Yong;Song, Jae-Bok
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.15 no.5
    • /
    • pp.519-524
    • /
    • 2009
  • This paper describes a new sensor system for 3D environment perception using stereo structured infrared light sources and a camera. Environment and obstacle sensing is the key issue for mobile robot localization and navigation. Laser scanners and infrared scanners cover $180^{\circ}$ and are accurate but too expensive. Those sensors use rotating light beams so that the range measurements are constrained on a plane. 3D measurements are much more useful in many ways for obstacle detection, map building and localization. Stereo vision is very common way of getting the depth information of 3D environment. However, it requires that the correspondence should be clearly identified and it also heavily depends on the light condition of the environment. Instead of using stereo camera, monocular camera and two projected infrared light sources are used in order to reduce the effects of the ambient light while getting 3D depth map. Modeling of the projected light pattern enabled precise estimation of the range. Two successive captures of the image with left and right infrared light projection provide several benefits, which include wider area of depth measurement, higher spatial resolution and the visibility perception.

Microsoft Kinect-based Indoor Building Information Model Acquisition (Kinect(RGB-Depth Camera)를 활용한 실내 공간 정보 모델(BIM) 획득)

  • Kim, Junhee;Yoo, Sae-Woung;Min, Kyung-Won
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.31 no.4
    • /
    • pp.207-213
    • /
    • 2018
  • This paper investigates applicability of Microsoft $Kinect^{(R)}$, RGB-depth camera, to implement a 3D image and spatial information for sensing a target. The relationship between the image of the Kinect camera and the pixel coordinate system is formulated. The calibration of the camera provides the depth and RGB information of the target. The intrinsic parameters are calculated through a checker board experiment and focal length, principal point, and distortion coefficient are obtained. The extrinsic parameters regarding the relationship between the two Kinect cameras consist of rotational matrix and translational vector. The spatial images of 2D projection space are converted to a 3D images, resulting on spatial information on the basis of the depth and RGB information. The measurement is verified through comparison with the length and location of the 2D images of the target structure.

Development of Merging Algorithm between 3-D Objects and Real Image for Augmented Reality

  • Kang, Dong-Joong
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.100.5-100
    • /
    • 2002
  • A core technology for implementation of Augmented Reality is to develop a merging algorithm between interesting 3-D objects and real images. In this paper, we present a 3-D object recognition method to decide viewing direction toward the object from camera. This process is the starting point to merge with real image and 3-D objects. Perspective projection between a camera and 3-dimentional objects defines a plane in 3-D space that is from a line in an image and the focal point of the camera. If no errors with perfect 3-D models were introduced in during image feature extraction, then model lines in 3-D space projecting onto this line in the image would exactly lie in this plane. This observa...

  • PDF

3D Reconstruction Using Multi-Camera (다수 카메라를 이용한 3차원 복원)

  • Kim, Young-Su;Park, Sung-Chan;Jeong, Hong
    • Proceedings of the IEEK Conference
    • /
    • 2006.06a
    • /
    • pp.451-452
    • /
    • 2006
  • In this paper, we present a 3D reconstruction method using multi-camera. This method is very compact algorithm so that can be implemented easily on small hardware architecture. By using multi-camera, it gives exacter result than existing method and we propose accurate index for each matching nodes to use multi-camera.

  • PDF

Open Standard Based 3D Urban Visualization and Video Fusion

  • Enkhbaatar, Lkhagva;Kim, Seong-Sam;Sohn, Hong-Gyoo
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.28 no.4
    • /
    • pp.403-411
    • /
    • 2010
  • This research demonstrates a 3D virtual visualization of urban environment and video fusion for effective damage prevention and surveillance system using open standard. We present the visualization and interaction simulation method to increase the situational awareness and optimize the realization of environmental monitoring through the CCTV video and 3D virtual environment. New camera prototype was designed based on the camera frustum view model to project recorded video prospectively onto the virtual 3D environment. The demonstration was developed by the X3D, which is royalty-free open standard and run-time architecture, and it offers abilities to represent, control and share 3D spatial information via the internet browsers.

Robot System Design Capable of Motion Recognition and Tracking the Operator's Motion (사용자의 동작인식 및 모사를 구현하는 로봇시스템 설계)

  • Choi, Yonguk;Yoon, Sanghyun;Kim, Junsik;Ahn, YoungSeok;Kim, Dong Hwan
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.24 no.6
    • /
    • pp.605-612
    • /
    • 2015
  • Three dimensional (3D) position determination and motion recognition using a 3D depth sensor camera are applied to a developed penguin-shaped robot, and its validity and closeness are investigated. The robot is equipped with an Asus Xtion Pro Live as a 3D depth camera, and a sound module. Using the skeleton information from the motion recognition data extracted from the camera, the robot is controlled so as to follow the typical three mode-reactions formed by the operator's gestures. In this study, the extraction of skeleton joint information using the 3D depth camera is introduced, and the tracking performance of the operator's motions is explained.