• Title/Summary/Keyword: three dimensional vision

Search Result 220, Processing Time 0.026 seconds

Assessment and Comparison of Three Dimensional Exoscopes for Near-Infrared Fluorescence-Guided Surgery Using Second-Window Indocyanine-Green

  • Cho, Steve S.;Teng, Clare W.;Ravin, Emma De;Singh, Yash B.;Lee, John Y.K.
    • Journal of Korean Neurosurgical Society
    • /
    • v.65 no.4
    • /
    • pp.572-581
    • /
    • 2022
  • Objective : Compared to microscopes, exoscopes have advantages in field-depth, ergonomics, and educational value. Exoscopes are especially well-poised for adaptation into fluorescence-guided surgery (FGS) due to their excitation source, light path, and image processing capabilities. We evaluated the feasibility of near-infrared FGS using a 3-dimensional (3D), 4 K exoscope with near-infrared fluorescence imaging capability. We then compared it to the most sensitive, commercially-available near-infrared exoscope system (3D and 960 p). In-vitro and intraoperative comparisons were performed. Methods : Serial dilutions of indocyanine-green (1-2000 ㎍/mL) were imaged with the 3D, 4 K Olympus Orbeye (system 1) and the 3D, 960 p VisionSense Iridium (system 2). Near-infrared sensitivity was calculated using signal-to-background ratios (SBRs). In addition, three patients with brain tumors were administered indocyanine-green and imaged with system 1, with two also imaged with system 2 for comparison. Results : Systems 1 and 2 detected near-infrared fluorescence from indocyanine green concentrations of >250 ㎍/L and >31.3 ㎍/L, respectively. Intraoperatively, system 1 visualized strong near-infrared fluorescence from two, strongly gadolinium-enhancing meningiomas (SBR=2.4, 1.7). The high-resolution, bright images were sufficient for the surgeon to appreciate the underlying anatomy in the near-infrared mode. However, system 1 was not able to visualize fluorescence from a weakly-enhancing intraparenchymal metastasis. In contrast, system 2 successfully visualized both the meningioma and the metastasis but lacked high resolution stereopsis. Conclusion : Three-dimensional exoscope systems provide an alternative visualization platform for both standard microsurgery and near-infrared fluorescent guided surgery. However, when tumor fluorescence is weak (i.e., low fluorophore uptake, deep tumors), highly sensitive near-infrared visualization systems may be required.

Evaluation of Visual Responses in Viewing a 3D Image (3D 영상 시청 시 시각반응의 평가)

  • Lee, Mu-Hyuk;Son, Jeong-Sik;Kim, Jaedo;Yu, Dong-Sik
    • Journal of Korean Ophthalmic Optics Society
    • /
    • v.17 no.2
    • /
    • pp.165-170
    • /
    • 2012
  • Purpose: The aim of this study was to measure and evaluate changes of visual responses in viewing a 2D and 3D (three-dimensional) image. Methods: The subjects were 44 college students aged 19 to 25 years with normal binocular vision. The visual responses measured were CA/C (convergence accommodation/convergence) ratio, convergence-induced PD(interpupillary distance), accommodative responses, perceived distance in viewing a 3D image. Results: Convergence and accommodative responses in viewing the 3D image were significantly larger (p<0.05) than in 2D. A moderate positive correction was found between CA/C ratio and accommodative response (r = 0.477, p = 0.001). It was indicated that smaller PD had larger depth perception. Convergence in viewing the 3D image was significantly larger (p<0.05) than that at cognitive distance. Conclusions: The visual fatigue may be more intense in larger CA/C ratio and smaller PD when viewing 3D images.

Heuristic Designs of SAD Correlation Algorithm for Vision System (비전 시스템 구현을 위한 SAD 정합 알고리즘의 변형)

  • Yi, Jong-Su;Kim, Jun-Seong
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.47 no.5
    • /
    • pp.61-66
    • /
    • 2010
  • A stereo vision, which is based on two or more images taken from different view points, is able to build three dimensional maps of its environment having various applications including robots and home networks. SAD algorithm, which is based on area-based correlation, is widely used since its regular structure provide abundant parallelism. In this paper, we present heuristic designs of SAD algorithm to meet the demands on accuracy and resource usages in various applications. The disparity abridgement and the window abridgement algorithms can be used for vision systems in low cost and small size. The window shape algorithm can be applicable when object are in specific shapes. The adaptive window algorithm work well when accuracy is the primary concern.

Pose Estimation of an Object from X-ray Images Based on Principal Axis Analysis

  • Roh, Young-Jun;Cho, Hyung-Suck
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.97.4-97
    • /
    • 2002
  • 1. Introduction Pose estimation of a three dimensional object has been studied in robot vision area, and it is needed in a number of industrial applications such as process monitoring and control, assembly and PCB inspection. In this research, we propose a new pose estimation method based on principal axes analysis. Here, it is assumed that the locations of x-ray source and the image plane are predetermined and the object geometry is known. To this end, we define a dispersion matrix of an object, which is a discrete form of inertia matrix of the object. It can be determined here from a set of x-ray images, at least three images are required. Then, the pose information is obtained fro...

  • PDF

3D Augmented Reality Streaming System Based on a Lamina Display

  • Baek, Hogil;Park, Jinwoo;Kim, Youngrok;Park, Sungwoong;Choi, Hee-Jin;Min, Sung-Wook
    • Current Optics and Photonics
    • /
    • v.5 no.1
    • /
    • pp.32-39
    • /
    • 2021
  • We propose a three-dimensional (3D) streaming system based on a lamina display that can convey field information in real-time by creating floating 3D images that can satisfy the accommodation cue. The proposed system is mainly composed of three parts, namely: a 3D vision camera unit to obtain and provide RGB and depth data in real-time, a 3D image engine unit to realize the 3D volume with a fast response time by using the RGB and depth data, and an optical floating unit to bring the implemented 3D image out of the system and consequently increase the sense of presence. Furthermore, we devise the streaming method required for implementing augmented reality (AR) images by using a multilayered image, and the proposed method for implementing AR 3D video in real-time non-face-to-face communication has been experimentally verified.

Estimation of the Dimensions of Horticultural Products and the Mean Plant Height of Plug Seedlings Using Three-Dimensional Images (3차원 영상을 이용한 원예산물의 크기와 플러그묘의 평균초장 추정)

  • Jang, Dong Hwa;Kim, Hyeon Tae;Kim, Yong Hyeon
    • Journal of Bio-Environment Control
    • /
    • v.28 no.4
    • /
    • pp.358-365
    • /
    • 2019
  • This study was conducted to estimate the dimensions of horticultural products and the mean plant height of plug seedlings using three-dimensional (3D) images. Two types of camera, a ToF camera and a stereo-vision camera, were used to acquire 3D images for horticultural products and plug seedlings. The errors calculated from the ToF images for dimensions of horticultural products and mean height of plug seedlings were lower than those predicted from stereo-vision images. A new indicator was defined for determining the mean plant height of plug seedlings. Except for watermelon with tap, the errors of circumference and height of horticultural products were 0.0-3.0% and 0.0-4.7%, respectively. Also, the error of mean plant height for plug seedlings was 0.0-5.5%. The results revealed that 3D images can be utilized to estimate accurately the dimensions of horticultural products and the plant height of plug seedlings. Moreover, our method is potentially applicable for segmenting objects and for removing outliers from the point cloud data based on the 3D images of horticultural crops.

A Vision Based Pallet Measurement Method by Estimating 3D Direction of A Line Parallel to The Ground (지면 평행 직선의 3차원 방향 추정에 의한 비전 기반 파렛트 측정 방법)

  • Kim, Minhwan;Byun, Sungmin
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.10
    • /
    • pp.1229-1235
    • /
    • 2020
  • A line parallel to the ground is frequently shown in our daily life, which enables us to guess its direction. Especially, such a guess tends to become clear when a vanishing line of the ground is shown together. In this paper, a vision based pallet measurement method is suggested, which uses a technique for estimating three-dimensional direction of a line parallel to the ground. The technique computes actually a vector heading to intersection of a given imaged line parallel to the ground and the ground vanishing line determined previously on calibrating a measurement camera. Through an experiment of measuring a real commercial pallet with various orientation and distance, we found that the technique could measure the orientation of the pallet correctly and accurately. The technique worked well even though an edge line available on the front plane of a pallet was almost parallel to the ground vanishing line.

A Study on Visual Servoing Application for Robot OLP Compensation (로봇 OLP 보상을 위한 시각 서보잉 응용에 관한 연구)

  • 김진대;신찬배;이재원
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.21 no.4
    • /
    • pp.95-102
    • /
    • 2004
  • It is necessary to improve the exactness and adaptation of the working environment in the intelligent robot system. The vision sensor have been studied for this reason fur a long time. However, it is very difficult to perform the camera and robot calibrations because the three dimensional reconstruction and many processes are required for the real usages. This paper suggests the image based visual servoing to solve the problem of old calibration technique and supports OLP(Off-Line-Programming) path compensation. Virtual camera can be modeled from the real factors and virtual images obtained from virtual camera gives more easy perception process. Also, Initial path generated from OLP could be compensated by the pixel level acquired from the real and virtual, respectively. Consequently, the proposed visually assisted OLP teaching remove the calibration and reconstruction process in real working space. With a virtual simulation, the better performance is observed and the robot path error is calibrated by the image differences.

전자총 히터(electron gun heater) 자동검사를 위한 머신비젼 알고리즘

  • 김인수;이문규
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.17 no.3
    • /
    • pp.58-67
    • /
    • 2000
  • Electron gun heaters are used to heat a cathode in video(TV) monitors. Major defects of the electron gun heaters include dimensional inaccuracy and pollution with dirty materials. In this paper, to save the labor and time being taken to inspect the heaters, a machine vision system is considered. For the system, a new algorithm is developed to measure the 9 different dimensions of each heater and to detect polluted defects. The algorithm consists of three stages. In the first stage, the center of the heater image is obtained and then its boundary detection is performed. For the efficient boundary detection, a mask called the sum mask is used. In the second stage of the algorithm, a set of fiducial points are determined on the boundary image. Finally, using the fiducial points specified dimensions are measured and the amount of polluted area is computed in the third stage. The performance of the algorithm is evaluated for a set of real specimens. The results indicate that measurements obtained by the algorithm satisfy the tolerance limits fur most of the dimensions and the algorithm detects the polluted defects successfully.

  • PDF

Control of an Underwater Stereo Camera Embedded in a Single Canister Capable of Measuring Distance (거리측정이 가능한 단동형 수중 스테레오 카메라의 제어)

  • 이판묵;전봉환;이종무
    • Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
    • /
    • 2000.10a
    • /
    • pp.90-95
    • /
    • 2000
  • This paper presents the vergence control of a parallel stereo camera and its application to underwater stereo camera to enhance the working efficiency of underwater vehicles that equips with manipulators in seabed operation. The stereo camera consists of two parallel lenses mounted on a lateral moving base and two CCD cameras mounted on a longitudinal moving base, which is embedded in a small pressure canister for underwater application. Because the lateral shift is related to the backward shift with a nonlinear relation, only one control input is needed to control the vergence and focus of the camera with a special driving device. We can get a clear stereo vision with the camera for all the range of objects in air and in water, especially in short range objects. The control system of the camera is so simple that we are able to realize a small stereo camera system and to apply it to a stereo vision system for underwater vehicles. This paper also shows how to acquire the distance information of an underwater object with this stereo camera. Whenever we focus on an underwater object with the camera, we can obtain the three-dimensional images and the distance information in real-time.

  • PDF