• International Journal of Control, Automation, and Systems
• /
• 제5권6호
• /
• pp.663-673
• /
• 2007

This paper presents a new moving obstacle detection method using an optical flow in mobile robot with an omnidirectional camera. Because an omnidirectional camera consists of a nonlinear mirror and CCD camera, the optical flow pattern in omnidirectional image is different from the pattern in perspective camera. The geometry characteristic of an omnidirectional camera has influence on the optical flow in omnidirectional image. When a mobile robot with an omnidirectional camera moves, the optical flow is not only theoretically calculated in omnidirectional image, but also investigated in omnidirectional and panoramic images. In this paper, the panoramic image is generalized from an omnidirectional image using the geometry of an omnidirectional camera. In particular, Focus of expansion (FOE) and focus of contraction (FOC) vectors are defined from the estimated optical flow in omnidirectional and panoramic images. FOE and FOC vectors are used as reference vectors for the relative evaluation of optical flow. The moving obstacle is turned out through the relative evaluation of optical flows. The proposed algorithm is tested in four motions of a mobile robot including straight forward, left turn, right turn and rotation. The effectiveness of the proposed method is shown by the experimental results.

• 제어로봇시스템학회논문지
• /
• 제18권5호
• /
• pp.479-486
• /
• 2012

In this paper, a ranging system is proposed that is able to measure 360 degree omnidirectional distances to environment objects. The ranging system is based on the structured light imaging system with catadioptric omnidirectional mirror. In order to make the ranging system robust against environmental illumination, efficient structured light image processing algorithms are developed; sequential integration of difference images with modulated structured light and radial search based on Bresenham line drawing algorithm. A dedicated FPGA image processor is developed to speed up the overall image processing. Also the distance equation is derived in the omnidirectional imaging system with a hyperbolic mirror. It is expected that the omnidirectional ranging system is useful for mapping and localization of mobile robot. Experiments are carried out to verify the performance of the proposed ranging system.

• 제어로봇시스템학회논문지
• /
• 제16권8호
• /
• pp.751-755
• /
• 2010

In this paper, we proposed an omnidirectional ranging system that is able to obtain $360^{\circ}$ all directional distances effectively based on structured light image. The omnidirectional ranging system consists of laser structured light source and a catadioptric omnidirectional camera with a curved mirror. The proposed integro-differential structured light image processing algorithm makes the ranging system robust against environmental illumination condition. The omnidirectional ranging system is useful for map-building and self-localization of a mobile robot.

• 제어로봇시스템학회논문지
• /
• 제17권2호
• /
• pp.145-148
• /
• 2011

In this paper, we proposed a search method for structured light pixels of omnidirectional structured light image. Since the omnidirectional structured light image is composed of several circular arc segments, the proposed algorithm searches the structured light pixels in radial direction rather than horizontal or vertical directions. The proposed search algorithm is based on the well-known Bresenham raster algorithm for line drawing in discrete integer space, thereby computation of the algorithm is very efficient. Comparison results between the proposed search algorithm and the conventional horizontal search are presented in experiments.

• 로봇학회논문지
• /
• 제3권2호
• /
• pp.91-98
• /
• 2008

This paper describes the recognition method of moving objects in mobile robot with an omnidirectional camera. The moving object is detected using the specific pattern of an optical flow in omnidirectional image. This paper consists of two parts. In the first part, the pattern of an optical flow is investigated in omnidirectional image. The optical flow in omnidirectional image is influenced on the geometry characteristic of an omnidirectional camera. The pattern of an optical flow is theoretically and experimentally investigated. In the second part, the detection of moving objects is presented from the estimated optical flow. The moving object is extracted through the relative evaluation of optical flows which is derived from the pattern of optical flow. In particular, Focus-Of-Expansion (FOE) and Focus-Of-Contraction (FOC) vectors are defined from the estimated optical flow. They are used as reference vectors for the relative evaluation of optical flows. The proposed algorithm is performed in four motions of a mobile robot such as straight forward, left turn, right turn and rotation. Experimental results using real movie show the effectiveness of the proposed method.

• 대한전기학회논문지:시스템및제어부문D
• /
• 제49권6호
• /
• pp.307-315
• /
• 2000

For the autonomy of a mobile robot it is first needed to know its position and orientation. Various methods of estimating the position of a robot have been developed. However, it is still difficult to localize the robot without any initial position or orientation. In this paper we present the method how to make the colored map and how to calculate the position and direction of a robot using the angle data of an omnidirectional image. The wall of the map is rendered with the corresponding color images and the color histograms of images and the coordinates of feature points are stored in the map. Then a mobile robot gets the color omnidirectional image at arbitrary position and orientation, segments it and recognizes objects by multiple color indexing. Using the information of recognized objects robot can have enough feature points and localize itself.

• 전기전자학회논문지
• /
• 제21권3호
• /
• pp.268-271
• /
• 2017

본 논문에서는 1200만 화소의 고해상도 $360^{\circ}$ 전방위 IP 카메라의 개발을 제안한다. 제안하는 1200만 화소의 고해상도 $360^{\circ}$ 전방위 IP 카메라는 $360^{\circ}$ 전방위 시야각의 렌즈 부와 1200만 화소 고해상도 IP 카메라 부로 구성된다. $360^{\circ}$ 전방위 시야각의 렌즈 부는 등사영 렌즈 설계방식과 catadioptric 면 제작방식을 적용하여 어안 렌즈에서 필연적으로 발생되고 있는 주변부 왜곡현상이 없는 화상을 얻을 수 있도록 한다. 1200만 화소 고해상도 IP 카메라 부는 CMOS 센서 & ISP 부, DSP 부, I/O 부 등으로 구성하여 카메라에 들어온 영상을 디지털 영상으로 변환하여 영상 왜곡 보정, 영상 보정, 영상 압축 등의 기능 등을 수행한 후에, NVR(Network Video Recorder)에 전송한다. 제안된 1200만 화소의 고해상도 $360^{\circ}$ 전방위 IP 카메라의 성능을 평가하기 위하여 외부시험기관에서 실험한 결과, 1200만 화소의 영상효율, $360^{\circ}$ 전방위 렌즈 화각, 전자파 인증 규격 등이 목표값에 적합하게 측정됨이 확인되었다.

• 한국산학기술학회논문지
• /
• 제16권6호
• /
• pp.4108-4114
• /
• 2015

광학 반사체를 이용하여 카메라 영상을 얻는 방법을 catadioptric 영상법이라고 부른다. Catadioptric 영상법은 360도 모든 방향의 시각정보를 한 장의 영상면에 담기 위한 전방향 영상 획득시스템에 많이 사용된다. 대표적인 전방향 광학 반사체로서 그릇 모양의 3차원 쌍곡면형 거울이 있다. 본 논문에서는 쌍곡면형 반사체를 이용한 catadioptric 전방향 영상 시스템에 간단히 오목 렌즈를 추가함으로써 하나의 카메라로 시점이 다른 전방향 스테레오 영상을 얻는 방법에 관해 연구하였다. 시점이 다른 전방향 스테레오 영상 정합을 통해 대상 물체의 3차원 좌표를 복원할 수 있다. 본 전방향 스테레오 영상 시스템은 한 대의 카메라를 사용하므로 경제적이며, 스테레오 영상간에 카메라 내재 매개변수가 같으므로 정합이 쉽다는 장점이 있다. 본 논문에서는 3차원 좌표값 측정에 필요한 매개변수들을 3 단계 캘리브레이션을 이용하여 추출하였고, 실험을 통해 전방향 3차원 거리측정 성능을 검증하였다. 또한 거리측정 정밀도를 분석하여 본 스테레오 영상 시스템의 신뢰할 만한 측정범위를 제시하였다.

• 한국정밀공학회지
• /
• 제31권3호
• /
• pp.261-268
• /
• 2014

Precision screws have a wide range of industrial applications such as electrical and automotive products. To produce screw threads with high precision, not only high precision manufacturing technology but also reliable measurement technology is required. Machine vision systems have been used in the automatic inspection of screw threads based on backlight illumination, which cannot detect defects on the thread surface. Recently, an omnidirectional inspection system for screw threads was developed to obtain $360^{\circ}$ images of screws, based on front light illumination. In this study, the illumination design for the omnidirectional inspection system was modified by adding a light shield to improve the image uniformity. Optical simulation for various shield designs was performed to analyze image uniformity of the obtained images. The simulation results were analyzed statistically using response surface method, from which optical performance of the omnidirectional inspection system could be optimized in terms of image quality and uniformity.

• 제어로봇시스템학회논문지
• /
• 제15권4호
• /
• pp.400-405
• /
• 2009

A new method for the catadioptric omnidirectional stereo vision with single camera is presented in this paper. The proposed method uses a concave lens with a convex mirror. Since the optical part of the proposed method is simple and commercially available, the resultant omnidirectional stereo system becomes versatile and cost-effective. The closed-form solution for 3D distance computation is presented based on the simple optics including the reflection and the reflection of the convex mirror and the concave lens. The compactness of the system and the simplicity of the image processing make the omnidirectional stereo system appropriate for real-time applications such as autonomous navigation of a mobile robot or the object manipulation. In order to verify the feasibility of the proposed method, an experimental prototype is implemented.