• 한국정밀공학회지
• /
• 제23권10호
• /
• pp.22-29
• /
• 2006

This paper considers the lens distortions such as a fisheye distortion and a perspective distortion. While a fisheye lens has a wide field-of-view, it causes a large distortion to the images. Regardless of a fisheye lens or a rectilinear lens, a lens generates perspective distortion in a vertical direction when the lens views in an upward direction or downward direction. These distortions deform images differently from human visual functions. Therefore, this paper presents a method to correct the distortions, and whereby, the research in this paper enlarges choices of images to image processing algorithm that may select the distorted images and the corrected images depending on applications. An infinite polynomial model is employed in the fisheye radial distortion correction, and the vertical perspective distortion correction is done by using a vanishing point. The methods introduced in this paper are implemented on the images captured by a rear-view camera installed on a vehicle and showed their robustness of the correction.

• Journal of the Optical Society of Korea
• /
• 제14권3호
• /
• pp.245-259
• /
• 2010

We have developed mathematically precise image-processing algorithms for extracting panoramic images from fisheye images. Furthermore, we have successfully built a DSP-based panoramic camera employing single fisheye lens.

• Journal of the Optical Society of Korea
• /
• 제14권2호
• /
• pp.109-120
• /
• 2010

We have developed mathematically precise image-processing algorithms for extracting rectilinear images from fisheye images as well as digital pan/tilt/zoom technology. Using this technology, vertical lines always appear as vertical lines in the panned and/or tilted images. Furthermore, polygonal panoramic images composed of multiple rectilinear images have been obtained using the developed digital pan/tilt technology.

• 방송공학회논문지
• /
• 제27권1호
• /
• pp.20-30
• /
• 2022

최근 VR (Virtual Reality) 기술이 주목받기 시작하면서 생동감 넘치는 VR 컨텐츠를 볼 수 있는 360° 파노라마 영상이 많은 관심을 받고 있다. 이미지 스티칭 기술은 360° 파노라마 영상을 제작하는데 주요한 기술로서 많은 연구가 활발하게 이루어지고 있다. 일반적인 스티칭 알고리즘은 특징점 기반 이미지 스티칭을 기반으로 한다. 하지만 기존의 특징점 기반 이미지 스티칭 방법들은 특징점에 크게 영향을 받는다는 문제가 존재한다. 이러한 문제를 해결하기 위해서 최근에는 딥러닝 기반의 이미지 스티칭 기술들이 연구되고 있지만 이미지 간의 겹치는 영역이 거의 없거나 큰 시차가 존재할 때 여전히 많은 문제점이 존재한다. 또한 실제 환경에서는 라벨링 된 정답 파노라마 영상을 얻을 수 없으므로 완전한 지도학습에 한계가 존재한다. 따라서 자율주행분야에 많이 이용되는 칼라(Carla) 시뮬레이터를 통해 카메라 센터가 다른 3개의 fisheye 이미지와 그에 대응되는 정답 영상을 제작하였다. 우리는 제작한 fisheye 영상으로360° 파노라마 영상을 만드는 이미지 스티칭 모델을 제안한다. 최종 실험 결과로는 실제 환경과 비슷하게 구성한 가상의 데이터 세트로 다양한 환경과 큰 시차에도 강인한 스티칭 결과를 검증한다.

• 전자공학회논문지
• /
• 제53권10호
• /
• pp.84-91
• /
• 2016

최근 어라운드 뷰 모니터링 시스템이나 보안 시스템 등에서는 광각 카메라를 이용하여 사용자에게 영상을 제공하고 있다. 광각 카메라로 촬영된 영상은 보다 넓은 범위의 장면을 제공하는 장점이 있으나 영상에 왜곡이 존재하고 특히 영상 외곽 부분은 초점이 맞지 않아 영상의 선명도가 저하되는 단점이 존재한다. 따라서 광각 영상에 대하여 초해상도 기법을 적용할 경우 영상 외곽에서의 블러 영향이 그대로 남아 있어 고해상도 영상의 선명도가 저하되고 아티팩트가 발생하는 등 결과적으로 초해상도 기법의 성능 저하로 이어진다. 따라서 본 논문에서는 자기 유사성 기반의 전처리 기법을 적용하여 영상 외곽부에서의 화질 저하를 개선하고자 한다. 추가로 전체 알고리즘에 대하여 GPU 환경에서의 가속화를 수행하여 알고리즘의 가속성을 확인한다.

• 보존과학회지
• /
• 제37권4호
• /
• pp.312-321
• /
• 2021

Underwater archaeology relies heavily on photography and video image recording during surveillances and excavations like ordinary archaeological studies on land. All underwater images suffer poor image quality and distortions due to poor visibility, low contrast and blur, caused by differences in refractive indices of water and air, properties of selected lenses and shapes of viewports. In the Yellow Sea (between mainland China and the Korean peninsula), the visibility underwater is far less than 1 m, typically in the range of 30 cm to 50 cm, on even a clear day, due to very high turbidity. For photographing 1 m x 1 m grids underwater, a very wide view angle (180°) fisheye lens with an 8 mm focal length is intentionally used despite unwanted severe barrel-shaped image distortion, even with a dome port camera housing. It is very difficult to map wide underwater archaeological excavation sites by combining severely distorted images. Development of practical compensation methods for distorted underwater images acquired through the fisheye lens is strongly desired. In this study, the source of image distortion in underwater photography is investigated. We have identified the source of image distortion as the mismatching, in optical axis and focal points, between dome port housing and fisheye lens. A practical image distortion compensation method, using customized image processing software, was explored and verified using archived underwater excavation images for effectiveness in underwater archaeological applications. To minimize unusable area due to severe distortion after distortion compensation, practical underwater photography guidelines are suggested.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2008년도 하계종합학술대회
• /
• pp.963-964
• /
• 2008

Recently, omni-directional cameras are broadly used due to their wide field of view. Fisheye camera is one of them. This paper proposes the system which uses a fisheye camera for face recognition and analyzes its advantages. Since face images taken with a fisheye camera are affected by perspective distortion and radial distortion, we suggest a two-step method for removing those distortions from the face images.

• 한국멀티미디어학회논문지
• /
• 제22권2호
• /
• pp.128-135
• /
• 2019

This paper presents a deep learning-based object detection method for recognizing vehicles in images acquired through cameras installed on ceiling of underground parking lot. First, we present an image enhancement method, which improves vehicle detection performance under dark lighting environment. Second, we present a new CNN-based multiscale classifiers for detecting vehicles in images acquired through cameras with fisheye lens. Experiments show that the presented vehicle detector has better performance than the conventional ones.

• 한국멀티미디어학회논문지
• /
• 제20권5호
• /
• pp.769-781
• /
• 2017

Deep learning networks like Convolutional Neural Networks (CNNs) show successful performances in many computer vision applications such as image classification, object detection, and so on. For implementation of deep learning networks in embedded system with limited processing power and memory, deep learning network may need to be simplified. However, simplified deep learning network cannot learn every possible scene. One realistic strategy for embedded deep learning network is to construct a simplified deep learning network model optimized for the scene images of the installation place. Then, automatic training will be necessitated for commercialization. In this paper, as an intermediate step toward automatic training under fisheye camera environments, we study more precise human localization in fisheye images, and propose an accurate human localization method, Automatic Ground-Truth Labelling Method (AGTLM). AGTLM first localizes candidate human object bounding boxes by utilizing GoogLeNet-LSTM approach, and after reassurance process by GoogLeNet-based CNN network, finally refines them more correctly and precisely(tightly) by applying saliency object detection technique. The performance improvement of the proposed human localization method, AGTLM with respect to accuracy and tightness is shown through several experiments.

• IEIE Transactions on Smart Processing and Computing
• /
• 제2권6호
• /
• pp.339-344
• /
• 2013

This paper presents an automatic focal length estimation method to correct the fisheye lens distortion in a spatially adaptive manner. The proposed method estimates the focal length of the fisheye lens by generating two reference focal lengths. The distorted fisheye lens image is finally corrected using the orthographic projection model. The experimental results showed that the proposed focal length estimation method is more accurate than existing methods in terms of the loss rate.