• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.6
• /
• pp.2044-2059
• /
• 2022

Recent works have shown that the geometric constraint can be harnessed to boost the performance of CNN-based camera localization. However, the existing strategies are limited to imposing image-level constraint between pose pairs, which is weak and coarse-gained. In this paper, we introduce a pixel-level epipolar geometry constraint to vanilla localization framework without the ground-truth 3D information. Dubbed EpiLoc, our method establishes the geometric relationship between pixels in different images by utilizing the epipolar geometry thus forcing the network to regress more accurate poses. We also propose a variant called EpiSingle to cope with non-sequential training images, which can construct the epipolar geometry constraint based on a single image in a self-supervised manner. Extensive experiments on the public indoor 7Scenes and outdoor RobotCar datasets show that the proposed pixel-level constraint is valuable, and helps our EpiLoc achieve state-of-the-art results in the end-to-end camera localization task.

• Smart Structures and Systems
• /
• v.25 no.2
• /
• pp.135-153
• /
• 2020

There has been a sustained interest towards the non-contact structural displacement measurement by means of videogrammetric technique. On the way forward, one of the major concerns is the spurious image drift induced by temperature variation. This study therefore carries out an investigation into the temperature effect of videogrammetric technique, focusing on the exploration of the mechanism behind the temperature effect and the elimination of the temperature-caused measurement error. 2D videogrammetric measurement tests under monotonic or cyclic temperature variation are first performed. Features of measurement error and the casual relationship between temperature variation and measurement error are then studied. The variation of the temperature of digital camera is identified as the main cause of measurement error. An excellent linear relationship between them is revealed. After that, camera parameters are extracted from the mapping between world coordinates and pixels coordinates of the calibration targets. The coordinates of principle point and focal lengths show variations well correlated with temperature variation. The measurement error is thought to be an outcome mainly attributed to the variation of the coordinates of principle point. An approach for eliminating temperature-caused measurement error is finally proposed. Correlation models between camera parameters and temperature are formulated. Thereby, camera parameters under different temperature conditions can be predicted and the camera projective matrix can be updated accordingly. By reconstructing the world coordinates with the updated camera projective matrix, the temperature-caused measurement error is eliminated. A satisfactory performance has been achieved by the proposed approach in eliminating the temperature-caused measurement error.

• Journal of Power System Engineering
• /
• v.15 no.1
• /
• pp.72-77
• /
• 2011

The handling ability of containers at the terminal strongly depends on the performance of the cargo handling system such as RTGC(Rubber Tired Gantry Crane). This paper introduces a new guide line position measurement method using a camera for the RTGC which plays a important role in the harbor area. Because the line tracking is the basic technique for control system design of RTGC, it is necessary to develop a useful and reliable measurement system. If the displacement and angle of the RTGC relative to a guide line as trajectory to follow is obtained, the position of RTGC is calculated. Therefore, in this paper, a camera-based measurement system is introduced. The proposed measurement system is robust against light fluctuation and cracks of the guideline. This system consists of a camera and a PC which are installed at the lower side of the RTGC. Two edges of the guide line are detected from an input image taken by the camera, and these positions are determined in a Hough parameter space by using the Hough transformation method. From the experimental results, high accurate standard deviations were found as 0.98 pixel of the displacement and 0.24 degree of the angle, including robustness against lighting fluctuation and cracks of the guide line also.

• The Journal of the Korea Contents Association
• /
• v.14 no.8
• /
• pp.1-12
• /
• 2014

The projection mapping technique is used in various ways in almost every genre of performance arts at the moment. Thus, artist from various areas are participated in contents productions using it. The diversification of projection mapping contents gave producers a clue to try fresher visual effects and it was connected to the change of point of time using the camera working which was never used in old projection mapping contents productions. It is analyzed that the use of camera workings in the projection mapping image maximizes the visual Tactility and helps audiences concentrate on the contents. This study performed the theoretical research on the 'camera working' which is a new visual expression of the projection mapping and analyzed cases of projection mapping works applying them. It is to reconstruct the camera working which has been applied only by images of movies and suggest a guideline to create the optimized visual effect.

• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.4
• /
• pp.177-186
• /
• 2015

For data fusion of laser range finder (LRF) and vision camera, accurate calibration of external parameters which describe relative pose between two sensors is necessary. This paper proposes a new calibration method which can acquires more accurate external parameters between a LRF and a vision camera compared to other existing methods. The main motivation of the proposed method is that any corner data of a known 3D structure which is acquired by the LRF should be projected on a straight line in the camera image. To satisfy such constraint, we propose a 3D geometric model and a numerical solution to minimize the energy function of the model. In addition, we describe the implementation steps of the data acquisition of LRF and camera images which are necessary in accurate calibration results. In the experiment results, it is shown that the performance of the proposed method are better in terms of accuracy compared to other conventional methods.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.44 no.4 s.316
• /
• pp.27-34
• /
• 2007

In this paper device driver for camera capture in hand held mobile system is implemented based on microsoft windows CE operating system. We also study the storage device driver based on the FAT fie system by using NAND flash memory as a storage device. We use the MBA2440 PDA board for implementing the hardware for image capture by using CMOS camera module producted by PixelPlus company. This camera module has VGA $640{\times}480$ pixel resolution. We also make application program which can be cooperated with the device driver for testing its performance, for example image capture speed and quality of captured image. We check that the application can be cooperated well not only with the device driver for camera capture but also with the device driver for FAT file system designed especially for the NAND flash memory.

• The KIPS Transactions:PartB
• /
• v.14B no.3 s.113
• /
• pp.163-170
• /
• 2007

In autonomous navigation of a mobile vehicle or a mobile robot, localization calculated from recognizing its environment is most important factor. Generally, we can determine position and pose of a camera equipped mobile vehicle or mobile robot using INS and GPS but, in this case, we must use enough known ground landmark for accurate localization. hi contrast with homography method to calculate position and pose of a camera by only using the relation of two dimensional feature point between two frames, in this paper, we propose a method to calculate the position and the pose of a camera using relation between the location to predict through perspective transform of 3D feature points obtained by overlaying 3D model with previous frame using GPS and INS input and the location of corresponding feature point calculated using KLT tracking method in current frame. For the purpose of the performance evaluation, we use wireless-controlled vehicle mounted CCD camera, GPS and INS, and performed the test to calculate the location and the rotation angle of the camera with the video sequence stream obtained at 15Hz frame rate.

• Journal of the Korea Society of Computer and Information
• /
• v.10 no.3 s.35
• /
• pp.143-150
• /
• 2005

Camera image is very sensitive to illumination that result in difficulties for recognizing character. Also Camera captured document images have not only skew but also vignetting effect and geometric distortion. Vignetting effect make it difficult to separate characters from the document images. Geometric distortion, occurred by the mismatch of angle and center position between the document image and the camera, make the shape of characters to be distorted, so that the character recognition is more difficult than the case of using scanner. In this paper, we propose a method that can increase the performance of character recognition by correcting the geometric distortion of document images using a linear approximation which changes the quadrilateral region to the rectangle one. The proposed method also determine the quadrilateral transform region automatically, using the alignment of character lines and the skewed angles of characters located in the edges of each character line. Proposed method, therefore, can correct the geometric distortion without getting positional information from camera.

• Journal of IKEEE
• /
• v.26 no.3
• /
• pp.430-436
• /
• 2022

In this paper, we propose an intelligent camera for multiple body temperature detection. The proposed camera is composed of optical(4056*3040) and thermal(640*480), which detects abnormal symptoms by analyzing a person's facial expression and body temperature from the acquired image. The optical and thermal imaging cameras are operated simultaneously and detect an object in the optical image, in which the facial region and expression analysis are calculated from the object. Additionally, the calculated coordinate values from the optical image facial region are applied to the thermal image, also the maximum temperature is measured from the region and displayed on the screen. Abnormal symptom detection is determined by using the analyzed three facial expressions(neutral, happy, sadness) and body temperature values. In order to evaluate the performance of the proposed camera, the optical image processing part is tested on Caltech, WIDER FACE, and CK+ datasets for three algorithms(object detection, facial region detection, and expression analysis). Experimental results have shown 91%, 91%, and 84% accuracy scores each.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.12
• /
• pp.1816-1825
• /
• 2022

In this paper, we propose a new approach for tracking each human in a surveillance camera network with various resolution cameras. When tracking human on multiple non-overlapping cameras, the traditional appearance features are easily affected by various camera viewing conditions. To overcome this limitation, the proposed system utilizes facial information along with appearance information. In general, human images captured by the surveillance camera are often low resolution, so it is necessary to be able to extract useful features even from low-resolution faces to facilitate tracking. In the proposed tracking scheme, texture-based face descriptor is exploited to extract features from detected face after face frontalization. In addition, when the size of the face captured by the surveillance camera is very small, a super-resolution technique that enlarges the face is also exploited. The experimental results on the public benchmark Dana36 dataset show promising performance of the proposed algorithm.