• Title/Summary/Keyword: Multi-Sensor Image

Search Result 286, Processing Time 0.03 seconds

Speeding up the KLT Tracker for Realtime Image Georeferencing (실시간 영상 지오레퍼런싱을 위한 KLT 트랙커의 속도개선)

  • Supannee, Tanathong;Lee, Im-Pyeong
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2010.04a
    • /
    • pp.77-80
    • /
    • 2010
  • The demand for human security significantly promotes the development of surveillance applications using a multi-sensor integrated UAV system. For more sophisticated operations, the system should provide a sequence of images rectified in a ground coordinate system in realtime. This rectification requires accurate position and attitude of the camera at the time of exposure of each image, which can be estimated through an Aerial Triangulation process using the GPS/INS data and tie points between adjacent images. In this work, the KLT tracker is utilized to obtain the tie points. To satisfy the realtime requirements, we present an approach to speed up the tracker by supplying the initial guessed positions of tie points based on the exterior orientation. The experimental results show that, when the guessed positions are supplied, the KLT tracker consumed less computational time than the ordinary KLT which is more suitable to be incorporated into the realtime image georeferencing process.

  • PDF

Development of PKNU3: A small-format, multi-spectral, aerial photographic system

  • Lee Eun-Khung;Choi Chul-Uong;Suh Yong-Cheol
    • Korean Journal of Remote Sensing
    • /
    • v.20 no.5
    • /
    • pp.337-351
    • /
    • 2004
  • Our laboratory originally developed the compact, multi-spectral, automatic aerial photographic system PKNU3 to allow greater flexibility in geological and environmental data collection. We are currently developing the PKNU3 system, which consists of a color-infrared spectral camera capable of simultaneous photography in the visible and near-infrared bands; a thermal infrared camera; two computers, each with an 80-gigabyte memory capacity for storing images; an MPEG board that can compress and transfer data to the computers in real-time; and the capability of using a helicopter platform. Before actual aerial photographic testing of the PKNU3, we experimented with each sensor. We analyzed the lens distortion, the sensitivity of the CCD in each band, and the thermal response of the thermal infrared sensor before the aerial photographing. As of September 2004, the PKNU3 development schedule has reached the second phase of testing. As the result of two aerial photographic tests, R, G, B and IR images were taken simultaneously; and images with an overlap rate of 70% using the automatic 1-s interval data recording time could be obtained by PKNU3. Further study is warranted to enhance the system with the addition of gyroscopic and IMU units. We evaluated the PKNU 3 system as a method of environmental remote sensing by comparing each chlorophyll image derived from PKNU 3 photographs. This appraisement was backed up with existing study that resulted in a modest improvement in the linear fit between the measures of chlorophyll and the RVI, NDVI and SAVI images stem from photographs taken by Duncantech MS 3100 which has same spectral configuration with MS 4000 used in PKNU3 system.

High Frame Rate VGA CMOS Image Sensor using Three Step Single Slope Column-Parallel ADCs

  • Lee, Junan;Huang, Qiwei;Kim, Kiwoon;Kim, Kyunghoon;Burm, Jinwook
    • JSTS:Journal of Semiconductor Technology and Science
    • /
    • v.15 no.1
    • /
    • pp.22-28
    • /
    • 2015
  • This paper proposes column-parallel three step Single Slope Analog-to-Digital Converter (SS-ADC) for high frame rate VGA CMOS Image Sensors (CISs). The proposed three step SS-ADC improves the sampling rate while maintaining the architecture of the conventional SS-ADC for high frame rate CIS. The sampling rate of the three-step ADC is increased by a factor of 39 compared with the conventional SS-ADC. The proposed three-step SS-ADC has a 12-bit resolution and 200 kS/s at 25 MHz clock frequency. The VGA CIS using three step SS-ADC has the maximum frame rate of 200 frames/s. The total power consumption is 76 mW with 3.3 V supply voltage without ramp generator buffer. A prototype chip was fabricated in a $0.13{\mu}m$ CMOS process.

Multi-Modal Biometries System for Ubiquitous Sensor Network Environment (유비쿼터스 센서 네트워크 환경을 위한 다중 생체인식 시스템)

  • Noh, Jin-Soo;Rhee, Kang-Hyeon
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.44 no.4 s.316
    • /
    • pp.36-44
    • /
    • 2007
  • In this paper, we implement the speech & face recognition system to support various ubiquitous sensor network application services such as switch control, authentication, etc. using wireless audio and image interface. The proposed system is consist of the H/W with audio and image sensor and S/W such as speech recognition algorithm using psychoacoustic model, face recognition algorithm using PCA (Principal Components Analysis) and LDPC (Low Density Parity Check). The proposed speech and face recognition systems are inserted in a HOST PC to use the sensor energy effectively. And improve the accuracy of speech and face recognition, we implement a FEC (Forward Error Correction) system Also, we optimized the simulation coefficient and test environment to effectively remove the wireless channel noises and correcting wireless channel errors. As a result, when the distance that between audio sensor and the source of voice is less then 1.5m FAR and FRR are 0.126% and 7.5% respectively. The face recognition algorithm step is limited 2 times, GAR and FAR are 98.5% and 0.036%.

A Study on the Method of Generating RPC for KOMPSAT-2 MSC Pre-Processing System (KOMPSAT-2 MSC 전처리시스템을 위한 RPC(Rational Polynomial Coefficient)생성 기법에 관한 연구)

  • 서두천;임효숙
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2003.10a
    • /
    • pp.417-422
    • /
    • 2003
  • The KOMPSAT-2 MSC(Multi-Spectral Camera), with high spatial resolution, is currently under development and will be launched in the end of 2004. A sensor model relates a 3-D ground position to the corresponding 2-D image position and describes the imaging geometry that is necessary to reconstruct the physical imaging process. The Rational Function Model (RFM) has been considered as a generic sensor model. form. The RFM is technically applicable to all types of sensors such as frame, pushbroom, whiskbroom and SAR etc. With the increasing availability of the new generation imaging sensors, accurate and fast rectification of digital imagery using a generic sensor model becomes of great interest to the user community. This paper describes the procedure to generation of the RPC (Rational Polynomial Coefficients) for KOMPSAT-2 MSC.

  • PDF

Registration between High-resolution Optical and SAR Images Using linear Features (선형정보를 이용한 고해상도 광학영상과 SAR 영상 간 기하보정)

  • Han, You-Kyung;Kim, Duk-Jin;Kim, Yong-Il
    • Korean Journal of Remote Sensing
    • /
    • v.27 no.2
    • /
    • pp.141-150
    • /
    • 2011
  • Precise image-to-image registration is required to process multi-sensor data together. The purpose of this paper is to develop an algorithm that register between high-resolution optical and SAR images using linear features. As a pre-processing step, initial alignment was fulfilled using manually selected tie points to remove any dislocations caused by scale difference, rotation, and translation of images. Canny edge operator was applied to both images to extract linear features. These features were used to design a cost function that finds matching points based on their similarity. Outliers having larger geometric differences than general matching points were eliminated. The remaining points were used to construct a new transformation model, which was combined the piecewise linear function with the global affine transformation, and applied to increase the accuracy of geometric correction.

Design and Implementation of Local Forest Fire Monitoring and Situational Response Platform Using UAV with Multi-Sensor (무인기 탑재 다중 센서 기반 국지 산불 감시 및 상황 대응 플랫폼 설계 및 구현)

  • Shin, Won-Jae;Lee, Yong-Tae
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.10 no.6
    • /
    • pp.626-632
    • /
    • 2017
  • Since natural disaster occurs increasingly and becomes complicated, it causes deaths, disappearances, and damage to property. As a result, there is a growing interest in the development of ICT-based natural disaster response technology which can minimize economic and social losses. In this letter, we introduce the main functions of the forest fire management platform by using images from an UAV. In addition, we propose a disaster image analysis technology based on the deep learning which is a key element technology for disaster detection. The proposed deep learning based disaster image analysis learns repeatedly generated images from the past, then it is possible to detect the disaster situation of forest-fire similar to a person. The validity of the proposed method is verified through the experimental performance of the proposed disaster image analysis technique.

Simultaneous Localization and Mobile Robot Navigation using a Sensor Network

  • Jin Tae-Seok;Bashimoto Hideki
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.6 no.2
    • /
    • pp.161-166
    • /
    • 2006
  • Localization of mobile agent within a sensing network is a fundamental requirement for many applications, using networked navigating systems such as the sonar-sensing system or the visual-sensing system. To fully utilize the strengths of both the sonar and visual sensing systems, This paper describes a networked sensor-based navigation method in an indoor environment for an autonomous mobile robot which can navigate and avoid obstacle. In this method, the self-localization of the robot is done with a model-based vision system using networked sensors, and nonstop navigation is realized by a Kalman filter-based STSF(Space and Time Sensor Fusion) method. Stationary obstacles and moving obstacles are avoided with networked sensor data such as CCD camera and sonar ring. We will report on experiments in a hallway using the Pioneer-DX robot. In addition to that, the localization has inevitable uncertainties in the features and in the robot position estimation. Kalman filter scheme is used for the estimation of the mobile robot localization. And Extensive experiments with a robot and a sensor network confirm the validity of the approach.

Image Retrieval using Multiple Features on Mobile Platform (모바일 플랫폼에서 다중 특징 기반의 이미지 검색)

  • Lee, Yong-Hwan;Cho, Han-Jin;Lee, June-Hwan
    • Journal of Digital Convergence
    • /
    • v.12 no.6
    • /
    • pp.237-243
    • /
    • 2014
  • In this paper, we propose a mobile image retrieval system which utilizes the mobile device's sensor information and enables running in a variety of the environments, and implement the system on Android platform. The proposed system deals with a new image descriptor using combination of the visual feature with EXIF attributes in the target of JPEG image, and image matching algorithm which is optimized to the mobile environments. Experiments are performed on the Android platform, and the experimental results revealed that the proposed algorithm exhibits a significant improved results with large image database.

Development of Multi-functional Laser Pointer Mouse Through Image Processing (영상처리를 통한 다기능 레이저 포인터 마우스 개발)

  • Kim, Yeong-Woo;Kim, Sung-Min;Shin, Jin;Yi, Soo-Yeong
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.11
    • /
    • pp.1168-1172
    • /
    • 2011
  • Beam projector is popularly used for presentation. In order to pay attention to local area of the beam projector display, a laser pointer is used together with a pointing device(Mouse). Simple wireless presenter has limited functions of a pointing device such as "go to next slide" or "back to previous slide" in a specific application(Microsoft PowerPoint) through wireless channel; thus, there is inconvenience to do other tasks e.g., program execution, maximize/minimize window etc. provided by clicking mouse buttons. The main objective of this paper is to implement a multi-functional laser-pointer mouse that has the same functions of a computer mouse. In order to get position of laser spot in the projector display, an image processing to extract the laser spot in the camera image is required. In addition, we propose a transformation of the spot position into computer display coordinates to execute mouse functions on computer display.