• Title/Summary/Keyword: multi-camera

Search Result 879, Processing Time 0.024 seconds

Gaze Detection by Computing Facial Rotation and Translation (얼굴의 회전 및 이동 분석에 의한 응시 위치 파악)

  • Lee, Jeong-Jun;Park, Kang-Ryoung;Kim, Jai-Hie
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.39 no.5
    • /
    • pp.535-543
    • /
    • 2002
  • In this paper, we propose a new gaze detection method using 2-D facial images captured by a camera on top of the monitor. We consider only the facial rotation and translation and not the eyes' movements. The proposed method computes the gaze point caused by the facial rotation and the amount of the facial translation respectively, and by combining these two the final gaze point on a monitor screen can be obtained. We detected the gaze point caused by the facial rotation by using a neural network(a multi-layered perceptron) whose inputs are the 2-D geometric changes of the facial features' points and estimated the amount of the facial translation by image processing algorithms in real time. Experimental results show that the gaze point detection accuracy between the computed positions and the real ones is about 2.11 inches in RMS error when the distance between the user and a 19-inch monitor is about 50~70cm. The processing time is about 0.7 second with a Pentium PC(233MHz) and 320${\times}$240 pixel-size images.

Visualization of The Three Dimensional Information Using Stereo Camera (스테레오 카메라를 이용한 3차원 정보의 가시화)

  • Lee, Nam-Oh;Park, Soon-Yong;Lee, Seung-Min
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.47 no.4
    • /
    • pp.15-20
    • /
    • 2010
  • The three dimensional information is extracted and visualized using by stereo images of the object and the method for a 3D stereoscopic image is presented by the vergence control algorithm. The matching, which is applied a undistortion of lens and the energy function, is executed for the efficient extraction three dimensional information. Especially, applying the optimized method of matched line to the multi direction of the disparity imges. The disadvantages of multi directional method and reliability expansion method is collected. The matched interesting range of the three dimensional information is visualized using by VRML and more 3D stereoscopic image is visualized through the vergence control according to distance of the object. more improved three dimensional information is provided to observer by visualizing both of them at the same time.

Real-Time Compressed Video Acquisition System for Stereo 360 VR (Stereo 360 VR을 위한 실시간 압축 영상 획득 시스템)

  • Choi, Minsu;Paik, Joonki
    • Journal of Broadcast Engineering
    • /
    • v.24 no.6
    • /
    • pp.965-973
    • /
    • 2019
  • In this paper, Stereo 4K@60fps 360 VR real-time video capture system which consists of video stream capture, video encoding and stitching module is been designed. The system captures stereo 4K@60fps 360 VR video by stitching 6 of 2K@60fps stream which are captured through HDMI interface from 6 cameras in real-time. In video capture phase, video is captured from each camera using multi-thread in real-time. In video encoding phase, raw frame memory transmission and parallel encoding are used to reduce the resource usage in data transmission between video capture and video stitching modules. In video stitching phase, Real-time stitching is secured by stitching calibration preprocessing.

Application of the Multi-Focusing Composite Image for the Cotton Fiber Luster Analysis and Cotton Fabric Luster Analysis (다중초점화상기법(多重焦點畵像技法)을 적용(適用)한 면섬유광택분석(綿纖維光澤分析) 및 면직물(綿織物)의 광택(光澤)에 관(關)한 연구(硏究))

  • Mun, Sun-Hye;Kim, Jong-Jun;Jeon, Dong-Won
    • Journal of Fashion Business
    • /
    • v.7 no.5
    • /
    • pp.108-118
    • /
    • 2003
  • Surface properties, including the texture and the luster, of cotton fibers and yarns thereof play an important role in textile technology. The convolutions and the cross-sectional shape of the cotton fiber affect the fabric texture and the luster accordingly. Mercerization of the cotton fabric affects the luster, strength, and other properties of the fabric. In this study, the effect of mercerization was examined on the luster of the cotton fabric, together with the effect of polishing treatment. One of the traditional methods determining the fabric luster is the use of glossmeter or goniometric glossmeter. The use of glossmeter gives successful results in determining the gloss of rather flat and continuous surface such as plastic sheet, painted surface, or paper products. Since the textile fabrics have diverse surface structures and textures, these could be regarded as having three-dimensional surface. Such complexity imposes some difficulties for differentiating subtle surface luster properties of diverse textile fabrics. The advancement in the area of imaging technologies has enabled the micro-scale analysis of the surface textures and the fabric luster recently. Using a CCD camera, the surface luster images were taken at various incident illumination conditions. Microscale analysis, including the blob analysis, of the images could differentiate the subtle luster properties present in a group of cotton fabric samples comprising mercerized cotton fabric, non-mercerized cotton fabric, polished cotton fabric, and a 'standard' cotton fabric. The glossmeter measurement gave satisfactory but limited differentiation among the samples, whose luster differences are easily recognizable with visual observation, except for the mercerized cotton fabric sample and the non-mercerized cotton fabric. The microscale analysis of the fabric luster could, therefore, help understand the nature of diverse textile fabric luster.

The Effect Analysis of Compression Method on KOMPSAT Image Chain

  • Yong, Sang-Soon;Ra, Sung-Woong
    • Korean Journal of Remote Sensing
    • /
    • v.23 no.5
    • /
    • pp.431-437
    • /
    • 2007
  • Multi-Spectral Camera(MSC) on the KOMPSAT-2 satellite was developed and launched as a main payload to provide 1m of GSD(Ground Sampling Distance) for one(1) channel panchromatic imaging and 4m of GSD for four(4) channel multi-spectral imaging at 685km altitude covering l5km of swath width. Since the compression on MSC image chain was required to overcome the mismatch between input data rate and output date rate JPEG-like method was selected and analyzed to check the influence on the performance. In normal operation the MSC data is being acquired and transmitted with lossy compression ratio to cover whole image channel and full swath width in real-time. In the other hand the MSC performance have carefully been handled to avoid or minimize any degradation so that it was analyzed and restored in KGS(KOMPSAT Ground Station) during LEOP(Launch and Early Operation Phase). While KOMPSAT-2 had been developed, new compression method based upon wavelet for space application was introduced and available for next satellite. The study on improvement of image chain including new compression method is asked for next KOMPSAT which requires better GSD and larger swath width In this paper, satellite image chain which consists of on-board image chain and on-ground image chain including general MSC description is briefly described. The performance influences on the image chain between two on-board compression methods which are or will be used for KOMPSAT are analyzed. The differences on performance between two methods are compared and the better solution for the performance improvement of image chain on KOMPSAT is suggested.

KOMPSAT Data Processing System: An Overview and Preliminary Acceptance Test Results

  • Kim, Yong-Seung;Kim, Youn-Soo;Lim, Hyo-Suk;Lee, Dong-Han;Kang, Chi-Ho
    • Korean Journal of Remote Sensing
    • /
    • v.15 no.4
    • /
    • pp.357-365
    • /
    • 1999
  • The optical sensors of Electro-Optical Camera (EOC) and Ocean Scanning Multi-spectral Imager (OSMI) aboard the KOrea Multi-Purpose SATellite (KOMPSAT) will be placed in a sun synchronous orbit in late 1999. The EOC and OSMI sensors are expected to produce the land mapping imagery of Korean territory and the ocean color imagery of world oceans, respectively. Utilization of the EOC and OSMI data would encompass the various fields of science and technology such as land mapping, land use and development, flood monitoring, biological oceanography, fishery, and environmental monitoring. Readiness of data support for user community is thus essential to the success of the KOMPSAT program. As a part of testing such readiness prior to the KOMPSAT launch, we have performed the preliminary acceptance test for the KOMPSAT data processing system using the simulated EOC and OSMI data sets. The purpose of this paper is to demonstrate the readiness of the KOMPSAT data processing system, and to help data users understand how the KOMPSAT EOC and OSMI data are processed, archived, and provided. Test results demonstrate that all requirements described in the data processing specification have been met, and that the image integrity is maintained for all products. It is however noted that since the product accuracy is limited by the simulated sensor data, any quantitative assessment of image products can not be made until actual KOMPSAT images will be acquired.

Highway flood hazard mapping in Thailand using the Multi Criteria Analysis based the Analytic Hierarchy Process

  • Budhakooncharoen, Saisunee;Mahadhamrongchai, Wichien;Sukolratana, Jiraroth
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2015.05a
    • /
    • pp.236-236
    • /
    • 2015
  • Flood is one of the major natural disasters affecting millions of people. Thailand also, frequently faces with this type of disaster. Especially, 2011 mega flood in Central Thailand, inundated highway severely attributed to the failure of national economic and risk to life. Lesson learned from such an extreme event caused flood monitoring and warning becomes one of the sound mitigations. The highway flood hazard mapping accomplished in this research is one of the strategies. This is due to highway flood is the potential risk to life and limb, and potential damage to property. Monitoring and warning therefore help reducing live and property losses. In this study, degree of highway flood hazard was assessed by weighting factors for each cause of the highway flood using Multi Criteria Analysis (MCA) based Analytic Hierarchy Process (AHP). These weighting factors are the essential information to classify the degree of highway flood hazard to enable pinpoint on flood monitoring and flood warning in hazard areas. The highway flood causes were then investigated. It was found that three major factors influence to the highway flood are namely the highway characteristics, the hydrological characteristics and the land topography characteristics. The weight of importance for each cause of the highway flood in the whole country was assessed by weighting 3 major factors influence to the highway flood. According to the result of MCA analysis, the highway, the hydrological and the land topography characteristics were respectively weighted as 35, 35 and 30 percent influence to the cause of highway flood. These weighting factors were further utilized to classify the degree of highway flood hazard. The Weight Linear Combination (WLC) method was used to compute the total score of all highways according to each factor. This score was later used to categorize highway flood as high, moderate and low degree of hazard levels. Highway flood hazard map accomplished in this research study is applicable to serve as the handy tool for highway flood warning. However, to complete the whole warning process, flood water level monitoring system for example the camera gauge should be installed in the hazard highway. This is expected to serve as a simple flood monitor as part of the warning system during such extreme or critical event.

  • PDF

A Study for Utilization and constitution of MMSS (MMSS 시스템 구성 및 활용에 대한 연구)

  • Kim, Kwang-Yong;Yeun, Yeo-Sang;Choi, Jong-Hyun;Kim, Min-Soo;Kim, Kyoung-Ok
    • Journal of Korea Spatial Information System Society
    • /
    • v.3 no.1 s.5
    • /
    • pp.117-126
    • /
    • 2001
  • We have developed the Mobile Multi Sensor System(MMSS) for the data construction of 4S application and for basic technology acquisition of mobile mapping system in Korea. Using this MMSS, we will collect the information of road and road facilities for DB creation and also construct the Digital Elevation Model(DEM) as ancillary data in urban area. The MMSS consist of the integrated navigation sensor, DGPS & IMU, and digital CCD camera set. In the S/W aspect, we developed the post-processing components for extracting the 3D coordinate information (Spatial Information) and the client program for the MMSS user group. In this paper, we will overview the MMSS constitution and post-processing program, and introduce the utilization plan of MMSS.

  • PDF

Development of a Fault Detection Algorithm for Multi-Autonomous Driving Perception Sensors Based on FIR Filters (FIR 필터 기반 다중 자율주행 인지 센서 결함 감지 알고리즘 개발)

  • Jae-lee Kim;Man-bok Park
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.22 no.3
    • /
    • pp.175-189
    • /
    • 2023
  • Fault detection and diagnosis (FDI) algorithms are actively being researched for ensuring the integrity and reliability of environment perception sensors in autonomous vehicles. In this paper, a fault detection algorithm based on a multi-sensor perception system composed of radar, camera, and lidar is proposed to guarantee the safety of an autonomous vehicle's perception system. The algorithm utilizes reference generation filters and residual generation filters based on finite impulse response (FIR) filter estimates. By analyzing the residuals generated from the filtered sensor observations and the estimated state errors of individual objects, the algorithm detects faults in the environment perception sensors. The proposed algorithm was evaluated by comparing its performance with a Kalman filter-based algorithm through numerical simulations in a virtual environment. This research could help to ensure the safety and reliability of autonomous vehicles and to enhance the integrity of their environment perception sensors.

Design of Face with Mask Detection System in Thermal Images Using Deep Learning (딥러닝을 이용한 열영상 기반 마스크 검출 시스템 설계)

  • Yong Joong Kim;Byung Sang Choi;Ki Seop Lee;Kyung Kwon Jung
    • Convergence Security Journal
    • /
    • v.22 no.2
    • /
    • pp.21-26
    • /
    • 2022
  • Wearing face masks is an effective measure to prevent COVID-19 infection. Infrared thermal image based temperature measurement and identity recognition system has been widely used in many large enterprises and universities in China, so it is totally necessary to research the face mask detection of thermal infrared imaging. Recently introduced MTCNN (Multi-task Cascaded Convolutional Networks)presents a conceptually simple, flexible, general framework for instance segmentation of objects. In this paper, we propose an algorithm for efficiently searching objects of images, while creating a segmentation of heat generation part for an instance which is a heating element in a heat sensed image acquired from a thermal infrared camera. This method called a mask MTCNN is an algorithm that extends MTCNN by adding a branch for predicting an object mask in parallel with an existing branch for recognition of a bounding box. It is easy to generalize the R-CNN to other tasks. In this paper, we proposed an infrared image detection algorithm based on R-CNN and detect heating elements which can not be distinguished by RGB images.