• Title/Summary/Keyword: 영상 전처리

Search Result 1,103, Processing Time 0.025 seconds

Effective PPG Signal Processing Method for Detecting Emotional Stimulus (감성 자극 판단을 위한 효과적인 PPG 신호 처리 방법)

  • Oh, Dong-Gi;Min, Byung-Seok;Kwon, Sung-Oh;Kim, Hyun-Joong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.5C
    • /
    • pp.393-402
    • /
    • 2012
  • In this study, we propose a signal processing algorithm to measure the arousal level of a human subject using a PPG(Photoplethysmography) sensor. From the measured PPG signals, the arousal level is determined by PPI(Pulse to Pulse Interval) and discrete-time signal processing. We ran psychophysical experiments displaying visual stimuli on TV display while measuring PPG signal from a finger, where the nature landscape scenes were used for restorative effect, and the urban environments were used to stimulate the stress. However, the measured PPG signals may include noise due to subject movement and measurement error, which results in incorrect detections. In this paper, to mitigate the noise impact on stimulus detection, we propose a detecting algorithm using digital signal processing methods and statistics of measured signals. A filter is adopted to remove a high frequency noise and adaptively designed taking into account the statistics of the measured PPG signals. Moreover we employ a hysteresis method to reduce the distortion of PPI in decision of emotional. Via experiment, we show that the proposed scheme reduces signal noise and improves stimulus detection.

Hardware Design of High Performance HEVC Deblocking Filter for UHD Videos (UHD 영상을 위한 고성능 HEVC 디블록킹 필터 설계)

  • Park, Jaeha;Ryoo, Kwangki
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.19 no.1
    • /
    • pp.178-184
    • /
    • 2015
  • This paper proposes a hardware architecture for high performance Deblocking filter(DBF) in High Efficiency Video Coding for UHD(Ultra High Definition) videos. This proposed hardware architecture which has less processing time has a 4-stage pipelined architecture with two filters and parallel boundary strength module. Also, the proposed filter can be used in low-voltage design by using clock gating architecture in 4-stage pipeline. The segmented memory architecture solves the hazard issue that arises when single port SRAM is accessed. The proposed order of filtering shortens the delay time that arises when storing data into the single port SRAM at the pre-processing stage. The DBF hardware proposed in this paper was designed with Verilog HDL, and was implemented with 22k logic gates as a result of synthesis using TSMC 0.18um CMOS standard cell library. Furthermore, the dynamic frequency can process UHD 8k($7680{\times}4320$) samples@60fps using a frequency of 150MHz with an 8K resolution and maximum dynamic frequency is 285MHz. Result from analysis shows that the proposed DBF hardware architecture operation cycle for one process coding unit has improved by 32% over the previous one.

Extraction of Pyrophyllite Mineralized Zone using Characteristics of Spectral Reflectance of Rock Samples (암석분광반사율 특성을 이용한 납석 광화대 추출)

  • Chi, Kwang-Hoon;Lee, Hong-Jin
    • Korean Journal of Remote Sensing
    • /
    • v.23 no.6
    • /
    • pp.493-500
    • /
    • 2007
  • In general, it accomplished a spectral reflectance analysis to be, the measurement results appear differently by targets, methods and condition. This paper presents a standard methodology for preprocessing mineral/rock samples and setting the distance from a target to the sensor, and then examines closely the spectral features for pyrophyllite. The size of mineral/rock samples is various according to the condition and scale of outcrop, so it is important to maintain the distance between the sensor and the sample. Before standardization for preprocessing samples and the sensor and sample distance, we prepare various rock samples (Quartz Porphyry) such as natural rock, pebble, powder and cutting rock. For a qualitative analysis to minimize the effect of surface condition of the sample and shadow, we maintains the distance from the sample to the sensor at 30cm and measures three times repeatedly for cutting the sample at $1{\sim}2cm$ thickness. To illustrate the proposed methodology, a case study for pyrophyllite was carried out. In this study, pyrophyllite showed an absorption pattern at wave length of 1.406nm, 1,868nm, 2.180nm and 2.309nm, and a higher grade represented strong absorption at 1.406nm and 2.180 nm. These absorption feature corresponds the band 7 of LANDSAT TM and band 8 of ASTER imageries. So, using these results, pyrophyllite deposits were extracted from other features (such as barren area, concrete area, bed of river, stone pit area etc.).

A Study for Possibility to Detect Missing Sidewalk Blocks using Drone (드론을 이용한 보도블럭 탈락 탐지 가능성 연구)

  • Shin, Jung-il
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.22 no.5
    • /
    • pp.34-41
    • /
    • 2021
  • Sidewalks are facilities used for the safe and comfortable passage of pedestrians and are paved with blocks of various materials. Currently, Korea does not have a quantitative survey method for the pavement condition of sidewalks, so it is necessary to develop an efficient survey method. Drones are being used as an efficient survey tool in various fields, but there are limited studies in which sidewalks have been investigated. This study investigates the possibility of detection by limiting the missing sidewalk blocks using a drone. This study is an initial study on the development of a method for detecting damage in sidewalk blocks. For this, sidewalk blocks were artificially removed to simulate a dropout situation, and images were acquired with 0.7-cm resolution using a drone. As a characteristic of the point cloud data acquired through image pre-processing, there was high variance of the elevation of the points in the missing area of the sidewalk block. Using these characteristics, an experiment was conducted to detect the missing parts of the sidewalk block by applying four thresholds to the variance of the elevation of points included in the grid corresponding to the sidewalk area. As a result, the detection accuracy was shown with a positive detection ratio of 70-80%, omission errors of 20-30%, and commission errors lower than 2%. It is judged that the possibility of detecting missing sidewalk blocks is high. This study focused on detecting a simulated missing sidewalk block in a limited environment. Therefore, it is expected that an efficient and quantitative method of detecting damaged sidewalk blocks can be developed in the future through additional research with considerations of the actual environment.

Validation of Sea Surface Wind Estimated from KOMPSAT-5 Backscattering Coefficient Data (KOMPSAT-5 후방산란계수 자료로 산출된 해상풍 검증)

  • Jang, Jae-Cheol;Park, Kyung-Ae;Yang, Dochul
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.6_3
    • /
    • pp.1383-1398
    • /
    • 2018
  • Sea surface wind is one of the most fundamental variables for understanding diverse marine phenomena. Although scatterometers have produced global wind field data since the early 1990's, the data has been used limitedly in oceanic applications due to it slow spatial resolution, especially at coastal regions. Synthetic Aperture Radar (SAR) is capable to produce high resolution wind field data. KOMPSAT-5 is the first Korean satellite equipped with X-band SAR instrument and is able to retrieve the sea surface wind. This study presents the validation results of sea surface wind derived from the KOMPSAT-5 backscattering coefficient data for the first time. We collected 18 KOMPSAT-5 ES mode data to produce a matchup database collocated with buoy stations. In order to calculate the accurate wind speed, we preprocessed the SAR data, including land masking, speckle noise reduction, and ship detection, and converted the in-situ wind to 10-m neutral wind as reference wind data using Liu-Katsaros-Businger (LKB) model. The sea surface winds based on XMOD2 show root-mean-square errors of about $2.41-2.74m\;s^{-1}$ depending on backscattering coefficient conversion equations. In-depth analyses on the wind speed errors derived from KOMPSAT-5 backscattering coefficient data reveal the existence of diverse potential error factors such as image quality related to range ambiguity, discrete and discontinuous distribution of incidence angle, change in marine atmospheric environment, impacts on atmospheric gravity waves, ocean wave spectrum, and internal wave.

Detection of Toluene Hazardous and Noxious Substances (HNS) Based on Hyperspectral Remote Sensing (초분광 원격탐사 기반 위험·유해물질 톨루엔 탐지)

  • Park, Jae-Jin;Park, Kyung-Ae;Foucher, Pierre-Yves;Kim, Tae-Sung;Lee, Moonjin
    • Journal of the Korean earth science society
    • /
    • v.42 no.6
    • /
    • pp.623-631
    • /
    • 2021
  • The increased transport of marine hazardous and noxious substances (HNS) has resulted in frequent HNS spill accidents domestically and internationally. There are about 6,000 species of HNS internationally, and most of them have toxic properties. When an accidental HNS spill occurs, it can destroys the marine ecosystem and can damage life and property due to explosion and fire. Constructing a spectral library of HNS according to wavelength and developing a detection algorithm would help prepare for accidents. In this study, a ground HNS spill experiment was conducted in France. The toluene spectrum was determined through hyperspectral sensor measurements. HNS present in the hyperspectral images were detected by applying the spectral mixture algorithm. Preprocessing principal component analysis (PCA) removed noise and performed dimensional compression. The endmember spectra of toluene and seawater were extracted through the N-FINDR technique. By calculating the abundance fraction of toluene and seawater based on the spectrum, the detection accuracy of HNS in all pixels was presented as a probability. The probability was compared with radiance images at a wavelength of 418.15 nm to select abundance fractions with maximum detection accuracy. The accuracy exceeded 99% at a ratio of approximately 42%. Response to marine spills of HNS are presently impeded by the restricted access to the site because of high risk of exposure to toxic compounds. The present experimental and detection results could help estimate the area of contamination with HNS based on hyperspectral remote sensing.

Change Attention-based Vehicle Scratch Detection System (변화 주목 기반 차량 흠집 탐지 시스템)

  • Lee, EunSeong;Lee, DongJun;Park, GunHee;Lee, Woo-Ju;Sim, Donggyu;Oh, Seoung-Jun
    • Journal of Broadcast Engineering
    • /
    • v.27 no.2
    • /
    • pp.228-239
    • /
    • 2022
  • In this paper, we propose an unmanned vehicle scratch detection deep learning model for car sharing services. Conventional scratch detection models consist of two steps: 1) a deep learning module for scratch detection of images before and after rental, 2) a manual matching process for finding newly generated scratches. In order to build a fully automatic scratch detection model, we propose a one-step unmanned scratch detection deep learning model. The proposed model is implemented by applying transfer learning and fine-tuning to the deep learning model that detects changes in satellite images. In the proposed car sharing service, specular reflection greatly affects the scratch detection performance since the brightness of the gloss-treated automobile surface is anisotropic and a non-expert user takes a picture with a general camera. In order to reduce detection errors caused by specular reflected light, we propose a preprocessing process for removing specular reflection components. For data taken by mobile phone cameras, the proposed system can provide high matching performance subjectively and objectively. The scores for change detection metrics such as precision, recall, F1, and kappa are 67.90%, 74.56%, 71.08%, and 70.18%, respectively.

Comparison of Adversarial Example Restoration Performance of VQ-VAE Model with or without Image Segmentation (이미지 분할 여부에 따른 VQ-VAE 모델의 적대적 예제 복원 성능 비교)

  • Tae-Wook Kim;Seung-Min Hyun;Ellen J. Hong
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.23 no.4
    • /
    • pp.194-199
    • /
    • 2022
  • Preprocessing for high-quality data is required for high accuracy and usability in various and complex image data-based industries. However, when a contaminated hostile example that combines noise with existing image or video data is introduced, which can pose a great risk to the company, it is necessary to restore the previous damage to ensure the company's reliability, security, and complete results. As a countermeasure for this, restoration was previously performed using Defense-GAN, but there were disadvantages such as long learning time and low quality of the restoration. In order to improve this, this paper proposes a method using adversarial examples created through FGSM according to image segmentation in addition to using the VQ-VAE model. First, the generated examples are classified as a general classifier. Next, the unsegmented data is put into the pre-trained VQ-VAE model, restored, and then classified with a classifier. Finally, the data divided into quadrants is put into the 4-split-VQ-VAE model, the reconstructed fragments are combined, and then put into the classifier. Finally, after comparing the restored results and accuracy, the performance is analyzed according to the order of combining the two models according to whether or not they are split.

Detecting Vehicles That Are Illegally Driving on Road Shoulders Using Faster R-CNN (Faster R-CNN을 이용한 갓길 차로 위반 차량 검출)

  • Go, MyungJin;Park, Minju;Yeo, Jiho
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.21 no.1
    • /
    • pp.105-122
    • /
    • 2022
  • According to the statistics about the fatal crashes that have occurred on the expressways for the last 5 years, those who died on the shoulders of the road has been as 3 times high as the others who died on the expressways. It suggests that the crashes on the shoulders of the road should be fatal, and that it would be important to prevent the traffic crashes by cracking down on the vehicles intruding the shoulders of the road. Therefore, this study proposed a method to detect a vehicle that violates the shoulder lane by using the Faster R-CNN. The vehicle was detected based on the Faster R-CNN, and an additional reading module was configured to determine whether there was a shoulder violation. For experiments and evaluations, GTAV, a simulation game that can reproduce situations similar to the real world, was used. 1,800 images of training data and 800 evaluation data were processed and generated, and the performance according to the change of the threshold value was measured in ZFNet and VGG16. As a result, the detection rate of ZFNet was 99.2% based on Threshold 0.8 and VGG16 93.9% based on Threshold 0.7, and the average detection speed for each model was 0.0468 seconds for ZFNet and 0.16 seconds for VGG16, so the detection rate of ZFNet was about 7% higher. The speed was also confirmed to be about 3.4 times faster. These results show that even in a relatively uncomplicated network, it is possible to detect a vehicle that violates the shoulder lane at a high speed without pre-processing the input image. It suggests that this algorithm can be used to detect violations of designated lanes if sufficient training datasets based on actual video data are obtained.

Development of a deep learning-based cabbage core region detection and depth classification model (딥러닝 기반 배추 심 중심 영역 및 깊이 분류 모델 개발)

  • Ki Hyun Kwon;Jong Hyeok Roh;Ah-Na Kim;Tae Hyong Kim
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.16 no.6
    • /
    • pp.392-399
    • /
    • 2023
  • This paper proposes a deep learning model to determine the region and depth of cabbage cores for robotic automation of the cabbage core removal process during the kimchi manufacturing process. In addition, rather than predicting the depth of the measured cabbage, a model was presented that simultaneously detects and classifies the area by converting it into a discrete class. For deep learning model learning and verification, RGB images of the harvested cabbage 522 were obtained. The core region and depth labeling and data augmentation techniques from the acquired images was processed. MAP, IoU, acuity, sensitivity, specificity, and F1-score were selected to evaluate the performance of the proposed YOLO-v4 deep learning model-based cabbage core area detection and classification model. As a result, the mAP and IoU values were 0.97 and 0.91, respectively, and the acuity and F1-score values were 96.2% and 95.5% for depth classification, respectively. Through the results of this study, it was confirmed that the depth information of cabbage can be classified, and that it can be used in the development of a robot-automation system for the cabbage core removal process in the future.