• Title/Summary/Keyword: data pre-processing

Search Result 805, Processing Time 0.023 seconds

An Efficient Visualization Method for Interactive Volume Rendering (대화식 볼륨 렌더링을 지원하는 효율적인 가시화 방법)

  • Kim, Tae-Young
    • Journal of the Korea Computer Graphics Society
    • /
    • v.8 no.1
    • /
    • pp.1-11
    • /
    • 2002
  • In order to widely use volume rendering technology in practical fields, a user should be able to control the classification parameter interactively and extract a meaningful information easily from the 3D data as fast as it can be. Previous work on an accelerating volume rendering reconstructs an isotropic volume from an anisotropic one and classifies in pre-processing time and then renders the classified volume rapidly in run time. But, this traditional step may result in long pre-processing time and no real-time feedback. In this paper, we present an efficient classification and rendering method that allows a user to set the opacity transfer function interactively at rendering time on a personal computer without special-purpose hardware.

  • PDF

Two-Channel Multiwavelet Transform and Pre/Post-Filtering for Image Compression (영상 데이터 압축을 위한 2-채널 멀티웨이브렛 변환과 전후처리 필터의 적용)

  • Heo, Ung;Choi, Jae-Ho
    • Journal of the Korea Computer Industry Society
    • /
    • v.5 no.5
    • /
    • pp.737-746
    • /
    • 2004
  • Two-channel multiwavelet system is investigated for image compression application in this paper. Generally, multiwavelets are known for their superb capability of compressing non-stationary signals like voice. However, multivavelet system have a critical problem in processing and compressing image data due to mesh-grid visual artifacts. In our two-channel multiwavelet system we have investigated incorporation of pre and post filtering to the multiwavelet transform and compression system for alleviating those ingerent visual artifacts due to multiwavelet effect. In addition, to quantify the image data compression performance of proposed multiwavelet system, computer simulations have been performed using various image data. For bit allocation and quantization, the Lagrange multiplier technique considering data rate vs. distortion rate along with a nonlinear companding method are applied equallly to all systems considered, here. The simulation results have yielded 1 ~ 2 dB compression enhancement over the scalar savelet systems. If the more advanced compression methods like SPIHT and run-length channel coding were adopted for the proposed multiwavelet system, a much higher compression gain could be obtained.

  • PDF

NIS quality analysis of pre- and post-harvest sugarcane.

  • Johnson, Sarah E.;Berding, Nils
    • Proceedings of the Korean Society of Near Infrared Spectroscopy Conference
    • /
    • 2001.06a
    • /
    • pp.1621-1621
    • /
    • 2001
  • The quality of sugarcane grown on the NE Australian tropical coast ($16^{\circ}$15'- $18^{\circ}$15' S Lat.) has declined markedly in the past seven years. This has been linked to dilution of mill-supply cane with increasing levels of non mature-stalk material consisting of leaves and sucker culms. The prime research objective was to examine the transition from the pre-harvest, in-field crop to harvested material sent for processing, in terms of quality and crop fraction proportions. A secondary objective was to quantify the effects of preharvest-season crop habit and culm condition on crop quality. Ten quadrat samples from each of 54 random crop sites (17 in 1999 and 37 in 2000), covering a wide range of variables (cultivar, crop class, and edaphic, topographic, climatic, and temporal factors) were collected immediately before harvest. Samples were partitioned into four fractions:- sound and unsound mature stalks (culms), sucker culms, and extraneous matter (leaves). Material harvested from each site was sampled and partitioned into four fractions:- sound and unsound billets (culm pieces), culm-spindle pieces, and leaf. In 2000, before harvest, 14 additional sites were sampled monthly, on three occasions, from March - June. Erect and non-erect culms were divided into sound and unsound classes. All samples were disintegrated and presented to a remote reflectance module of a scanning spectrophotometer using the BSES large cassette module. Near infra-red spectroscopic (NIS) analyses were developed for the rapid determination of quality components (Brix, commercial cane sugar (CCS), fibre, moisture, and polariscope reading). Calibrations for three material groups (culm (n = 639), non-culm (n = 496), and combined) were developed for all components using the 1999 data set. Two sub-sets (n = 178, and 190) of about 10% of the preharvest-season and harvest populations scanned in 2000 also were subjected to full routine laboratory analyses. The 1999 combined calibrations were excellent, but the culm calibrations produced consistently lower standard errors. Non-culm calibrations were marginally better than the combined for only CCS and pol. reading. Analysis of the 2000 culm data with calibrations using all 1999 and 2000 culm data resulted in better predictions relative to the 1999 culm calibrations. This also was true for the combined calibrations. Assessment of quality components in pre- and post-harvest sugarcane using NIS calibrations was more cost effective than using routine laboratory techniques. Outcomes from this NIS-facilitated research will have important economic consequences for the Australian sugarcane industry. Potential CCS present in mature culms is being discounted by dilution with leaves and sucker culms, threatening farm viability. The results question the efficacy of current harvesting technology. The CCS of harvested cane is improved only marginally over that of the in-field crop. Current harvesting technology requires either supplementary, innovative pre-mill processing or a design revolution to improve mill-supply cane quality, and therefore whole of industry economics. NIS-facilitated analyses, before the harvest season, highlighted the benefits of growing erect, sound crops. Loss of CCS then, can be minimized only by a combination of crop improvement and agronomic solutions, applied as part of sound on-farm management.

  • PDF

Single chip multi-function peripheral image processor with unified binarization architecture (통합된 이진화 구조를 가진 복합기용 1-Chip 영상처리 프로세서의 개발)

  • Park, Chang-Dae;Lee, Eul-Hwan;Kim, Jae-Ho
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.36S no.11
    • /
    • pp.34-43
    • /
    • 1999
  • A high-speed image processor (HIP) is implemented for a high-speed multi-function peripheral. HIP has a binarization architecture with unified data path. It has the pixel-by-pixel pipelined processing to minimize size of the external memory. It performs pre-processing such as shading correction, automatic gain control (AGC), and gamma correction, and also drives external CCD or CIS modules. The pre-processed data can be enlarged or reduced. Various binarizatin algorithms can be processed in the unified archiecture. The embedded binarization algorithms are simple thresholding, high pass filtering, dithering, error diffusion, and thershold modulated error diffusion. These binarization algorithms are unified based on th threshold modulated error diffusion. The data path is designed to share the common functional block of the binarization algorithms. The complexity of the controls and the gate counts is greatly reduced with this novel architecture.

  • PDF

Research on the air data acquisition method using static pressure hole (정압력 홀을 적용한 초고속 유동 데이터 획득 방안에 관한 연구)

  • Choi, Jong-Ho;Yoon, Hyun-Gull
    • Proceedings of the Korean Society of Propulsion Engineers Conference
    • /
    • 2010.05a
    • /
    • pp.406-410
    • /
    • 2010
  • Current paper represents the air data acquisition and processing algorithm which can acquire the air data such as velocity and angle of attack by measuring the static pressure on the specific locations of a high speed aerial vehicle. Unlike the previous air data acquisition system, current system applied several pre-determined data obtained from computational fluid dynamic approach having enough sensor redundancy and fault detection ability. The verification of current algorithm was done by commercial software Matlab and Simulink.

  • PDF

Building Hybrid Stop-Words Technique with Normalization for Pre-Processing Arabic Text

  • Atwan, Jaffar
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.7
    • /
    • pp.65-74
    • /
    • 2022
  • In natural language processing, commonly used words such as prepositions are referred to as stop-words; they have no inherent meaning and are therefore ignored in indexing and retrieval tasks. The removal of stop-words from Arabic text has a significant impact in terms of reducing the size of a cor- pus text, which leads to an improvement in the effectiveness and performance of Arabic-language processing systems. This study investigated the effectiveness of applying a stop-word lists elimination with normalization as a preprocessing step. The idea was to merge statistical method with the linguistic method to attain the best efficacy, and comparing the effects of this two-pronged approach in reducing corpus size for Ara- bic natural language processing systems. Three stop-word lists were considered: an Arabic Text Lookup Stop-list, Frequency- based Stop-list using Zipf's law, and Combined Stop-list. An experiment was conducted using a selected file from the Arabic Newswire data set. In the experiment, the size of the cor- pus was compared after removing the words contained in each list. The results showed that the best reduction in size was achieved by using the Combined Stop-list with normalization, with a word count reduction of 452930 and a compression rate of 30%.

Fast Image Pre-processing Algorithms Using SSE Instructions (SSE 명령어를 이용한 영상의 고속 전처리 알고리즘)

  • Park, Eun-Soo;Cui, Xuenan;Kim, Jun-Chul;Im, Yu-Cheong;Kim, Hak-Il
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.46 no.2
    • /
    • pp.65-77
    • /
    • 2009
  • This paper proposes fast image processing algorithms using SSE (Streaming SIMD Extensions) instructions. The CPU's supporting SSE instructions have 128bit XMM registers; data included in these registers are processed at the same time with the SIMD (Single Instruction Multiple Data) mode. This paper develops new SIMD image processing algorithms for Mean filter, Sobel horizontal edge detector, and Morphological erosion operation which are most widely used in automated optical inspection systems and compares their processing times. In order to objectively evaluate the processing time, the developed algorithms are compared with OpenCV 1.0 operated in SISD (Single Instruction Single Data) mode, Intel's IPP 5.2 and MIL 8.0 which are fast image processing libraries supporting SIMD mode. The experimental result shows that the proposed algorithms on average are 8 times faster than the SISD mode image processing library and 1.4 times faster than the SIMD fast image processing libraries. The proposed algorithms demonstrate their applicability to practical image processing systems at high speed without commercial image processing libraries or additional hardwares.

Proposed Pre-Processing Method for Improving Pothole Dataset Performance in Deep Learning Model and Verification by YOLO Model (딥러닝 모델에서 포트홀 데이터셋의 성능 향상을 위한 전처리 방법 제안과 YOLO 모델을 통한 검증)

  • Han-Jin Lee;Ji-Woong Yang;Ellen J. Hong
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.23 no.4
    • /
    • pp.249-255
    • /
    • 2022
  • Potholes are an important clue to the structural defects of asphalt pavement and cause many casualties and property damage. Therefore, accurate pothole detection is an important task in road surface maintenance. Many machine learning technologies are being introduced for pothole detection, and data preprocessing is required to increase the efficiency of deep learning models. In this paper, we propose a preprocessing method that emphasizes important textures and shapes in pothole datasets. The proposed preprocessing method uses intensity transformation to reduce unnecessary elements of the road and emphasize the texture and shape of the pothole. In addition, the feature of the porthole is detected using Superpixel and Sobel edge detection. Through performance comparison between the proposed preprocessing method and the existing preprocessing method, it is shown that the proposed preprocessing method is a more effective method than the existing method in detecting potholes.

A Noise Robust Speech Recognition Method Using Model Compensation Based on Speech Enhancement (음성 개선 기반의 모델 보상 기법을 이용한 강인한 잡음 음성 인식)

  • Shen, Guang-Hu;Jung, Ho-Youl;Chung, Hyun-Yeol
    • The Journal of the Acoustical Society of Korea
    • /
    • v.27 no.4
    • /
    • pp.191-199
    • /
    • 2008
  • In this paper, we propose a MWF-PMC noise processing method which enhances the input speech by using Mel-warped Wiener Filtering (MWF) at pre-processing stage and compensates the recognition model by using PMC (Parallel Model Combination) at post-processing stage for speech recognition in noisy environments. The PMC uses the residual noise extracted from the silence region of enhanced speech at pre-processing stage to compensate the clean speech model and thus this method is considered to improve the performance of speech recognition in noisy environments. For recognition experiments we dew.-sampled KLE PBW (Phoneme Balanced Words) 452 word speech data to 8kHz and made 5 different SNR levels of noisy speech, i.e., 0dB. 5dB, 10dB, 15dB and 20dB, by adding Subway, Car and Exhibition noise to clean speech. From the recognition results, we could confirm the effectiveness of the proposed MWF-PMC method by obtaining the improved recognition performances over all compared with the existing combined methods.

Wildfire-induced Change Detection Using Post-fire VHR Satellite Images and GIS Data (산불 발생 후 VHR 위성영상과 GIS 데이터를 이용한 산불 피해 지역 변화 탐지)

  • Chung, Minkyung;Kim, Yongil
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.5_3
    • /
    • pp.1389-1403
    • /
    • 2021
  • Disaster management using VHR (very high resolution) satellite images supports rapid damage assessment and also offers detailed information of the damages. However, the acquisition of pre-event VHR satellite images is usually limited due to the long revisit time of VHR satellites. The absence of the pre-event data can reduce the accuracy of damage assessment since it is difficult to distinguish the changed region from the unchanged region with only post-event data. To address this limitation, in this study, we conducted the wildfire-induced change detection on national wildfire cases using post-fire VHR satellite images and GIS (Geographic Information System) data. For GIS data, a national land cover map was selected to simulate the pre-fire NIR (near-infrared) images using the spatial information of the pre-fire land cover. Then, the simulated pre-fire NIR images were used to analyze bi-temporal NDVI (Normalized Difference Vegetation Index) correlation for unsupervised change detection. The whole process of change detection was performed on a superpixel basis considering the advantages of superpixels being able to reduce the complexity of the image processing while preserving the details of the VHR images. The proposed method was validated on the 2019 Gangwon wildfire cases and showed a high overall accuracy over 98% and a high F1-score over 0.97 for both study sites.