• Title/Summary/Keyword: Data Correction

Search Result 2,499, Processing Time 0.027 seconds

Improved Statistical Language Model for Context-sensitive Spelling Error Candidates (문맥의존 철자오류 후보 생성을 위한 통계적 언어모형 개선)

  • Lee, Jung-Hun;Kim, Minho;Kwon, Hyuk-Chul
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.2
    • /
    • pp.371-381
    • /
    • 2017
  • The performance of the statistical context-sensitive spelling error correction depends on the quality and quantity of the data for statistical language model. In general, the size and quality of data in a statistical language model are proportional. However, as the amount of data increases, the processing speed becomes slower and storage space also takes up a lot. We suggest the improved statistical language model to solve this problem. And we propose an effective spelling error candidate generation method based on a new statistical language model. The proposed statistical model and the correction method based on it improve the performance of the spelling error correction and processing speed.

Automatic Spelling Correction for Efficient Data Base Production and Information Retrieval (효율적(效率的)인 데이터베이스 제작(製作)과 정보검색(精報檢索)을 위한 자동철자교정(自動綴字校正))

  • Kim, Byung-Hye
    • Journal of Information Management
    • /
    • v.21 no.1
    • /
    • pp.76-92
    • /
    • 1990
  • This paper discusses automatic spelling correction in a point of view bibliographic Data Base production and information retrieval. Types of commonly detected spelling errors and impact of spelling errors in bibliographic data bases are described here. Document normalization, spelling verification, spelling correction and user interface for general construction of automatic spelling correction systems are described.

  • PDF

Analysis of error correction capability and recording density of an optical disc system with LDPC code (LDPC 코드를 적용한 광 디스크 시스템의 에러 정정 성능 및 기록 용량 분석)

  • 김기현;김현정;이윤우
    • Proceedings of the IEEK Conference
    • /
    • 2003.11a
    • /
    • pp.537-540
    • /
    • 2003
  • In this paper, we evaluated error correction performance and recording density of an optical disc system. The performance of Low-Density Parity Check code (LDPC) is compared to the HD-DVD (BD) ECC. The recording density of optical disc can be increased by reducing the redundancy of the user data. Moreover, since the correction capability of LDPC with decreased redundancy is better than that of BD, the recording density can also be increased by reducing the mark length of the data on the disc surface.

  • PDF

A Relative Atomspheric Correction Methods for Water Quality Factors Extraction from Landsat TM data (Landsat TM data로부터 수질인자 추출을 위한 상대적 대기 보정 방법)

  • Yang, In-Tae;Kim, Eung-Nam;Choi, Youn-Kwan
    • Journal of Industrial Technology
    • /
    • v.18
    • /
    • pp.17-25
    • /
    • 1998
  • Recently, there are a lot of studies to use a satellite image data in order to investigate a simultaneous change of a wide range area as a lake. However, many cases of a water quality research occur as problem when we try to extract the water quality factors from the satellite image data, because of the atmosphere scattering exert as bad influence on a result of analysis. In this study, and attempt was made to select the relative atmospheric correction method for the water quality factors extraction from the satellite image data. And also, the time-series analysis of the water quality factors extraction from the satellite image data. And also, the time-series analysis of the water quality factors was performed by using the multi-temporal image data.

  • PDF

NON-UNIFORMITY CORRECTION- SYSTEM ANALYSIS FOR MULTI-SPECTRAL CAMERA

  • Park Jong-Euk;Kong Jong-Pil;Heo Haeng-Pal;Kim Young Sun;Chang Young Jun
    • Proceedings of the KSRS Conference
    • /
    • 2005.10a
    • /
    • pp.478-481
    • /
    • 2005
  • The PMU (Payload Management Unit) is the main subsystem for the management, control and power supply of the MSC (Multi-Spectral Camera) Payload operation. It is the most important function for the electro-optical camera system that performs the Non-Uniformity Correction (NUC) function of the raw imagery data, rearranges the data from the CCD (Charge Coupled Device) detector and output it to the Data Compression and Storage Unit (DCSU). The NUC board in PMU performs it. In this paper, the NUC board system is described in terms of the configuration and the function, the efficiency for non-uniformity correction, and the influence of the data compression upon the peculiar feature of the CCD pixel. The NUC board is an image-processing unit within the PMU that receives video data from the CEV (Camera Electronic Unit) boards via a hotlinkand performs non-uniformity corrections upon the pixels according to commands received from the SBC (Single Board Computer) in the PMU. The lossy compression in DCSU needs the NUC in on-orbit condition.

  • PDF

Application of Convolutional Neural Networks (CNN) for Bias Correction of Satellite Precipitation Products (SPPs) in the Amazon River Basin

  • Alena Gonzalez Bevacqua;Xuan-Hien Le;Giha Lee
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.159-159
    • /
    • 2023
  • The Amazon River basin is one of the largest basins in the world, and its ecosystem is vital for biodiversity, hydrology, and climate regulation. Thus, understanding the hydrometeorological process is essential to the maintenance of the Amazon River basin. However, it is still tricky to monitor the Amazon River basin because of its size and the low density of the monitoring gauge network. To solve those issues, remote sensing products have been largely used. Yet, those products have some limitations. Therefore, this study aims to do bias corrections to improve the accuracy of Satellite Precipitation Products (SPPs) in the Amazon River basin. We use 331 rainfall stations for the observed data and two daily satellite precipitation gridded datasets (CHIRPS, TRMM). Due to the limitation of the observed data, the period of analysis was set from 1st January 1990 to 31st December 2010. The observed data were interpolated to have the same resolution as the SPPs data using the IDW method. For bias correction, we use convolution neural networks (CNN) combined with an autoencoder architecture (ConvAE). To evaluate the bias correction performance, we used some statistical indicators such as NSE, RMSE, and MAD. Hence, those results can increase the quality of precipitation data in the Amazon River basin, improving its monitoring and management.

  • PDF

Bias-correction of Dual Polarization Radar rainfall using Convolutional Autoencoder

  • Jung, Sungho;Le, Xuan Hien;Oh, Sungryul;Kim, Jeongyup;Lee, GiHa
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.166-166
    • /
    • 2020
  • Recently, As the frequency of localized heavy rains increases, the use of high-resolution radar data is increasing. The produced radar rainfall has still gaps of spatial and temporal compared to gauge observation rainfall, and in many studies, various statistical techniques are performed for correct rainfall. In this study, the precipitation correction of the S-band Dual Polarization radar in use in the flood forecast was performed using the ConvAE algorithm, one of the Convolutional Neural Network. The ConvAE model was trained based on radar data sets having a 10-min temporal resolution: radar rainfall data, gauge rainfall data for 790minutes(July 2017 in Cheongju flood event). As a result of the validation of corrected radar rainfall were reduced gaps compared to gauge rainfall and the spatial correction was also performed. Therefore, it is judged that the corrected radar rainfall using ConvAE will increase the reliability of the gridded rainfall data used in various physically-based distributed hydrodynamic models.

  • PDF

Electrostatic Coupling Intra-Body Communication Based on Frequency Shift Keying and Error Correction (FSK 통신 및 에러 정정을 통한 Intra-Body Communication)

  • Cho, Seongho;Park, Daejin
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.15 no.4
    • /
    • pp.159-166
    • /
    • 2020
  • The IBC (Intra-Body Communication) benefits from a wireless communication system for exchanging various kinds of digital information through wearable electronic devices and sensors. The IBC using the human body as the transmission channel allows wireless communication without the transmitting radio frequency waves to the air. This paper discusses the results of experiments on electrostatic coupling IBC based on FSK (Frequency Shift Keying) and 1 bit error correction. We implemented FSK communication and 1 bit error correction algorithm using the MCU boards and aluminum tape electrodes. The transmitter modulates digital data using 50% duty square wave as carrier signal and transmits data through human body. The receiver performs ADC (Analog to Digital Conversion) on carrier signal from human body. In order to figure out the frequency of carrier signal from ADC results, we applied zero-crossing algorithm which is used to detect the edge characteristic in computer vision. Experiment results shows that digital data modulated as square wave can be successfully transmitted through human body by applying the proposed architecture of a 1ch GPIO as a transmitter and 1ch ADC for as a receiver. Also, this paper proposes 1 bit error correction technique for reliable IBC. This technique performs error correction by utilizing the feature that carrier signal has 50% duty ratio. When 1 bit error correction technique is applied, the byte error rate at receiver side is improved around 3.5% compared to that not applied.

Precise Terrain Torrection for Gravity Measurement Considering the Earth's Curvature (지구 곡률을 고려한 중력의 정밀 지형보정)

  • Choi, Kwang-Sun;Lee, Young-Cheol;Lim, Mu-Taek
    • Journal of the Korean earth science society
    • /
    • v.28 no.7
    • /
    • pp.825-837
    • /
    • 2007
  • The researchers compiled two sets of digital terrain data released by NORI (National Oceanographic Research Institute, Korea) and NIMA (National Imagery and Mapping Agency, USA) respectively and analyzed a new set of $3"{\times}3"$ gridded terrain data in order to calculate terrain correction value in gravity in and around the Korean Peninsula. Using this new set of terrain data, the researchers developed an effective algorithm to calculate precise terrain correction value in gravity considering Earth's curvature and coded a fortran program to evaluate terrain correction value covering the surface of which the radius reaches up to 166.735 km. The researchers also calculated terrain correction value over the southern part of Korea. According to the statistics of terrain correction value calculated in and around the Korean Peninsula up to 166.735 km of surface radius, the maximum value soars to 56.508 mGal and the mean value is 4.539 mGal.

Establishment of Geometric Correction Data using LANDSAT Satellite Images over the Korean Peninsular (한반도지역 LANDSAT 위성영상의 기하보정 데이터 구축)

  • Yoon, Geun-Won;Park, Jeong-Ho;Chae, Gee-Ju;Park, Jong-Hyun
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.6 no.1
    • /
    • pp.98-106
    • /
    • 2003
  • Because satellite images have the advantage of high resolution, multi-spectral, revisit and wide swath characteristics, it is increased to utilize satellite image and get information little by little in nowadays. In order to utilize remote sensed images effectively, it is necessary to process satellite images through many processing steps. Among them, geometric correction is essential step for satellite image processing. In this study, we constructed geometric correction data using LANDSAT satellite images. First, we extracted GCPs from maps and constructed database over the Korean peninsular. Second, LANDSAT satellite images, 165 scenes were corrected geometrically using GCP database. Finally, we made 7 mosaic images by means of geometric correction images over Korean peninsular. We think that constructed geometric correction data will be used for many application fields as basic data.

  • PDF