• 제목/요약/키워드: statistical correction

검색결과 304건 처리시간 0.023초

문맥의존 철자오류 후보 생성을 위한 통계적 언어모형 개선 (Improved Statistical Language Model for Context-sensitive Spelling Error Candidates)

  • 이정훈;김민호;권혁철
    • 한국멀티미디어학회논문지
    • /
    • 제20권2호
    • /
    • pp.371-381
    • /
    • 2017
  • The performance of the statistical context-sensitive spelling error correction depends on the quality and quantity of the data for statistical language model. In general, the size and quality of data in a statistical language model are proportional. However, as the amount of data increases, the processing speed becomes slower and storage space also takes up a lot. We suggest the improved statistical language model to solve this problem. And we propose an effective spelling error candidate generation method based on a new statistical language model. The proposed statistical model and the correction method based on it improve the performance of the spelling error correction and processing speed.

고해상도 지상 기온 상세화 모델 개발 (Development of a High-Resolution Near-Surface Air Temperature Downscale Model)

  • 이두일;이상현;정형세;김연희
    • 대기
    • /
    • 제31권5호
    • /
    • pp.473-488
    • /
    • 2021
  • A new physical/statistical diagnostic downscale model has been developed for use to improve near-surface air temperature forecasts. The model includes a series of physical and statistical correction methods that account for un-resolved topographic and land-use effects as well as statistical bias errors in a low-resolution atmospheric model. Operational temperature forecasts of the Local Data Assimilation and Prediction System (LDAPS) were downscaled at 100 m resolution for three months, which were used to validate the model's physical and statistical correction methods and to compare its performance with the forecasts of the Korea Meteorological Administration Post-processing (KMAP) system. The validation results showed positive impacts of the un-resolved topographic and urban effects (topographic height correction, valley cold air pool effect, mountain internal boundary layer formation effect, urban land-use effect) in complex terrain areas. In addition, the statistical bias correction of the LDAPS model were efficient in reducing forecast errors of the near-surface temperatures. The new high-resolution downscale model showed better agreement against Korean 584 meteorological monitoring stations than the KMAP, supporting the importance of the new physical and statistical correction methods. The new physical/statistical diagnostic downscale model can be a useful tool in improving near-surface temperature forecasts and diagnostics over complex terrain areas.

통계적 문맥의존 철자오류 교정 기법의 향상을 위한 지역적 문서 정보의 활용 (The Utilization of Local Document Information to Improve Statistical Context-Sensitive Spelling Error Correction)

  • 이정훈;김민호;권혁철
    • 정보과학회 컴퓨팅의 실제 논문지
    • /
    • 제23권7호
    • /
    • pp.446-451
    • /
    • 2017
  • 본 논문에서의 문맥의존 철자오류(Context-Sensitive Spelling Error) 교정 기법은 샤논(Shannon)의 노이지 채널 모형(noisy channel model)을 기반으로 한다. 논문에서 제안하는 교정 기법의 향상에는 보간(interpolation)을 사용하며, 일반적인 보간 방법은 확률의 중간 값을 채우는 방식으로 N-gram에 존재하지 않는 빈도를 (N-1)-gram과 (N-2)-gram 등에서 얻는다. 이와 같은 방식은 동일 통계 말뭉치를 기반으로 계산하는데 제안하는 방식에서는 통계 말뭉치와 교정 문서간의 빈도 정보를 이용하여 보간 한다. 교정 문서의 빈도를 이용하였을 때 이점은 다음과 같다. 첫째 통계 말뭉치에 존재하지 않고 교정 문서에서만 나타나는 신조어의 확률을 얻을 수 있다. 둘째 확률 값이 모호한 두 교정 후보가 있더라도 교정 문서를 참고로 교정하게 되어 모호성을 해소한다. 제안한 방법은 기존 교정 모형보다 정밀도와 재현율의 성능향상을 보였다.

Statistical Correction of Numerical Model Forecasts for Typhoon Tracks

  • Sohn, Keon-Tae
    • Communications for Statistical Applications and Methods
    • /
    • 제12권2호
    • /
    • pp.295-304
    • /
    • 2005
  • This paper concentrates on the prediction of typhoon tracks using the dynamic linear model (DLM) for the statistical correction of the numerical model guidance used in the JMA. The DLM with proposed forecast strategy is applied to reduce their systematic errors using the latest observation. All parameters of the DLM are updated dynamically and backward forecasting is performed to remove the effect of initial values.

다차로도로의 서비스수준 분석을 위한 속도보정계수 개선에 관한 연구 (New Speed Adjustment Factor for Analyzing Level of Service at Multi-Lane Highway)

  • 김원길;강원의;노창균;박범진
    • 한국도로학회논문집
    • /
    • 제14권6호
    • /
    • pp.167-173
    • /
    • 2012
  • PURPOSES : This study is to develop speed correction factor for more realistic Level-of-Service(LOS) at multilane highway. METHODS : In this study, we compared speed difference the degree of speed reductions in actual multilane road conditions with speed reduction considering speed correction factor presented in highway capacity manual using statistical techniques. And also we presents new speed correction factor analyzing collected data at national highway No.1 (Goyang~Wolrung). RESULTS : The result of analyzing and comparing new suggested speed correction factor with speed correction factor in Korea Highway Capacity Manual (KHCM) shows RMSE (Root Mean Square Error) in new speed correction factor (RMSE 1.5) is much lower than existing speed correction factor (RMSE 13.4). New suggested speed correction can be used for analyzing Level-of-Service at multilane highway. And also we suggests improvements for analysis procedure in analyzing Level-of-Service at multilane highway CONCLUSIONS : As a result of comparing differences, we draw the causes that effect the differences in speed and suggest new speed correction factor that consider traffic volumes. It can be more rational because it uses speed correction factor which can consider more realistic traffic conditions, etc.

EFFICIENT ESTIMATION OF THE COINTEGRATING VECTOR IN ERROR CORRECTION MODELS WITH STATIONARY COVARIATES

  • Seo, Byeong-Seon
    • Journal of the Korean Statistical Society
    • /
    • 제34권4호
    • /
    • pp.345-366
    • /
    • 2005
  • This paper considers the cointegrating vector estimator in the error correction model with stationary covariates, which combines the stationary vector autoregressive model and the nonstationary error correction model. The cointegrating vector estimator is shown to follow the locally asymptotically mixed normal distribution. The variance of the estimator depends on the co­variate effect of stationary regressors, and the asymptotic efficiency improves as the magnitude of the covariate effect increases. An economic application of the money demand equation is provided.

Statistical Atmospheric Correction of Lake Surface Temperature from Landsat Thermal Images

  • Han, Hyang-Sun;Lee, Hoon-Yol
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2005년도 Proceedings of ISRS 2005
    • /
    • pp.418-421
    • /
    • 2005
  • In this study, we analyzed surface temperature of lakes in the Han River system, using Landsat-5 and -7 time-series images. Surface temperature was extracted using NASA equation and compared with in situ 10m-depth temperature in Lake Soyang and surface temperature on five other dam lakes downstream. The 24 images out of 29 showed standard deviation of temperature difference less than $2^{\circ}C$, to which a novel statistical atmospheric correction could be applied. The correlation coefficients were 0.950 at Lake Soyang and 0.979-0.997 at the other lakes after atmospheric correction.

  • PDF