• Title/Summary/Keyword: noisy data

Search Result 421, Processing Time 0.026 seconds

CONTINUOUS DATA ASSIMILATION FOR THE THREE-DIMENSIONAL LERAY-α MODEL WITH STOCHASTICALLY NOISY DATA

  • Bui Kim, My;Tran Quoc, Tuan
    • Bulletin of the Korean Mathematical Society
    • /
    • v.60 no.1
    • /
    • pp.93-111
    • /
    • 2023
  • In this paper we study a nudging continuous data assimilation algorithm for the three-dimensional Leray-α model, where measurement errors are represented by stochastic noise. First, we show that the stochastic data assimilation equations are well-posed. Then we provide explicit conditions on the observation density (resolution) and the relaxation (nudging) parameter which guarantee explicit asymptotic bounds, as the time tends to infinity, on the error between the approximate solution and the actual solution which is corresponding to these measurements, in terms of the variance of the noise in the measurements.

Named entity recognition using transfer learning and small human- and meta-pseudo-labeled datasets

  • Kyoungman Bae;Joon-Ho Lim
    • ETRI Journal
    • /
    • v.46 no.1
    • /
    • pp.59-70
    • /
    • 2024
  • We introduce a high-performance named entity recognition (NER) model for written and spoken language. To overcome challenges related to labeled data scarcity and domain shifts, we use transfer learning to leverage our previously developed KorBERT as the base model. We also adopt a meta-pseudo-label method using a teacher/student framework with labeled and unlabeled data. Our model presents two modifications. First, the student model is updated with an average loss from both human- and pseudo-labeled data. Second, the influence of noisy pseudo-labeled data is mitigated by considering feedback scores and updating the teacher model only when below a threshold (0.0005). We achieve the target NER performance in the spoken language domain and improve that in the written language domain by proposing a straightforward rollback method that reverts to the best model based on scarce human-labeled data. Further improvement is achieved by adjusting the label vector weights in the named entity dictionary.

A Topological Derivative Based Non-Iterative Electromagnetic Imaging of Perfectly Conducting Cracks

  • Ma, Yong-Ki;Park, Won-Kwang
    • Journal of electromagnetic engineering and science
    • /
    • v.12 no.1
    • /
    • pp.128-134
    • /
    • 2012
  • In this manuscript, we consider electromagnetic imaging of perfectly conducting cracks completely hidden in a homogeneous material via boundary measurements. For this purpose, we carefully derive a topological derivative formula based on the asymptotic expansion formula for the existence of a perfectly conducting inclusion with a small radius. With this, we introduce a topological derivative based imaging algorithm and discuss its properties. Various numerical examples with noisy data show the effectiveness and limitations of the imaging algorithm.

Local Bandwidth Selection for Nonparametric Regression

  • Lee, Seong-Woo;Cha, Kyung-Joon
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.453-463
    • /
    • 1997
  • Nonparametric kernel regression has recently gained widespread acceptance as an attractive method for the nonparametric estimation of the mean function from noisy regression data. Also, the practical implementation of kernel method is enhanced by the availability of reliable rule for automatic selection of the bandwidth. In this article, we propose a method for automatic selection of the bandwidth that minimizes the asymptotic mean square error. Then, the estimated bandwidth by the proposed method is compared with the theoretical optimal bandwidth and a bandwidth by plug-in method. Simulation study is performed and shows satisfactory behavior of the proposed method.

  • PDF

Mobile Robot Navigation in an Indoor Environment

  • Choi, Sung-Yug;Lee, Jang-Myung
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.1456-1459
    • /
    • 2005
  • To compensate the drawbacks, a new localization method that estimates the global position of the mobile robot by using a camera set on ceiling in the corridor is proposed. This scheme is not a relative localization, which decreases the position error through algorithms with noisy sensor data. The effectiveness of the proposed localization scheme is demonstrated by the experiments.

  • PDF

Gear Inspection System using Vision System (비젼을 이용한 기어 형상 측정 시스템 개발)

  • 이일환;박희재
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1996.11a
    • /
    • pp.485-489
    • /
    • 1996
  • In this paper, an automatic gear inspection system has been developed using the computer aided vision system. Image processing and data analysis algorithms for gear inspection have been investigated and were shown to perform quickly with high accuracy. As a result, dimensions of a gear can be measured upto few micrometer size in real time. In addition, the system can be applied to a practical manufacturing process even under noisy conditions.

  • PDF

Fuzzy Techniques in Optimal Bit Allocation

  • Kong, Seong-Gon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1993.06a
    • /
    • pp.1313-1316
    • /
    • 1993
  • This paper presents a fuzzy system that estimates the optimal bit allocation matrices for the spatially active subimage classes of adaptive transform image coding in noisy channels. Transform image coding is good for image data compression but it requires a transmission error protection scheme to maintain the performance since the channel noise degrades its performance. The fuzzy system provides a simple way of estimating the bit allocation matrices from the optimal bit map computed by the method of minimizing the mean square error between the transform coefficients of the original and the reconstructed images.

  • PDF

ICA+OPCA for Artifact-Robust Classification of EEG (ICA+OPCA를 이용한 잡음에 강인한 뇌파 분류)

  • Park, Sungcheol;Lee, Hyekyoung;Park, Seungjin
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2003.10b
    • /
    • pp.739-741
    • /
    • 2003
  • Electroencephalogram (EEG)-based brain computer interface (BCI) provides a new communication channel between human brain and computer. EEG is very noisy data and contains artifacts, thus the extraction of features that are robust to noise and artifacts is important. In this paper we present a method with employ both independent component analysis (ICA) and oriented principal component analysis (OPCA) for artifact-robust feature extraction.

  • PDF

Robust Cross Validation Score

  • Park, Dong-Ryeon
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.413-423
    • /
    • 2005
  • Consider the problem of estimating the underlying regression function from a set of noisy data which is contaminated by a long tailed error distribution. There exist several robust smoothing techniques and these are turned out to be very useful to reduce the influence of outlying observations. However, no matter what kind of robust smoother we use, we should choose the smoothing parameter and relatively less attention has been made for the robust bandwidth selection method. In this paper, we adopt the idea of robust location parameter estimation technique and propose the robust cross validation score functions.

Valve Model Extraction from Noisy 3-D Point Cloud Data (잡음이 있는 3차원 점군 정보에서의 밸브 모형 추출)

  • Oh, Ki-Won;Choi, Kang-Sun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2015.04a
    • /
    • pp.945-946
    • /
    • 2015
  • Laser Range Finder를 이용하여 생성한 3차원 점군 정보는 단면적인 부분만 볼 수 있으며, 잡음이 포함되어 작은 물체를 추출하는데 많은 영향이 생긴다. 이러한 잡음이 있는 3차원 점군 정보 사이에서 밸브의 중심의 위치에 대한 추가적인 입력을 받아 원환체, 원통, 평면의 정보를 복합적으로 포함하고 있는 밸브의 모델을 추출한다.