• 제목/요약/키워드: kernel density estimation

검색결과 137건 처리시간 0.028초

A Nonparametric Approach for Noisy Point Data Preprocessing

  • Xi, Yongjian;Duan, Ye;Zhao, Hongkai
    • International Journal of CAD/CAM
    • /
    • 제9권1호
    • /
    • pp.31-36
    • /
    • 2010
  • 3D point data acquired from laser scan or stereo vision can be quite noisy. A preprocessing step is often needed before a surface reconstruction algorithm can be applied. In this paper, we propose a nonparametric approach for noisy point data preprocessing. In particular, we proposed an anisotropic kernel based nonparametric density estimation method for outlier removal, and a hill-climbing line search approach for projecting data points onto the real surface boundary. Our approach is simple, robust and efficient. We demonstrate our method on both real and synthetic point datasets.

A Case Study of an Activity Based Mathematical Education: A Kernel Density Estimation to Solve a Dilemma for a Missile Simulation

  • Kim, G. Daniel
    • 한국수학교육학회지시리즈E:수학교육논문집
    • /
    • 제16권
    • /
    • pp.139-147
    • /
    • 2003
  • While the statistical concept 'order statistics' has a great number of applications in our society ranging from industry to military analysis, it is not necessarily an easy concept to understand for many people. Adding some interesting simulation activities of this concept to the probability or statistics curriculum, however, can enhance the learning curve greatly. A hands-on and a graphic calculator based activities of a missile simulation were introduced by Kim(2003) in the context of order statistics. This article revisits the two activities in his paper and point out a dilemma that occurs from the violation of an assumption on two deviation parameters associated with the missile simulation. A third activity is introduced to resolve the dilemma in the terms of a kernel density estimation which is a nonparametric approach.

  • PDF

Improving Sample Entropy Based on Nonparametric Quantile Estimation

  • Park, Sang-Un;Park, Dong-Ryeon
    • Communications for Statistical Applications and Methods
    • /
    • 제18권4호
    • /
    • pp.457-465
    • /
    • 2011
  • Sample entropy (Vasicek, 1976) has poor performance, and several nonparametric entropy estimators have been proposed as alternatives. In this paper, we consider a piecewise uniform density function based on quantiles, which enables us to evaluate entropy in each interval, and study the poor performance of the sample entropy in terms of the poor estimation of lower and upper quantiles. Then we propose some improved entropy estimators by simply modifying the quantile estimators, and compare their performances with some existing estimators.

Lagged Cross-Correlation of Probability Density Functions and Application to Blind Equalization

  • Kim, Namyong;Kwon, Ki-Hyeon;You, Young-Hwan
    • Journal of Communications and Networks
    • /
    • 제14권5호
    • /
    • pp.540-545
    • /
    • 2012
  • In this paper, the lagged cross-correlation of two probability density functions constructed by kernel density estimation is proposed, and by maximizing the proposed function, adaptive filtering algorithms for supervised and unsupervised training are also introduced. From the results of simulation for blind equalization applications in multipath channels with impulsive and slowly varying direct current (DC) bias noise, it is observed that Gaussian kernel of the proposed algorithm cuts out the large errors due to impulsive noise, and the output affected by the DC bias noise can be effectively controlled by the lag ${\tau}$ intrinsically embedded in the proposed function.

움직임 인식응용을 위한 커널 밀도 추정 기반 학습용 데이터 증폭 기법 (Data Augmentation using a Kernel Density Estimation for Motion Recognition Applications)

  • 정우순;이형규
    • 한국산업정보학회논문지
    • /
    • 제27권4호
    • /
    • pp.19-27
    • /
    • 2022
  • 머신러닝(ML, Machine Learning)기반 응용에서의 인식성능은 적용된 모델의 종류와 크기, 학습환경 및 학습에 사용되는 데이터 등 다양한 요인에 따라 결정된다. 특히 학습에 사용되는 데이터가 충분치 않을 경우 인식성능이 저하되거나 과적합(Overfitting)등의 문제가 발생하기도 한다. 이미지 인식을 주요 대상으로 하는 기존 연구들은 학습을 위한 데이터셋이 풍부하고 검증된 데이터셋을 사용하여 학습 및 인식성능을 평가할 수 있다. 하지만 사용된 센서, 인식의 대상, 인식 상황이 다른 특정 응용들의 경우 데이터셋을 직접 구축해야 한다. 이런 경우, ML모델의 성능은 데이터의 양과 품질에 따라 달라진다. 본 논문에서는 이용 가능한 학습용 데이터가 충분치 않은 움직임 인식응용에 효율적으로 사용될 수 있는 비모수 추정 방식의 일종인 커널 밀도 추정 알고리즘을 사용하여 학습용 데이터를 증폭한 후, 사용된 커널의 종류에 따라, 원본 데이터의 수 및 증폭 비율에 따라 증폭된 데이터가 원본 데이터의 특징을 잘 반영하는지 인식 정확도 변화를 토대로 비교 분석한다. 실험결과, 본 연구에서 사용한 움직임 인식응용에서는 좁은 대역폭을 가진 Tophat 커널로 증폭된 데이터셋에서 최대 14.31%의 인식 정확도 향상을 확인하였다.

A Study on Goodness-of-fit Test for Density with Unknown Parameters

  • Hang, Changkon;Lee, Minyoung
    • Communications for Statistical Applications and Methods
    • /
    • 제8권2호
    • /
    • pp.483-497
    • /
    • 2001
  • When one fits a parametric density function to a data set, it is usually advisable to test the goodness of the postulated model. In this paper we study the nonparametric tests for testing the null hypothesis against general alternatives, when the null hypothesis specifies the density function up to unknown parameters. We modify the test statistic which was proposed by the first author and his colleagues. Asymptotic distribution of the modified statistic is derived and its performance is compared with some other tests through simulation.

  • PDF

Robustness of Minimum Disparity Estimators in Linear Regression Models

  • Pak, Ro-Jin
    • Journal of the Korean Statistical Society
    • /
    • 제24권2호
    • /
    • pp.349-360
    • /
    • 1995
  • This paper deals with the robustness properties of the minimum disparity estimation in linear regression models. The estimators defined as statistical quantities whcih minimize the blended weight Hellinger distance between a weighted kernel density estimator of the residuals and a smoothed model density of the residuals. It is shown that if the weights of the density estimator are appropriately chosen, the estimates of the regression parameters are robust.

  • PDF

영상에서의 배경추정알고리즘 성능 비교 (Performance Comparison of Background Estimation in the Video)

  • 도진규;김규영;박장식;김현태;유윤식
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 2011년도 춘계학술대회
    • /
    • pp.808-810
    • /
    • 2011
  • 입력영상에 대하여 전처리과정으로 배경을 분리하는 것이 영상처리 및 인식 성능에 중요한 영향을 준다. 본 논문에서는 화재검출을 위한 영상인식 전처리로 활용하는 다양한 배경추정 알고리즘에 대하여 계산량과 배경추정 성능 분석하였다. 비교하는 배경추정알고리즘은 Gaussian Running Average 추정기법, Mixture of Gaussian 모델, 그리고 KDE (kernel density estimate) 알고리즘에 대한 성능을 평가하였다. 입력영상에 대하여 배경영상차로부터 연기를 검출하는데 있어 KDE 알고리즘이 배경추정 성능은 우수한 것을 확인하였다.

  • PDF

확률밀도함수의 불연속점 추정을 위한 띠폭 선택 (Bandwidth selection for discontinuity point estimation in density)

  • 허집
    • Journal of the Korean Data and Information Science Society
    • /
    • 제23권1호
    • /
    • pp.79-87
    • /
    • 2012
  • Huh (2002)는 확률밀도함수가 하나의 불연속점을 가질 때, 한쪽방향커널함수를 이용하여 확률 밀도함수의 오른쪽과 왼쪽 커널추정량을 제시하여 그 차를 최대로 하는 점을 불연속점의 위치추정량으로 제안하였다. 커널추정량의 평활모수인 띠폭의 선택의 중요함은 익히 알려져 있다. 최대가능도 교차타당성은 확률밀도함수의 커널추정량에서 띠폭 선택의 기준으로 널리 쓰여지고 있다. 본 연구에서는 한쪽방향커널함수를 이용한 확률밀도함수의 오른쪽과 왼쪽 커널추정량들의 띠폭의 선택 방법을 Hart와 Yi (1998)의 한쪽방향교차타당성의 방법론을 최대가능도교차타당성에 적용하여 제안하고자 한다. 소표본 모의실험을 통하여 연구결과를 제시하고자 한다.

Monitoring the 2007 Florida east coast Karenia brevis (Dinophyceae) red tide and neurotoxic shellfish poisoning (NSP) event

  • Wolny, Jennifer L.;Scott, Paula S.;Tustison, Jacob;Brooks, Christopher R.
    • ALGAE
    • /
    • 제30권1호
    • /
    • pp.49-58
    • /
    • 2015
  • In September 2007, reports of respiratory irritation and fish kills were received by the Florida Fish and Wildlife Conservation Commission (FWC) from the Jacksonville, Florida area. Water samples collected in this area indicated a bloom of Karenia brevis, the dinoflagellate that produces brevetoxin, which can cause neurotoxic shellfish poisoning. For the next four months, K. brevis was found along approximately 400 km of coastal and Intracoastal waterways from Jacksonville to Jupiter Inlet. This event represents the longest and most extensive red tide the east coast of Florida has experienced and the first time Karenia species other than K. brevis have been reported in this area. This extensive red tide influenced commercial and recreational shellfish harvesting activities along Florida's east coast. Fourteen shellfish harvesting areas (SHAs) were monitored weekly during this event and 10 SHAs were closed for an average of 53 days due to this red tide. The length of SHA closure was dependent on the shellfish species present. Interagency cooperation in monitoring this K. brevis bloom was successful in mitigating any human health impacts. Kernel density estimation was used to create geographic extent maps to help extrapolate discreet sample data points into $5km^2$ radius values for better visualization of the bloom.