• Title/Summary/Keyword: incomplete data

검색결과 725건 처리시간 0.03초

분포 혼합비율의 모수추정을 위한 효율적인 알고리즘에 관한 연구 (A Study for Efficient EM Algorithms for Estimation of the Proportion of a Mixed Distribution)

  • 황강진;박경탁;유희경
    • 품질경영학회지
    • /
    • 제30권4호
    • /
    • pp.68-77
    • /
    • 2002
  • EM algorithm has good convergence rate for numerical procedures which converges on very small step. In the case of proportion estimation in a mixed distribution which has very big incomplete data or of update of new data continuously, however, EM algorithm highly depends on a initial value with slow convergence ratio. There have been many studies to improve the convergence rate of EM algorithm in estimating the proportion parameter of a mixed data. Among them, dynamic EM algorithm by Hurray Jorgensen and Titterington algorithm by D. M. Titterington are proven to have better convergence rate than the standard EM algorithm, when a new data is continuously updated. In this paper we suggest dynamic EM algorithm and Titterington algorithm for the estimation of a mixed Poisson distribution and compare them in terms of convergence rate by using a simulation method.

Improve object recognition using UWB SAR imaging with compressed sensing

  • Pham, The Hien;Hong, Ic-Pyo
    • 전기전자학회논문지
    • /
    • 제25권1호
    • /
    • pp.76-82
    • /
    • 2021
  • In this paper, the compressed sensing basic pursuit denoise algorithm adopted to synthetic aperture radar imaging is investigated to improve the object recognition. From the incomplete data sets for image processing, the compressed sensing algorithm had been integrated to recover the data before the conventional back- projection algorithm was involved to obtain the synthetic aperture radar images. This method can lead to the reduction of measurement events while scanning the objects. An ultra-wideband radar scheme using a stripmap synthetic aperture radar algorithm was utilized to detect objects hidden behind the box. The Ultra-Wideband radar system with 3.1~4.8 GHz broadband and UWB antenna were implemented to transmit and receive signal data of two conductive cylinders located inside the paper box. The results confirmed that the images can be reconstructed by using a 30% randomly selected dataset without noticeable distortion compared to the images generated by full data using the conventional back-projection algorithm.

A Network Partition Approach for MFD-Based Urban Transportation Network Model

  • Xu, Haitao;Zhang, Weiguo;zhuo, Zuozhang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권11호
    • /
    • pp.4483-4501
    • /
    • 2020
  • Recent findings identified the scatter and shape of MFD (macroscopic fundamental diagram) is heavily influenced by the spatial distribution of link density in a road network. This implies that the concept of MFD can be utilized to divide a heterogeneous road network with different degrees of congestion into multiple homogeneous subnetworks. Considering the actual traffic data is usually incomplete and inaccurate while most traffic partition algorithms rely on the completeness of the data, we proposed a three-step partitioned algorithm called Iso-MB (Isoperimetric algorithm - Merging - Boundary adjustment) permitting of incompletely input data in this paper. The proposed algorithm was implemented and verified in a simulated urban transportation network. The existence of well-defined MFD in each subnetwork was revealed and discussed and the selection of stop parameter in the isoperimetric algorithm was explained and dissected. The effectiveness of the approach to the missing input data was also demonstrated and elaborated.

Effects of Uncertain Spatial Data Representation on Multi-source Data Fusion: A Case Study for Landslide Hazard Mapping

  • Park No-Wook;Chi Kwang-Hoon;Kwon Byung-Doo
    • 대한원격탐사학회지
    • /
    • 제21권5호
    • /
    • pp.393-404
    • /
    • 2005
  • As multi-source spatial data fusion mainly deal with various types of spatial data which are specific representations of real world with unequal reliability and incomplete knowledge, proper data representation and uncertainty analysis become more important. In relation to this problem, this paper presents and applies an advanced data representation methodology for different types of spatial data such as categorical and continuous data. To account for the uncertainties of both categorical data and continuous data, fuzzy boundary representation and smoothed kernel density estimation within a fuzzy logic framework are adopted, respectively. To investigate the effects of those data representation on final fusion results, a case study for landslide hazard mapping was carried out on multi-source spatial data sets from Jangheung, Korea. The case study results obtained from the proposed schemes were compared with the results obtained by traditional crisp boundary representation and categorized continuous data representation methods. From the case study results, the proposed scheme showed improved prediction rates than traditional methods and different representation setting resulted in the variation of prediction rates.

EVALUATION OF AN ENHANCED WEATHER GENERATION TOOL FOR SAN ANTONIO CLIMATE STATION IN TEXAS

  • Lee, Ju-Young
    • Water Engineering Research
    • /
    • 제5권1호
    • /
    • pp.47-54
    • /
    • 2004
  • Several computer programs have been developed to make stochastically generated weather data from observed daily data. But they require fully dataset to run WGEN. Mostly, meterological data frequently have sporadic missing data as well as totally missing data. The modified WGEN has data filling algorithm for incomplete meterological datasets. Any other WGEN models have not the function of data filling. Modified WGEN with data filling algorithm is processing from the equation of Matalas for first order autoregressive process on a multi dimensional state with known cross and auto correlations among state variables. The parameters of the equation of Matalas are derived from existing dataset and derived parameters are adopted to fill data. In case of WGEN (Richardson and Wright, 1984), it is one of most widely used weather generators. But it has to be modified and added. It uses an exponential distribution to generate precipitation amounts. An exponential distribution is easier to describe the distribution of precipitation amounts. But precipitation data with using exponential distribution has not been expressed well. In this paper, generated precipitation data from WGEN and Modified WGEN were compared with corresponding measured data as statistic parameters. The modified WGEN adopted a formula of CLIGEN for WEPP (Water Erosion Prediction Project) in USDA in 1985. In this paper, the result of other parameters except precipitation is not introduced. It will be introduced through study of verification and review soon

  • PDF

K-NN과 최대 우도 추정법을 결합한 소프트웨어 프로젝트 수치 데이터용 결측값 대치법 (A Missing Data Imputation by Combining K Nearest Neighbor with Maximum Likelihood Estimation for Numerical Software Project Data)

  • 이동호;윤경아;배두환
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제36권4호
    • /
    • pp.273-282
    • /
    • 2009
  • 소프트웨어 프로젝트 데이터를 이용한 각종 분석 예측 모델 생성시 직면하는 문제 중 하나는 데이터에 포함된 결측값이며 이에 대한 효과적인 방안은 결측값 대치 법이다. 대표적인 결측값 대치법인 K 최근접 이웃 대치법은 대치과정에서 결측값을 포함하는 인스턴스의 관측정보를 활용하지 못한다는 단점이 있다. 본 연구에서는 이러한 단점을 극복하기 위해 K 최근접 이웃 대치법과 최대 우도 추정법을 결합한 새로운 소프트웨어 프로젝트 수치 데이터용 결측값 대치법을 제안한다. 또한 결측값 대치법의 정확도를 비교하기 위한 새로운 측도를 함께 제안한다.

무인주행차량을 위한 비포장 도로추적 (Adaptive and Recursive Tracking of Unpaved Roads)

  • 정홍;구본석
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 1999년도 가을 학술발표논문집 Vol.26 No.2 (2)
    • /
    • pp.548-550
    • /
    • 1999
  • 무인 주행 차량에 있어서, 포장 또는 비포장 도로의 시각적 추적은 매우 중요한 문제중의 하나이다. 따라서, 비디오 이미지로부터 비포장 도로를 추적할 수 있는 신속한 비젼 알고리즘의 개발이 필요하다. 이 논문에서는 칼만 필터와 EM(Expectation Maximization) 이론을 이용해 도로를 예측하고 시스템 파라미터를 갱신하는 방법을 제시한다. 시스템 파라미터, 도로 state, 도로 경계선, 그리고 모든 과거 데이터들을 각각 EM 파라미터, hidden data, incomplete data와 complete data로 정의함으로서 도로 state를 예측하고 시스템 파라미터를 추정할 수 있는 시간 회귀적 수식을 유도해 낼 수 있다. 이러한 방법을 이용하여 도로 state는 칼만 필터에 의해 매 프레임마다 예측되며, 시스템 파라미터들은 주기적으로 갱신되는 것이다. 결과적으로 이 방법은 주변환경과 날씨에 많은 영향을 받는 도로의 모양과 특징을 잘 찾아낼 수 있다. 또한 도로의 다음 state를 예측할 수 있는 점을 이용하면 계산량을 줄일 수 있으므로 실시간 구현에 용이하다. 이와 같은 방법으로 우리는 0.1 sec/frame 처리속도를 보장하는 도로추적 시스템을 구현하였다.

  • PDF

Neural network analysis of water pollution for a main river, Tamagawa, in Tokyo metropolis

  • Yuan, Yan;Kambe, Junko;Aoyama, T.;Nagashima, U.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.1078-1083
    • /
    • 2004
  • We proposed a method to compensate incomplete observations and made a study of environmental problem, water quality of Tama-River in Tokyo.The method is based on interpolations of the multi-layer neural networks. We call the approach as CQSAR method .which can compensate the defect data.The water quality data include defects which will give wrong effect to other normal data. The CQSAR method suppresses the wrong effect .Thus, we believe that the proposed CQSAR method has practical usability for environment examinations.

  • PDF

유지보수 영향을 고려한 배전계통 신뢰도 평가 (Reliability Evaluation of Power Distribution System Considering Maintenance Effects)

  • 문종필;손진근
    • 전기학회논문지P
    • /
    • 제59권2호
    • /
    • pp.154-157
    • /
    • 2010
  • In this paper, the Time-varying Failure Rates(TFR) of power distribution system components are extracted from the recorded failure data of KEPCO(Korea Electric Power Corporation) and the reliability of power distribution system is evaluated using Mean Failure Rate(MFR) and TFR. The TFR is approximated to bathtub curve using the exponential and Weibull distribution function. In addition, Kaplan-Meier estimation is applied to TFR extraction because of incomplete failure data of KEPCO. Also the reliability of the real power distribution system of Korea is evaluated using the MFR and TFR extracted from real failure data, respectively and the results of each case are compared with each other. As a result, it is proved that the reliability evaluation using the TFR is more realistic than MFR. In addition, it is presented that the application method at power distribution system maintenance and repair using the result of TFR.

Application of Joint Electro-Chemical Detection for Gas Insulated Switchgear Fault Diagnosis

  • Li, Liping;Tang, Ju;Liu, Yilu
    • Journal of Electrical Engineering and Technology
    • /
    • 제10권4호
    • /
    • pp.1765-1772
    • /
    • 2015
  • The integrity of the gas insulated switchgear (GIS) is vital to the safety of an entire power grid. However, there are some limitations on the techniques of detecting and diagnosing partial discharge (PD) induced by insulation defects in GIS. This paper proposes a joint electro-chemical detection method to resolve the problems of incomplete PD data source and also investigates a new unique fault diagnosis method to enhance the reliability of data processing. By employing ultra-high frequency method for online monitoring and the chemical method for detecting SF6 decomposition offline, the acquired data can form a more complete interpretation of PD signals. By utilizing DS evidence theory, the diagnostic results with tests on the four typical defects show the validity of the new fault diagnosis system. With higher accuracy and lower computation cost, the present research provides a promising way to make a more accurate decision in practical application.