• Title/Summary/Keyword: Hidden Markov model

Search Result 639, Processing Time 0.059 seconds

Light Weight Korean Morphological Analysis Using Left-longest-match-preference model and Hidden Markov Model (좌최장일치법과 HMM을 결합한 경량화된 한국어 형태소 분석)

  • Kang, Sangwoo;Yang, Jaechul;Seo, Jungyun
    • Korean Journal of Cognitive Science
    • /
    • v.24 no.2
    • /
    • pp.95-109
    • /
    • 2013
  • With the rapid evolution of the personal device environment, the demand for natural language applications is increasing. This paper proposes a morpheme segmentation and part-of-speech tagging model, which provides the first step module of natural language processing for many languages; the model is designed for mobile devices with limited hardware resources. To reduce the number of morpheme candidates in morphological analysis, the proposed model uses a method that adds highly possible morpheme candidates to the original outputs of a conventional left-longest-match-preference method. To reduce the computational cost and memory usage, the proposed model uses a method that simplifies the process of calculating the observation probability of a word consisting of one or more morphemes in a conventional hidden Markov model.

  • PDF

New Machine Condition Diagnosis Method Not Requiring Fault Data Using Continuous Hidden Markov Model (결함 데이터를 필요로 하지 않는 연속 은닉 마르코프 모델을 이용한 새로운 기계상태 진단 기법)

  • Lee, Jong-Min;Hwang, Yo-Ha
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.21 no.2
    • /
    • pp.146-153
    • /
    • 2011
  • Model based machine condition diagnosis methods are generally using a normal and many failure models which need sufficient data to train the models. However, data, especially for failure modes of interest, is very hard to get in real applications. So their industrial applications are either severely limited or impossible when the failure models cannot be trained. In this paper, continuous hidden Markov model(CHMM) with only a normal model has been suggested as a very promising machine condition diagnosis method which can be easily used for industrial applications. Generally hidden Markov model also uses many pattern models to recognize specific patterns and the recognition results of CHMM show the likelihood trend of models. By observing this likelihood trend of a normal model, it is possible to detect failures. This method has been successively applied to arc weld defect diagnosis. The result shows CHMM's big potential as a machine condition monitoring method.

A Study on Classification of Heart Sounds Using Hidden Markov Models (Hidden Markov Model을 이용한 심음분류에 관한 연구)

  • Kim Hee-Keun;Chung Young-Joo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.25 no.3
    • /
    • pp.144-150
    • /
    • 2006
  • Clinicians usually use stethoscopic auscultation for the diagnosis of heart diseases. However, the heart sound signal has varying characteristics due to the noise and/or the conditions of the patients. Also, it is not easy for junior clinicians to find the acoustical differences between different kinds or heart sound signals. which may result in errors in the diagnosis. Thus it will be quite useful for the clinicians to make use of an automatic classification system using signal processing techniques. In this paper, we propose to use hidden Markov models in stead of artificial neural networks which have been conventionally used for the automatic classification of heart sounds. In the experiments classifying heart sound signals. we could see that the proposed methods were quite successful in the classification accuracy.

HMM Based Endpoint Detection for Speech Signals

  • Lee Yonghyung;Oh Changhyuck
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2001.11a
    • /
    • pp.75-76
    • /
    • 2001
  • An endpoint detection method for speech signals utilizing hidden Markov model(HMM) is proposed. It turns out that the proposed algorithm is quite satisfactory to apply isolated word speech recognition.

  • PDF

Appropriate identification of optimum number of hidden states for identification of extreme rainfall using Hidden Markov Model: Case study in Colombo, Sri Lanka

  • Chandrasekara, S.S.K.;Kwon, Hyun-Han
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2019.05a
    • /
    • pp.390-390
    • /
    • 2019
  • Application of Hidden Markov Model (HMM) to the hydrological time series would be an innovative way to identify extreme rainfall events in a series. Even though the optimum number of hidden states can be identify based on maximizing the log-likelihood or minimizing Bayesian information criterion. However, occasionally value for the log-likelihood keep increasing with the state which gives false identification of the optimum hidden state. Therefore, this study attempts to identify optimum number of hidden states for Colombo station, Sri Lanka as fundamental approach to identify frequency and percentage of extreme rainfall events for the station. Colombo station consisted of daily rainfall values between 1961 and 2015. The representative station is located at the wet zone of Sri Lanka where the major rainfall season falls on May to September. Therefore, HMM was ran for the season of May to September between 1961 and 2015. Results showed more or less similar log-likelihood which could be identified as maximum for states between 4 to 7. Therefore, measure of central tendency (i.e. mean, median, mode, standard deviation, variance and auto-correlation) for observed and simulated daily rainfall series was carried to each state to identify optimum state which could give statistically compatible results. Further, the method was applied for the second major rainfall season (i.e. October to February) for the same station as a comparison.

  • PDF

A hidden Markov model for long term drought forecasting in South Korea

  • Chen, Si;Shin, Ji-Yae;Kim, Tae-Woong
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2015.05a
    • /
    • pp.225-225
    • /
    • 2015
  • Drought events usually evolve slowly in time and their impacts generally span a long period of time. This indicates that the sequence of drought is not completely random. The Hidden Markov Model (HMM) is a probabilistic model used to represent dependences between invisible hidden states which finally result in observations. Drought characteristics are dependent on the underlying generating mechanism, which can be well modelled by the HMM. This study employed a HMM with Gaussian emissions to fit the Standardized Precipitation Index (SPI) series and make multi-step prediction to check the drought characteristics in the future. To estimate the parameters of the HMM, we employed a Bayesian model computed via Markov Chain Monte Carlo (MCMC). Since the true number of hidden states is unknown, we fit the model with varying number of hidden states and used reversible jump to allow for transdimensional moves between models with different numbers of states. We applied the HMM to several stations SPI data in South Korea. The monthly SPI data from January 1973 to December 2012 was divided into two parts, the first 30-year SPI data (January 1973 to December 2002) was used for model calibration and the last 10-year SPI data (January 2003 to December 2012) for model validation. All the SPI data was preprocessed through the wavelet denoising and applied as the visible output in the HMM. Different lead time (T= 1, 3, 6, 12 months) forecasting performances were compared with conventional forecasting techniques (e.g., ANN and ARMA). Based on statistical evaluation performance, the HMM exhibited significant preferable results compared to conventional models with much larger forecasting skill score (about 0.3-0.6) and lower Root Mean Square Error (RMSE) values (about 0.5-0.9).

  • PDF