• Title/Summary/Keyword: Similar Data

Search Result 9,166, Processing Time 0.04 seconds

Evaluation for usefulness of Chukwookee Data in Rainfall Frequency Analysis (강우빈도해석에서의 측우기자료의 유용성 평가)

  • Kim, Kee-Wook;Yoo, Chul-Sang;Park, Min-Kyu;Kim, Dae-Ha;Park, Sangh-Young;Kim, Hyeon-Jun
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2007.05a
    • /
    • pp.1526-1530
    • /
    • 2007
  • In this study, the chukwookee data were evaluated by applying that for the historical rainfall frequency analysis. To derive a two parameter log-normal distribution by using historical data and modern data, censored data MLE and binomial censored data MLE were applied. As a result, we found that both average and standard deviation were all estimated smaller with chukwookee data then those with only modern data. This indicates that rather big events rarely happens during the period of chukwookee data then during the modern period. The frequency analysis results using the parameters estimated were also similar to those expected. The point to be noticed is that the rainfall quantiles estimated by both methods were similar, especially for the 99% threshold. This result indicates that the historical document records like the annals of Chosun dynasty could be valuable and effective for the frequency analysis. This also means the extension of data available for frequency analysis.

  • PDF

Nonlinear Canonical Correlation Analysis for Paralysis Disease Data

  • Shin, Yang-Kyu
    • Journal of the Korean Data and Information Science Society
    • /
    • v.15 no.3
    • /
    • pp.515-521
    • /
    • 2004
  • Categorical data are mostly found in oriental medical research. The nonlinear canonical correlation analysis does not assume an interval level of measurement. In this paper, we apply nonlinear canonical correlation analysis to quantification and explain how similar sets of variables are to one another for paralysis disease data.

  • PDF

Visualization Algorithm for Similarity Connection based on Data Transmutability (데이터 변형성 기반 유사성 연결을 위한 시각화 알고리즘)

  • Kim, Boon-Hee
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.9 no.11
    • /
    • pp.1249-1254
    • /
    • 2014
  • Big data based on numerous data made by the people are used in order to obtain useful information. We can obtain more useful information if it can apply machine learning techniques added deformation of human memory on the characteristics of the computer program. And big data is predicted by using these conclusions. Humans are used to remember similar data as an original data, so big data processing technology should reflect these human characteristics. In this study, this algorithm to provide the selectivity of information is proposed. This algorithm is the technology to reflect the above factors. This algorithm is selected the data with high selectivity to determine similar data based on the deformation characteristics of the data.

A study on the ordering of PIM family similarity measures without marginal probability (주변 확률을 고려하지 않는 확률적 흥미도 측도 계열 유사성 측도의 서열화)

  • Park, Hee Chang
    • Journal of the Korean Data and Information Science Society
    • /
    • v.26 no.2
    • /
    • pp.367-376
    • /
    • 2015
  • Today, big data has become a hot keyword in that big data may be defined as collection of data sets so huge and complex that it becomes difficult to process by traditional methods. Clustering method is to identify the information in a big database by assigning a set of objects into the clusters so that the objects in the same cluster are more similar to each other clusters. The similarity measures being used in the cluster analysis may be classified into various types depending on the nature of the data. In this paper, we computed upper and lower limits for probability interestingness measure based similarity measures without marginal probability such as Yule I and II, Michael, Digby, Baulieu, and Dispersion measure. And we compared these measures by real data and simulated experiment. By Warrens (2008), Coefficients with the same quantities in the numerator and denominator, that are bounded, and are close to each other in the ordering, are likely to be more similar. Thus, results on bounds provide means of classifying various measures. Also, knowing which coefficients are similar provides insight into the stability of a given algorithm.

A Comparison of the Cancer Incidence Rates between the National Cancer Registry and Insurance Claims Data in Korea

  • Seo, Hee Jung;Oh, In-Hwan;Yoon, Seok-Jun
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.13 no.12
    • /
    • pp.6163-6168
    • /
    • 2012
  • Although much health services research has been conducted using national health insurance claims data in Korea, the validity of this method has not been ascertained. The objective of this study was to validate the use of claims data for health services research by comparing incidence rate of cancers found using insurance claims data against rates of the national cancer registry of Korea. An algorithm to estimate incidence rates using claims data was developed and applied. The claims data from 2005-2008 were acquired and the patients admitted to hospitals due to cancer in 2008 without admission to hospital from 2005-2007 by the same diagnosis code were regarded as incident cases. The acquired results were compared with the values from the National Cancer Registry of Korea. The incidence rate of all cancers found using claims data was 363.1 per 100,000 people, which is very similar to the 361.9 per 100,000 rate of the national cancer registry. Also the age-, gender- and disease-specific rates between the two data sources were similar. Therefore, national health insurance claims data may be a worthwhile resource for health services research if appropriate algorithms are applied, especially considering the cost effectiveness of this method.

A Study on Training Data Selection Method for EEG Emotion Analysis using Semi-supervised Learning Algorithm (준 지도학습 알고리즘을 이용한 뇌파 감정 분석을 위한 학습데이터 선택 방법에 관한 연구)

  • Yun, Jong-Seob;Kim, Jin Heon
    • Journal of IKEEE
    • /
    • v.22 no.3
    • /
    • pp.816-821
    • /
    • 2018
  • Recently, machine learning algorithms based on artificial neural networks started to be used widely as classifiers in the field of EEG research for emotion analysis and disease diagnosis. When a machine learning model is used to classify EEG data, if training data is composed of only data having similar characteristics, classification performance may be deteriorated when applied to data of another group. In this paper, we propose a method to construct training data set by selecting several groups of data using semi-supervised learning algorithm to improve these problems. We then compared the performance of the two models by training the model with a training data set consisting of data with similar characteristics to the training data set constructed using the proposed method.

Speech Verification using Similar Word Information in Isolated Word Recognition (고립단어 인식에 유사단어 정보를 이용한 단어의 검증)

  • 백창흠;이기정홍재근
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.1255-1258
    • /
    • 1998
  • Hidden Markov Model (HMM) is the most widely used method in speech recognition. In general, HMM parameters are trained to have maximum likelihood (ML) for training data. This method doesn't take account of discrimination to other words. To complement this problem, this paper proposes a word verification method by re-recognition of the recognized word and its similar word using the discriminative function between two words. The similar word is selected by calculating the probability of other words to each HMM. The recognizer haveing discrimination to each word is realized using the weighting to each state and the weighting is calculated by genetic algorithm.

  • PDF

A Table Integration Technique Using Query Similarity Analysis

  • Choi, Go-Bong;Woo, Yong-Tae
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.3
    • /
    • pp.105-112
    • /
    • 2019
  • In this paper, we propose a technique to analyze similarity between SQL queries and to assist integrating similar tables. First, the table information was extracted from the SQL queries through the query structure analyzer, and the similarity between the tables was measured using the Jacquard index technique. Then, similar table clusters are generated through hierarchical cluster analysis method and the co-occurence probability of the table used in the query is calculated. The possibility of integrating similar tables is classified by using the possibility of co-occurence of similarity table and table, and classifying them into an integrable cluster, a cluster requiring expert review, and a cluster with low integration possibility. This technique analyzes the SQL query in practice and analyse the possibility of table integration independent of the existing business, so that the existing schema can be effectively reconstructed without interruption of work or additional cost.

Finding the optimal frequency for trade and development of system trading strategies in futures market using dynamic time warping (선물시장의 시스템트레이딩에서 동적시간와핑 알고리즘을 이용한 최적매매빈도의 탐색 및 거래전략의 개발)

  • Lee, Suk-Jun;Oh, Kyong-Joo
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.2
    • /
    • pp.255-267
    • /
    • 2011
  • The aim of this study is to utilize system trading for making investment decisions and use technical analysis and Dynamic Time Warping (DTW) to determine similar patterns in the frequency of stock data and ascertain the optimal timing for trade. The study will examine some of the most common patterns in the futures market and use DTW in terms of their frequency (10, 30, 60 minutes, and daily) to discover similar patterns. The recognized similar patterns were verified by executing trade simulation after applying specific strategies to the technical indicators. The most profitable strategies among the set of strategies applied to common patterns were again applied to the similar patterns and the results from DTW pattern recognition were examined. The outcome produced useful information on determining the optimal timing for trade by using DTW pattern recognition through system trading, and by applying distinct strategies depending on data frequency.

The Potential of Satellite SAR Imagery for Mapping of Flood Inundation

  • Lee, Kyu-Sung;Hong, Chang-Hee;Kim, Yoon-Hyoung
    • Proceedings of the KSRS Conference
    • /
    • 1998.09a
    • /
    • pp.128-133
    • /
    • 1998
  • To assess the flood damages and to provide necessary information for preventing future catastrophe, it is necessary to appraise the inundated area with more accurate and rapid manner. This study attempts to evaluate the potential of satellite synthetic aperture radar (SAR) data for mapping of flood inundated area in southern part of Korea. JERS L-band SAR data obtained during the summer of 1997 were used to delineate the inundated areas. In addition, Landsat TM data were also used for analyzing the land cover condition before the flooding. Once the two data sets were co-registered, each data was separately classified. The water surface areas extracted from the SAR data and the land cover map generated using the TM data were overlaid to determine the flood inundated areas. Although manual interpretation of water surfaces from the SAR image seems rather simple, the computer classification of water body requires clear understanding of radar backscattering behavior on the earth's surfaces. It was found that some surface features, such as rice fields, runaway, and tidal flat, have very similar radar backscatter to water surface. Even though satellite SAR data have a great advantage over optical remote sensor data for obtaining imagery on time and would provide valuable information to analyze flood, it should be cautious to separate the exact areas of flood inundation from the similar features.

  • PDF