• Title/Summary/Keyword: contingency table analysis

Search Result 57, Processing Time 0.023 seconds

Effect of Market Basket Size on the Accuracy of Association Rule Measures (장바구니 크기가 연관규칙 척도의 정확성에 미치는 영향)

  • Kim, Nam-Gyu
    • Asia pacific journal of information systems
    • /
    • v.18 no.2
    • /
    • pp.95-114
    • /
    • 2008
  • Recent interests in data mining result from the expansion of the amount of business data and the growing business needs for extracting valuable knowledge from the data and then utilizing it for decision making process. In particular, recent advances in association rule mining techniques enable us to acquire knowledge concerning sales patterns among individual items from the voluminous transactional data. Certainly, one of the major purposes of association rule mining is to utilize acquired knowledge in providing marketing strategies such as cross-selling, sales promotion, and shelf-space allocation. In spite of the potential applicability of association rule mining, unfortunately, it is not often the case that the marketing mix acquired from data mining leads to the realized profit. The main difficulty of mining-based profit realization can be found in the fact that tremendous numbers of patterns are discovered by the association rule mining. Due to the many patterns, data mining experts should perform additional mining of the results of initial mining in order to extract only actionable and profitable knowledge, which exhausts much time and costs. In the literature, a number of interestingness measures have been devised for estimating discovered patterns. Most of the measures can be directly calculated from what is known as a contingency table, which summarizes the sales frequencies of exclusive items or itemsets. A contingency table can provide brief insights into the relationship between two or more itemsets of concern. However, it is important to note that some useful information concerning sales transactions may be lost when a contingency table is constructed. For instance, information regarding the size of each market basket(i.e., the number of items in each transaction) cannot be described in a contingency table. It is natural that a larger basket has a tendency to consist of more sales patterns. Therefore, if two itemsets are sold together in a very large basket, it can be expected that the basket contains two or more patterns and that the two itemsets belong to mutually different patterns. Therefore, we should classify frequent itemset into two categories, inter-pattern co-occurrence and intra-pattern co-occurrence, and investigate the effect of the market basket size on the two categories. This notion implies that any interestingness measures for association rules should consider not only the total frequency of target itemsets but also the size of each basket. There have been many attempts on analyzing various interestingness measures in the literature. Most of them have conducted qualitative comparison among various measures. The studies proposed desirable properties of interestingness measures and then surveyed how many properties are obeyed by each measure. However, relatively few attentions have been made on evaluating how well the patterns discovered by each measure are regarded to be valuable in the real world. In this paper, attempts are made to propose two notions regarding association rule measures. First, a quantitative criterion for estimating accuracy of association rule measures is presented. According to this criterion, a measure can be considered to be accurate if it assigns high scores to meaningful patterns that actually exist and low scores to arbitrary patterns that co-occur by coincidence. Next, complementary measures are presented to improve the accuracy of traditional association rule measures. By adopting the factor of market basket size, the devised measures attempt to discriminate the co-occurrence of itemsets in a small basket from another co-occurrence in a large basket. Intensive computer simulations under various workloads were performed in order to analyze the accuracy of various interestingness measures including traditional measures and the proposed measures.

Estimation of Log-Odds Ratios for Incomplete $2{\times}2$ Tables with Covariates using FEFI

  • Kang, Shin-Soo;Bae, Je-Min
    • Journal of the Korean Data and Information Science Society
    • /
    • v.18 no.1
    • /
    • pp.185-194
    • /
    • 2007
  • The information of covariates are available to do fully efficient fractional imputation(FEFI). The new method, FEFI with logistic regression is proposed to construct complete contingency tables. Jackknife method is used to get a standard errors of log-odds ratio from the completed table by the new method. Simulation results, when covariates have more information about categorical variables, reveal that the new method provides more efficient estimates of log-odds ratio than either multiple imputation(MI) based on data augmentation or complete case analysis.

  • PDF

Analysis of Preferences Based on Purchasing Frequencies and Recognitions of Sizing System for Female Garments (여성복의 구매빈도에 의한 선호도 및 치수 시스템 인지도에 관한 분석)

  • Koo, Hee-Kyung
    • Journal of the Korea Fashion and Costume Design Association
    • /
    • v.13 no.1
    • /
    • pp.125-134
    • /
    • 2011
  • The research is a survey and analysis of female apparel preferences, and recognition of the KS sizing system for adult female garments. The practical surveys in this research are examined by total number of subjects, 200 women who are living in Seoul, South Korea. The homogeneity test using Chi-square statistics, and the analysis of frequencies and ratios of contingency tables were performed with the data which are classified by age, education level, income level and housing modalities. The findings in this study are as follows: 1. Women's preferences for purchasing female garments indicate significant differences between subjects, such as age, education level, income level and housing modalities. Moreover, the following five types of adult female garments were analyzed in this study: upper garment, lower garment, one-piece apparel, sportswear and sleepwear. The results of the preference study show an indirect understanding of the KSK 0051 classification system for subjects of the survey. Therefore the preference study can be used as a pilot study for the sizing recognition survey. 2. Women's recognition of the KSK 0051 sizing system for adult female adult garments do not indicate significant differences based on the characteristics of age, education level, income level and housing modalities. The low recognition of the KS sizing system is due to too many details and complex numbers of application for users. Therefore, the sizing system should be simplified and rearranged to be more effective and have more recognizable categories.

  • PDF

Identification of Factors Affecting the Occurrence of Temporal Patterns of Rainfall in Gamcheon Watershed (감천유역에 대한 강우양상 발생 영향인자의 규명 및 해석)

  • Ahn, Ki-Hong;Cho, Wan-Hee;Han, Kun-Yeun
    • Journal of the Korean Society of Hazard Mitigation
    • /
    • v.9 no.2
    • /
    • pp.77-85
    • /
    • 2009
  • In South Korea, seasonal, local and temporal climatic characteristics are variable in rainfall patterns. To design or assess the reliability of hydrosystem, information about the rainfall event under consideration is important. In this process, the complete description of a design storm involves the specification of rainfall duration, depth, and its temporal pattern. Generally, to use an appropriate temporal pattern for a design storm is of great importance in the design and evaluation of hydrological safety for hydrosystem. For purpose of selecting of factors affecting the occurrence of rainfall patterns, Huff's dimensionless method was executed and examined by statistical contingency tables analysis through which the inter-dependence of the occurrence frequency of rainfall patterns with respect to geographical location, rainfall duration and depth, and seasonality is investigated. This analysis result can be used to establish flood policies and to design or assess the reliability of hydrosystem.

GIS-based Spatial Integration and Statistical Analysis using Multiple Geoscience Data Sets : A Case Study for Mineral Potential Mapping (다중 지구과학자료를 이용한 GIS 기반 공간통합과 통계량 분석 : 광물 부존 예상도 작성을 위한 사례 연구)

  • 이기원;박노욱;권병두;지광훈
    • Korean Journal of Remote Sensing
    • /
    • v.15 no.2
    • /
    • pp.91-105
    • /
    • 1999
  • Spatial data integration using multiple geo-based data sets has been regarded as one of the primary GIS application issues. As for this issue, several integration schemes have been developed as the perspectives of mathematical geology or geo-mathematics. However, research-based approaches for statistical/quantitative assessments between integrated layer and input layers are not fully considered yet. Related to this niche point, in this study, spatial data integration using multiple geoscientific data sets by known integration algorithms was primarily performed. For spatial integration by using raster-based GIS functionality, geological, geochemical, geophysical data sets, DEM-driven data sets and remotely sensed imagery data sets from the Ogdong area were utilized for geological thematic mapping related by mineral potential mapping. In addition, statistical/quantitative information extraction with respective to relationships among used data sets and/or between each data set and integrated layer was carried out, with the scope of multiple data fusion and schematic statistical assessment methodology. As for the spatial integration scheme, certainty factor (CF) estimation and principal component analysis (PCA) were applied. However, this study was not aimed at direct comparison of both methodologies; whereas, for the statistical/quantitative assessment between integrated layer and input layers, some statistical methodologies based on contingency table were focused. Especially, for the bias reduction, jackknife technique was also applied in PCA-based spatial integration. Through the statistic analyses with respect to the integration information in this case study, new information for relationships of integrated layer and input layers was extracted. In addition, influence effects of input data sets with respect to integrated layer were assessed. This kind of approach provides a decision-making information in the viewpoint of GIS and is also exploratory data analysis in conjunction with GIS and geoscientific application, especially handing spatial integration or data fusion with complex variable data sets.

The Analysis of Audit Results in Steel Outfit Industry to Comply with ISO 9000:2000 (ISO 9000:2000 대응을 위한 철의장품 심사결과 분석)

  • Kim, Ho-Gyun;Park, Dong-Jun;Jung, Hyun-Suk
    • IE interfaces
    • /
    • v.14 no.2
    • /
    • pp.198-204
    • /
    • 2001
  • The ISO 9000 family of international quality management standards were revised on 15 December 2000. The ISO 9001:2000 standard is used for certification/registration and contractual purposes by organizations seeking recognition of their quality management system(QMS). We summarize key contents changed in ISO 9000:2000 family standards. To comply with ISO 9001:2000, we analyze the current QMS for steel outfit industry, using audit results from ISO 9001:1994 for seven steel outfit firms during last three years. We investigate statistical relationships between ISO 9001:2000 and ISO 9001:1994 requirements from a three dimensional contingency table with audit results. We observe that the importance of requirements of the ISO 9001:2000 sections makes a difference between companies.

  • PDF

An Application of Canonical Analysis on the Distribution of Lichens in Mt. Duckyuoo (덕유산 지의식물 분포에 대한 정준분석법의 적용연구)

  • Park, Seung Tai
    • The Korean Journal of Ecology
    • /
    • v.9 no.3
    • /
    • pp.135-147
    • /
    • 1986
  • The simplification and the searching trends of complex data which assumed relationship between predictor variables and object variables are one of primary objective of ecological research. This study was aimed to apply cononical analysis consisting of canonical correlation analysis and canonical variate analysis related to lichen vegetation and several environmental variables which are elevation, height on grond, exposure side and cover values. Data collected from the Duckyoo National Park in August 1985. Lichen species was ranked by eqivocation information theory with cover values. Canonical correlation analysis was applied to one data set both set both environmental variables and lichem family. In order to make two sets of data matrix the scale of position vector ordination was calculated from the vector scalar product for lichen species. Canonical variate analysis was applied to rearranged data which was made by interval class code for environmental variables. The sharpness values was calculated in frequency of cotingency tables and the dispersion profiles of each species in classes of environmental variables was designed to extract component values based on the decomposition of expected frequencies in contingency table. The results of canonical correlation analysis revealed canonical first correlation value 0.815(89%), and second correlation value 0.083(11%). Significance test showed that the hypothesis of joint mutuallity of canonical correlation is accepted (P>0.05). The relation between canonical score of vegetation variables and that of environmental variable indicated linear tendency.

  • PDF

An Analysis of Teachers' Knowledge about Correlation - Focused on Two-Way Tables - (상관관계에 대한 교사 지식 분석 - 2×2 분할표를 중심으로 -)

  • Shin, Bomi
    • School Mathematics
    • /
    • v.19 no.3
    • /
    • pp.461-480
    • /
    • 2017
  • The aim of this study was to analyze characteristics of teachers' knowledge about correlation with data presented in $2{\times}2$ tables. In order to achieve the aim, this study conducted didactical analysis about two-way tables through examining previous researches and developed a questionnaire with reference to the results of the analysis. The questionnaire was given to 53 middle and high school teachers and qualitative methods were used to analyze the data obtained from the written responses by the participants. This study also elaborated the framework descriptors for interpreting the teachers' responses in the light of the didactical analysis and the data was elucidated in terms of this framework. The specific features of teachers' knowledge about correlation with data presented in $2{\times}2$ tables were categorized into three types as a result. This study raised several implications for teachers' professional development for effective mathematics instruction about correlation and related concepts dealt with in probability and statistics.

Forecasting of Seasonal Inflow to Reservoir Using Multiple Linear Regression (다중선형회귀분석에 의한 계절별 저수지 유입량 예측)

  • Kang, Jaewon
    • Journal of Environmental Science International
    • /
    • v.22 no.8
    • /
    • pp.953-963
    • /
    • 2013
  • Reliable long-term streamflow forecasting is invaluable for water resource planning and management which allocates water supply according to the demand of water users. Forecasting of seasonal inflow to Andong dam is performed and assessed using statistical methods based on hydrometeorological data. Predictors which is used to forecast seasonal inflow to Andong dam are selected from southern oscillation index, sea surface temperature, and 500 hPa geopotential height data in northern hemisphere. Predictors are selected by the following procedure. Primary predictors sets are obtained, and then final predictors are determined from the sets. The primary predictor sets for each season are identified using cross correlation and mutual information. The final predictors are identified using partial cross correlation and partial mutual information. In each season, there are three selected predictors. The values are determined using bootstrapping technique considering a specific significance level for predictor selection. Seasonal inflow forecasting is performed by multiple linear regression analysis using the selected predictors for each season, and the results of forecast using cross validation are assessed. Multiple linear regression analysis is performed using SAS. The results of multiple linear regression analysis are assessed by mean squared error and mean absolute error. And contingency table is established and assessed by Heidke skill score. The assessment reveals that the forecasts by multiple linear regression analysis are better than the reference forecasts.

Quantitative Assessment of Input and Integrated Information in GIS-based Multi-source Spatial Data Integration: A Case Study for Mineral Potential Mapping

  • Kwon, Byung-Doo;Chi, Kwang-Hoon;Lee, Ki-Won;Park, No-Wook
    • Journal of the Korean earth science society
    • /
    • v.25 no.1
    • /
    • pp.10-21
    • /
    • 2004
  • Recently, spatial data integration for geoscientific application has been regarded as an important task of various geoscientific applications of GIS. Although much research has been reported in the literature, quantitative assessment of the spatial interrelationship between input data layers and an integrated layer has not been considered fully and is in the development stage. Regarding this matter, we propose here, methodologies that account for the spatial interrelationship and spatial patterns in the spatial integration task, namely a multi-buffer zone analysis and a statistical analysis based on a contingency table. The main part of our work, the multi-buffer zone analysis, was addressed and applied to reveal the spatial pattern around geological source primitives and statistical analysis was performed to extract information for the assessment of an integrated layer. Mineral potential mapping using multi-source geoscience data sets from Ogdong in Korea was applied to illustrate application of this methodology.