• 제목/요약/키워드: learning distribution

검색결과 966건 처리시간 0.027초

A New Incremental Learning Algorithm with Probabilistic Weights Using Extended Data Expression

  • Yang, Kwangmo;Kolesnikova, Anastasiya;Lee, Won Don
    • Journal of information and communication convergence engineering
    • /
    • 제11권4호
    • /
    • pp.258-267
    • /
    • 2013
  • New incremental learning algorithm using extended data expression, based on probabilistic compounding, is presented in this paper. Incremental learning algorithm generates an ensemble of weak classifiers and compounds these classifiers to a strong classifier, using a weighted majority voting, to improve classification performance. We introduce new probabilistic weighted majority voting founded on extended data expression. In this case class distribution of the output is used to compound classifiers. UChoo, a decision tree classifier for extended data expression, is used as a base classifier, as it allows obtaining extended output expression that defines class distribution of the output. Extended data expression and UChoo classifier are powerful techniques in classification and rule refinement problem. In this paper extended data expression is applied to obtain probabilistic results with probabilistic majority voting. To show performance advantages, new algorithm is compared with Learn++, an incremental ensemble-based algorithm.

SVM 기반 Bagging과 OoD 탐색을 활용한 제조공정의 불균형 Dataset에 대한 예측모델의 성능향상 (Boosting the Performance of the Predictive Model on the Imbalanced Dataset Using SVM Based Bagging and Out-of-Distribution Detection)

  • 김종훈;오하영
    • 정보처리학회논문지:소프트웨어 및 데이터공학
    • /
    • 제11권11호
    • /
    • pp.455-464
    • /
    • 2022
  • 제조업의 공정에서 생성되는 데이터셋은 크게 두 가지 특징을 가진다. 타겟 클래스의 심각한 불균형과 지속적인 Out-of-Distribution(OoD) 샘플의 발생이다. 클래스 불균형은 SMOTE 및 다양한 샘플링 전략을 통해서 대응할 수 있다. 그러나, OoD 탐색은 현재까지 인공신경망 영역에서만 다뤄져 왔다. OoD 탐색의 적용이 가능한 인공신경망은 제조공정 데이터셋에 대해서 만족스러운 성능을 발현하지 못한다. 원인은 제조공정의 데이터셋이 인공신경망에서 일반적으로 다루는 이미지, 텍스트 데이터셋과 비교해서 크기가 매우 작고, 노이즈가 심하다는 것이다. 또한 인공신경망의 과적합(overfitting) 문제도 제조업 데이터셋에서 인공신경망의 성능을 저하하는 원인으로 지적된다. 이에 현재까지 시도된 바 없는 SVM 알고리즘과 OoD 탐색의 접목을 시도하였다. 또한 예측모델의 정밀도 향상을 위해 배깅(Bagging) 알고리즘을 모델링에 반영하였다.

소재부품 중소기업 수출성과의 선행요인 경로 및 사회적 자본의 조절효과 분석 (An Analysis on Antecedents Path of Export Performance and Moderating Effects of Social Capital in Materials and Components SMEs)

  • 원동환
    • 유통과학연구
    • /
    • 제14권2호
    • /
    • pp.135-144
    • /
    • 2016
  • Purpose - The purpose of this paper is to empirically investigate the moderating effects of social capital on antecedents factors path of export performance in the materials and components SMEs(Small and Medium-sized Enterprises) of Busan and Kyungnam region. In case of materials and components SMEs, they are always trying to achieve business performance including export sales and market share, but it is difficult for them to increase performance due to the limitation of inner & tangible resources. Therefore intangible asset such as technology capability and its antecedents factors which are technology innovation and learning orientation are getting more important to SMEs. In addition, it is supposed that social capital such as local network including distribution channel in overseas market plays an essential role to enhance export performance. Accordingly, the main goal of this study is to find out the relationship between export performance and antecedents factors and the validity of social capital as a moderating valuable. Research design, data, and methodology - Technology innovation, learning orientation and technology capability have been used as antecedents factors for export performance and social capital such as network diversity and intensity has been used for moderating effects analysis. In order to select these valuables mentioned above, this study examined the existing researches on a basis of Resources Based View, Organizational Learning Theory and Social Capital theory. To achieve the objective of this paper, 7 hypotheses including the moderating effects have been proposed with 6 potential variables measured by 24 questions. The survey was carried out from December 2014 to March 2015 and 137 samples out of total 175 were selected for the analysis. PLS(Partial Least Squares) has been used for the methodology of empirical analysis for both antecedents factors path and moderating effects. Results - Research findings are as follows. First, technology innovation has a significant impact on learning orientation, learning orientation has a positive effect on the technology capability and technology capability also has a significant impact on export performance. Therefore 3 valuables are proved as antecedents factors of export performance. Second, the social capital(both network diversity and intensity) plays a moderating role with learning orientation to technology capability. However, there is no moderating effects between both of social capital and technology capability regarding export performance. Conclusions - According to path analysis results, it is suggested that the materials and components SMEs should raise technology innovation and learning orientation in order to improve technology capability and export performance. Meantime, the moderating effect analysis shows that SMEs should consider local network diversity and intensity along with learning orientation to add up technology capability. But local network diversity and intensity does not work systematically with technology capability for export performance and it means that SMEs should find the appropriate local partners for the purpose of establishing concrete distribution channels based on marketing perspective, not for improving technology capability.

Learning Probabilistic Kernel from Latent Dirichlet Allocation

  • Lv, Qi;Pang, Lin;Li, Xiong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제10권6호
    • /
    • pp.2527-2545
    • /
    • 2016
  • Measuring the similarity of given samples is a key problem of recognition, clustering, retrieval and related applications. A number of works, e.g. kernel method and metric learning, have been contributed to this problem. The challenge of similarity learning is to find a similarity robust to intra-class variance and simultaneously selective to inter-class characteristic. We observed that, the similarity measure can be improved if the data distribution and hidden semantic information are exploited in a more sophisticated way. In this paper, we propose a similarity learning approach for retrieval and recognition. The approach, termed as LDA-FEK, derives free energy kernel (FEK) from Latent Dirichlet Allocation (LDA). First, it trains LDA and constructs kernel using the parameters and variables of the trained model. Then, the unknown kernel parameters are learned by a discriminative learning approach. The main contributions of the proposed method are twofold: (1) the method is computationally efficient and scalable since the parameters in kernel are determined in a staged way; (2) the method exploits data distribution and semantic level hidden information by means of LDA. To evaluate the performance of LDA-FEK, we apply it for image retrieval over two data sets and for text categorization on four popular data sets. The results show the competitive performance of our method.

The Impact of State Financial Support on Active-Collaborative Learning Activities and Faculty-Student Interaction

  • Choi, Eun-Mee;Park, Young-Sool;Kwon, Lee-Seung
    • 산경연구논집
    • /
    • 제10권2호
    • /
    • pp.25-37
    • /
    • 2019
  • Purpose - The goal of this study is to analyze the differences in education performances between students of the government's financial support program and those who do not receive support at a local university in Korea. Research design, data, and methodology - The questionnaire used was NASEL. NASEL is considered a highly suitable survey tool for professors, courses, and performances in Korean universities. The 290 students who participated and 44 students do not participate in the financial support program were surveyed for 10 days. The characteristics of students were investigated by frequency analysis and technical statistics. The analysis of student collective characteristics used independent t and f-tests,and one-way ANOVA with IBM SPSS Statistics 22.0 for statistical purposes. Results - The p-value of the group receiving financial support and the group without financial support in active-collaborative learning is 0.167. The p-value of the economically supported group and the non-supported group of the faculty-student interaction is 0.281. The confidence coefficient of the active-collaborative learning questionnaire is 0.861. The reliability coefficient of the questionnaire for the faculty-student interaction questionnaire is 0.871. Conclusions - There are no clear differences in active-collaborative learning and faculty-student interaction between participating and non-participating students in the economic program.

비지도 학습 기법을 사용한 RF 위협의 분포 분석 (Analysis on the Distribution of RF Threats Using Unsupervised Learning Techniques)

  • 김철표;노상욱;박소령
    • 한국군사과학기술학회지
    • /
    • 제19권3호
    • /
    • pp.346-355
    • /
    • 2016
  • In this paper, we propose a method to analyze the clusters of RF threats emitting electrical signals based on collected signal variables in integrated electronic warfare environments. We first analyze the signal variables collected by an electronic warfare receiver, and construct a model based on variables showing the properties of threats. To visualize the distribution of RF threats and reversely identify them, we use k-means clustering algorithm and self-organizing map (SOM) algorithm, which are belonging to unsupervised learning techniques. Through the resulting model compiled by k-means clustering and SOM algorithms, the RF threats can be classified into one of the distribution of RF threats. In an experiment, we measure the accuracy of classification results using the algorithms, and verify the resulting model that could be used to visually recognize the distribution of RF threats.

배전 선로 부하예측 모델의 신뢰성 평가를 위한 비교 검증 시스템 (Development of Comparative Verification System for Reliability Evaluation of Distribution Line Load Prediction Model)

  • Lee, Haesung;Lee, Byung-Sung;Moon, Sang-Keun;Kim, Junhyuk;Lee, Hyeseon
    • KEPCO Journal on Electric Power and Energy
    • /
    • 제7권1호
    • /
    • pp.115-123
    • /
    • 2021
  • Through machine learning-based load prediction, it is possible to prevent excessive power generation or unnecessary economic investment by estimating the appropriate amount of facility investment in consideration of the load that will increase in the future or providing basic data for policy establishment to distribute the maximum load. However, in order to secure the reliability of the developed load prediction model in the field, the performance comparison verification between the distribution line load prediction models must be preceded, but a comparative performance verification system between the distribution line load prediction models has not yet been established. As a result, it is not possible to accurately determine the performance excellence of the load prediction model because it is not possible to easily determine the likelihood between the load prediction models. In this paper, we developed a reliability verification system for load prediction models including a method of comparing and verifying the performance reliability between machine learning-based load prediction models that were not previously considered, verification process, and verification result visualization methods. Through the developed load prediction model reliability verification system, the objectivity of the load prediction model performance verification can be improved, and the field application utilization of an excellent load prediction model can be increased.

Improve the Performance of Semi-Supervised Side-channel Analysis Using HWFilter Method

  • Hong Zhang;Lang Li;Di Li
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제18권3호
    • /
    • pp.738-754
    • /
    • 2024
  • Side-channel analysis (SCA) is a cryptanalytic technique that exploits physical leakages, such as power consumption or electromagnetic emanations, from cryptographic devices to extract secret keys used in cryptographic algorithms. Recent studies have shown that training SCA models with semi-supervised learning can effectively overcome the problem of few labeled power traces. However, the process of training SCA models using semi-supervised learning generates many pseudo-labels. The performance of the SCA model can be reduced by some of these pseudo-labels. To solve this issue, we propose the HWFilter method to improve semi-supervised SCA. This method uses a Hamming Weight Pseudo-label Filter (HWPF) to filter the pseudo-labels generated by the semi-supervised SCA model, which enhances the model's performance. Furthermore, we introduce a normal distribution method for constructing the HWPF. In the normal distribution method, the Hamming weights (HWs) of power traces can be obtained from the normal distribution of power points. These HWs are filtered and combined into a HWPF. The HWFilter was tested using the ASCADv1 database and the AES_HD dataset. The experimental results demonstrate that the HWFilter method can significantly enhance the performance of semi-supervised SCA models. In the ASCADv1 database, the model with HWFilter requires only 33 power traces to recover the key. In the AES_HD dataset, the model with HWFilter outperforms the current best semi-supervised SCA model by 12%.

소매 노하우의 국제이전에 관한 연구 : 7-Eleven 사례를 중심으로 (A Study on the International Transfer of Retail Know-how: A Case of 7-Eleven)

  • 김현철
    • 한국유통학회지:유통연구
    • /
    • 제13권4호
    • /
    • pp.1-19
    • /
    • 2008
  • 본 논문에서는 학습조직이론을 바탕으로 소매 노하우의 국제이전을 사례연구를 통하여 검토하였다. 연구의 대상으로서는 세계적인 편의점 체인인 7-Eleven을 선정하여 그 노하우가 어떻게 일본에 성공적으로 이전되었는지를 정성적으로 분석하였다. 분석결과 편의점 노하우의 국제이전에 있어서는 본질학습과 적응학습이 대단히 중요한 역할을 하였다. 본질학습의 내용으로는 편의점의 기본컨셉트와 점포운영 기본3원칙, 최저이익보증제도, 이익배분방식이 있었으며 적응학습의 내용으로는 출점방식과 점포규모, 점포입지, 상품구성 등과 같은 소매믹스가 있었다. 또한 적응학습에는 가설검증방식이라는 학습방법론이 사용되었으며 이 방식을 계속적으로 적용한 결과 경쟁기업이 모방하기 힘든 혁신을 이룩하였다. 다만 본질학습에서 학습한 내용이 적응학습에 원칙과 방향을 제시해 주었다. 이처럼 본질학습과 적응학습이 서로 맞물려 잘 이루어져야 소매 노하우의 국제이전은 성공할 수 있는 것이다.

  • PDF

Asymmetric Semi-Supervised Boosting Scheme for Interactive Image Retrieval

  • Wu, Jun;Lu, Ming-Yu
    • ETRI Journal
    • /
    • 제32권5호
    • /
    • pp.766-773
    • /
    • 2010
  • Support vector machine (SVM) active learning plays a key role in the interactive content-based image retrieval (CBIR) community. However, the regular SVM active learning is challenged by what we call "the small example problem" and "the asymmetric distribution problem." This paper attempts to integrate the merits of semi-supervised learning, ensemble learning, and active learning into the interactive CBIR. Concretely, unlabeled images are exploited to facilitate boosting by helping augment the diversity among base SVM classifiers, and then the learned ensemble model is used to identify the most informative images for active learning. In particular, a bias-weighting mechanism is developed to guide the ensemble model to pay more attention on positive images than negative images. Experiments on 5000 Corel images show that the proposed method yields better retrieval performance by an amount of 0.16 in mean average precision compared to regular SVM active learning, which is more effective than some existing improved variants of SVM active learning.