• Title/Summary/Keyword: Bias problem

Search Result 345, Processing Time 0.026 seconds

Tri-training algorithm based on cross entropy and K-nearest neighbors for network intrusion detection

  • Zhao, Jia;Li, Song;Wu, Runxiu;Zhang, Yiying;Zhang, Bo;Han, Longzhe
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.12
    • /
    • pp.3889-3903
    • /
    • 2022
  • To address the problem of low detection accuracy due to training noise caused by mislabeling when Tri-training for network intrusion detection (NID), we propose a Tri-training algorithm based on cross entropy and K-nearest neighbors (TCK) for network intrusion detection. The proposed algorithm uses cross-entropy to replace the classification error rate to better identify the difference between the practical and predicted distributions of the model and reduce the prediction bias of mislabeled data to unlabeled data; K-nearest neighbors are used to remove the mislabeled data and reduce the number of mislabeled data. In order to verify the effectiveness of the algorithm proposed in this paper, experiments were conducted on 12 UCI datasets and NSL-KDD network intrusion datasets, and four indexes including accuracy, recall, F-measure and precision were used for comparison. The experimental results revealed that the TCK has superior performance than the conventional Tri-training algorithms and the Tri-training algorithms using only cross-entropy or K-nearest neighbor strategy.

A Novel on Auto Imputation and Analysis Prediction Model of Data Missing Scope based on Machine Learning (머신러닝기반의 데이터 결측 구간의 자동 보정 및 분석 예측 모델에 대한 연구)

  • Jung, Se-Hoon;Lee, Han-Sung;Kim, Jun-Yeong;Sim, Chun-Bo
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.2
    • /
    • pp.257-268
    • /
    • 2022
  • When there is a missing value in the raw data, if ignore the missing values and proceed with the analysis, the accuracy decrease due to the decrease in the number of sample. The method of imputation and analyzing patterns and significant values can compensate for the problem of lower analysis quality and analysis accuracy as a result of bias rather than simply removing missing values. In this study, we proposed to study irregular data patterns and missing processing methods of data using machine learning techniques for the study of correction of missing values. we would like to propose a plan to replace the missing with data from a similar past point in time by finding the situation at the time when the missing data occurred. Unlike previous studies, data correction techniques present new algorithms using DNN and KNN-MLE techniques. As a result of the performance evaluation, the ANAE measurement value compared to the existing missing section correction algorithm confirmed a performance improvement of about 0.041 to 0.321.

Prediction of sediment flow to Pleikrong reservoir due to the impact of climate change

  • Xuan Khanh Do;ThuNgaLe;ThuHienNguyen
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.38-38
    • /
    • 2023
  • Pleikrong reservoir with a concrete gravity dam that impound more than 1 billion cubic meter storage volume is one of the largest reservoir in Central Highland of Vietnam. Sedimentation is a major problem in this area and it becomes more severe due to the effect of climate change. Over time, it gradually reduces the reservoir storage capacity affecting to the reliability of water and power supply. This study aims to integrate the soil and water assessment tool (SWAT) model with 14 bias-corrected GCM/RCM models under two emissions scenarios, representative concentration pathway (RCP) 4.5 and 8.5 to estimate sediment inflow to Pleikrong reservoir in the long term period. The result indicated that the simulated total amount of sediment deposited in the reservoir from 2010 to 2018 was approximately 39 mil m3 which is a 17% underestimate compared with the observed value of 47 mil m3. The results also show the reduction in reservoir storage capacity due to sedimentation ranges from 25% to 62% by 2050, depending on the different climate change models. The reservoir reduced storage volume's rate in considering the impact of climate change is much faster than in the case of no climate change. The outcomes of this study will be helpful for a sustainable and climate-resilient plan of sediment management for the Pleikrongreservoir.

  • PDF

SI-BASED MAGNETIC TUNNELING TRANSISTOR WITH HIGH TRANSFER RATIO

  • S. H. Jang;Lee, J. H.;T. Kang;Kim, K. Y.
    • Proceedings of the Korean Magnestics Society Conference
    • /
    • 2003.06a
    • /
    • pp.24-24
    • /
    • 2003
  • Metallic magnetoelectronic devices have studied intensively and extensively for last decade because of the scientific interest as well as great technological importance. Recently, the scientific activity in spintronics field is extending to the hybrid devices using ferromagnetic/semiconductor heterostructures and to new ferromagnetic semiconductor materials for future devices. In case of the hybrid device, conductivity mismatch problem for metal/semiconductor interface will be able to circumvent when the device operates in ballistic regime. In this respect, spin-valve transistor, first reported by Monsma, is based on spin dependent transport of hot electrons rather than electron near the Fermi energy. Although the spin-valve transistor showed large magnetocurrent ratio more than 300%, but low transfer ratio of the order of 10$\^$-5/ prevents the potential applications. In order to enhance the collector current, we have prepared magnetic tunneling transistor (MTT) with single ferromagnetic base on Si(100) collector by magnetron sputtering process. We have changed the resistance of tunneling emitter and the thickness of baser layer in the MTT structure to increase collector current. The high transfer ratio of 10$\^$-4/ range at bias voltage of more than 1.8 V, collector current of near l ${\mu}$A, and magnetocurrent ratio or 55% in Si-based MTT are obtained at 77K. These results suggest a promising candidate for future spintronic applications.

  • PDF

Design of Indoor Space Guidance System Using LiDAR and Camera on iPhone (iPhone의 LiDAR와 Camera를 이용한 실내 공간 안내를 위한 시스템 설계)

  • Junseok Jang;Kwangjae Sung
    • Journal of the Semiconductor & Display Technology
    • /
    • v.23 no.1
    • /
    • pp.71-78
    • /
    • 2024
  • In indoor environments, since global positioning system (GPS) signals can be blocked by obstacles, such as building structure. the performance of GPS-based positioning methods can be degraded because of the loss of GPS signals. To solve this problem, various localization schemes using inertial measurement unit (IMU) sensors, such as gyroscope, accelerometer, and magnetometer, have been proposed to enhance the positioning accuracy in indoor environments. IMU-based positioning methods can estimate the location of the user by calculating the velocity and heading angle of the user without the help of GPS. However, low-cost MEMS IMUs may lead to drift error and large bias. In addition, positioning errors in IMU-based positioning approaches can be caused by the irrelevant motion of the pedestrian. In this study, we propose an enhanced indoor positioning method that provides more reliable localization results by using the camera, light detection and right (LiDAR), and ARKit framework on the iPhone. Through reliable positioning results and augmented reality (AR) experiences, our indoor positioning system can provide indoor space guidance services.

  • PDF

Development of Local Stem Volume Table for Pinus densiflora S. et Z. Using Tree Stem Taper Model (수간곡선 모델을 이용한 소나무의 지방별 수간재적표 개발)

  • Kang, Jin-Taek;Son, Yeong-Mo;Kim, So-Won;Lee, Sun-Jeoung;Park, Hyun
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.16 no.4
    • /
    • pp.327-335
    • /
    • 2014
  • Current volume tables might underestimate or overestimate the volumes of individual trees in a specific region because the tables were made using the data from broad regions within South Korea. Therefore, to solve this problem, this study was conducted to develop local stem volume tables reflecting the local growth pattern and properties using stem taper equations in the regions of Hongcheon and Yeongju. We developed the local stem volume table for Pinus densiflora, which is the widely planted species in South Korea. To derive the most suitable taper equation for estimating the stem volume of region, three models of Max & Burkhart, Kozak and Parresol et al. were applied and their fitness were statistically analyzed by using the Fitness Index, Bias, and Standard Error of Bias. The result showed that there is a significant difference among the three models, and the Fitness Index of the Kozak model was highest compared to the other models. Therefore, the Kozak model was chosen for generating stem taper equation and stem volume tables for P. densiflora. The result from the developed stem volume tables of each region was compared to the current stem volume tables with driven by the data of tree growth obtained throughout the nation. The result showed that there is a significant difference (0.000< ${\alpha}=0.05$) in two regions, Hongcheon and Yeongju, and also there is a significant difference (0.000< ${\alpha}=0.05$) between the two regions.

A Validation Study of Retrospective Pre-post Testin the Affective Domain in Science Learning:for Scientifically Gifted Elementary Students (과학학습의 정의적 영역에서 사전-사후 통합 검사 설계의 타당화 연구: 과학영재를 대상으로)

  • Lim, Chae-Seong;Park, Hyoung-Min
    • Journal of Korean Elementary Science Education
    • /
    • v.36 no.3
    • /
    • pp.219-226
    • /
    • 2017
  • In this study, the reliability and validity of the retrospective pre-post test were analyzed in order to solve the problem of traditional pre-post test including response shift bias. Samples of the study were 162 elementary school students who are studying at the S university gifted education center in Seoul. Before completion of the field trip, we conducted pre test of science-related attitudes. After completion of the field trip, respondents were asked to compare their responses of pre and post science-related attitudes to quantitatively analyze the commonalities and differences of the two tests. To find out more characteristics, qualitative data such as daily records and interview were also gathered and analyzed. The major results of the study are as follows. First, for the paired t-test, there was no statistically significant difference between separate pre-test scores and retrospective pre-test. There was a very high correlation between the separate pre-test scores and the retrospective pre-test. Second, there were significant differences in all seven sub-factors of science-related attitudes between the retrospective pre-test and the post-test. Third, the separate pre-test scores showed a slightly higher tendency than the retrospective pre-test scores. This suggests that the response shift bias appears when it is performed the separate pre-test in affective domain. As a result of the interview, it was found that the evaluation standards of separate pre-test did not match with those of post-test. Forth, internal consistency reliability of the retrospective pre-test was higher than that of the separate pre-test. However, there were significant differences in six factors of science-related attitudes excluding the 'social implications of science' between the separate pre-test and the post-test. Based on these results, the retrospective pre-post test design provides simplicity and convenience to both respondents and investigators, as it is done with one test. The retrospective pre-post test design can be regarded as a valid design for the self-report measurement of affective domain on a single experimental group.

The Differential Effects of Transformational Leadership and Organizational Justice on Work Engagement : the Mediating Role of Psychological Contract Breach (변혁적 리더십 및 조직 공정성이 직무열의에 미치는 차별적 영향 : 심리적 계약위반의 매개효과)

  • Baec, Chae-Yoon;Shin, Je-Goo
    • The Journal of the Korea Contents Association
    • /
    • v.17 no.1
    • /
    • pp.299-336
    • /
    • 2017
  • The purpose of this study is to identify the differential effects of transformational leadership and organizational justice on psychological contract breach and work engagement, and to suggest practical implications. To this purpose, this study theoretically references equity theory which recognizes the relationship between organizational input and output, social exchange theory which explains the exchange relationship between members and organization, and job demand-resource (JD-R) model that combines job demands and job resources. A empirical study was conducted on 277 employees at 18 companies of diverse industries including manufacturing, distribution, and finance, and to eliminate the common method bias problem, the dependent variable was measured using peer evaluation. The results of this study showed that: 1) both transformational leadership and organizational justice had a significant positive effect on work engagement and significant negative effect on psychological contract breach; and 2) psychological contract breach played a partial mediating role in the relationship between transformational leadership and work engagement as well as between organizational justice and work engagement. Therefore, this study suggests that, as organizational justice has stronger influence on work engagement and psychological contract breach than transformational leadership, organizations should not only train its leaders but also guarantee fairness.

Localization Using Extended Kalman Filter based on Chirp Spread Spectrum Ranging (확장 Kalman 필터를 적용한 첩 신호 대역확산 거리 측정 기반의 위치추정시스템)

  • Bae, Byoung-Chul;Nam, Yoon-Seok
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.49 no.4
    • /
    • pp.45-54
    • /
    • 2012
  • Location-based services with GPS positioning technology as a key technology, but recognizing the current location through satellite communication is not possible in an indoor location-aware technology, low-power short-range communication is primarily made of the study. Especially, as Chirp Spread Spectrum(CSS) based location-aware approach for low-power physical layer IEEE802.15.4a is selected as a standard, Ranging distance estimation techniques and data transfer speed enhancements have been more developed. It is known that the distance measured by CSS ranging has quite a lot of noise as well as its bias. However, the noise problem can be adjusted by modeling the non-zero mean noise value by a scaling factor which corresponds to the change of magnitude of a measured distance vector. In this paper, we propose a localization system using the CSS signal to measure distance for a mobile node taken a measurement of the exact coordinates. By applying the extended kalman filter and least mean squares method, the localization system is faster, more stable. Finally, we evaluate the reliability and accuracy of the proposed algorithm's performance by the experiment for the realization of localization system.

GEO-KOMPSAT-2A AMI Best Detector Select Map Evaluation and Update (천리안위성2A호 기상탑재체 Best Detector Select 맵 평가 및 업데이트)

  • Jin, Kyoungwook;Lee, Sang-Cherl;Lee, Jung-Hyun
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.2
    • /
    • pp.359-365
    • /
    • 2021
  • GEO-KOMPSAT-2A (GK2A) AMI (Advanced Meteorological Imager) Best Detector Select (BDS) map is pre-determined and uploaded before the satellite launch. After the launch, there is some possibility of a detector performance change driven by an abrupt temperature variation and thus the status of BDS map needs to be evaluated and updated if necessary. To investigate performance of entire elements of the detectors, AMI BDS analyses were conducted based on a technical note provided from the AMI vendor (L3HARRIS). The concept of the BDS analysis is to investigate the stability of signals from detectors while they are staring at targets (deep space and internal calibration target). For this purpose, Long Time Series (LTS) and Output Voltage vs. Bias Voltage (V-V) methods are used. The LTS for 30 secs and the V-V for two secs are spanned respectively for looking at the targets to compute noise components of detectors. To get the necessary data sets, these activities were conducted during the In-Orbit Test (IOT) period since a normal operation of AMI is stopped and special mission plans are commanded. With collected data sets during the GK2A IOT, AMI BDS map was intensively examined. It was found that about 1% of entire detector elements, which were evaluated at the ground test, showed characteristic changes and those degraded elements are replaced by alternative best ones. The stripping effects on AMI raw images due to the BDS problem were clearly removed when the new BDS map was applied.