• Title/Summary/Keyword: Classification accuracy assessment

Search Result 168, Processing Time 0.024 seconds

Postoperative Pain Assessment based on Derivative Waveform of Photoplethysmogram (광용적맥파 미분 파형 기반 수술 후 통증 평가 가능성 고찰)

  • Seok, Hyeon Seok;Shin, Hangsik
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.7
    • /
    • pp.962-968
    • /
    • 2018
  • In this study, we developed novel indicators to assess postoperative pain based on PPG derivative waveform. As the candidate indicator of postoperative pain assessment, the time from the start of beating to the n-th peak($T_n$) and the n-th peak amplitude($A_n$) of the PPG derivative were selected. In order to verify derived indicators, each candidate indicator was derived from the PPG of 78 subjects before and after surgery, and it was confirmed whether significant changes were observed after surgery. Logistic classification was performed with each proposed indicator to calculate the pain classification accuracy, then the classification performance was compared with SPI(Surgical Pleth Index, GE Healthcare, Chicago, US). The results showed that there were significant differences(p < 0.01) in all indicators except for $T_3$ and $A_3$. The coefficient of variation(CV) of every time-related indicators were lower than the CV of SPI(30.43%), however, the CV in amplitude-related parameters were higher than that of SPI. Among the candidate indicators, amplitude of the first peak, $A_1$, showed that highest accuracy in post-operative pain classification, 68.72%, and it is 15.53% higher than SPI.

Study of Personal Credit Risk Assessment Based on SVM

  • LI, Xin;XIA, Han
    • The Journal of Industrial Distribution & Business
    • /
    • v.13 no.10
    • /
    • pp.1-8
    • /
    • 2022
  • Purpose: Support vector machines (SVMs) ensemble has been proposed to improve classification performance of Credit risk recently. However, currently used fusion strategies do not evaluate the importance degree of the output of individual component SVM classifier when combining the component predictions to the final decision. To deal with this problem, this paper designs a support vector machines (SVMs) ensemble method based on fuzzy integral, which aggregates the outputs of separate component SVMs with importance of each component SVM. Research design, data, and methodology: This paper designs a personal credit risk evaluation index system including 16 indicators and discusses a support vector machines (SVMs) ensemble method based on fuzzy integral for designing a credit risk assessment system to discriminate good creditors from bad ones. This paper randomly selects 1500 sample data of personal loan customers of a commercial bank in China 2015-2020 for simulation experiments. Results: By comparing the experimental result SVMs ensemble with the single SVM, the neural network ensemble, the proposed method outperforms the single SVM, and neural network ensemble in terms of classification accuracy. Conclusions: The results show that the method proposed in this paper has higher classification accuracy than other classification methods, which confirms the feasibility and effectiveness of this method.

Accuracy Assessment of Global Land Cover Datasets in South Korea

  • Son, Sanghun;Kim, Jinsoo
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.4
    • /
    • pp.601-610
    • /
    • 2018
  • The national accuracy of global land cover (GLC) products is of great importance to ecological and environmental research. However, GLC products that are derived from different satellite sensors, with differing spatial resolutions, classification methods, and classification schemes are certain to show some discrepancies. The goal of this study is to assess the accuracy of four commonly used GLC datasets in South Korea, GLC2000, GlobCover2009, MCD12Q1, and GlobeLand30. First, we compared the area of seven classes between four GLC datasets and a reference dataset. Then, we calculated the accuracy of the four GLC datasets based on an aggregated classification scheme containing seven classes, using overall, producer's and user's accuracies, and kappa coefficient. GlobeLand30 had the highest overall accuracy (77.59%). The overall accuracies of MCD12Q1, GLC2000, and GlobCover2009 were 75.51%, 68.38%, and 57.99%, respectively. These results indicate that GlobeLand30 is the most suitable dataset to support a variety of national scientific endeavors in South Korea.

THE LAND COVER MAPPING IN NORTH KOREA USING MODIS IMAGE;THE CLASSIFICATION ACCURACY ENHANCEMENT FOR INACCESSIBLE AREA USING GOOGLE EARTH

  • Cha, Su-Young;Park, Chong-Hwa
    • Proceedings of the KSRS Conference
    • /
    • 2007.10a
    • /
    • pp.341-344
    • /
    • 2007
  • A major obstacle to classify and validate Land Cover maps is the high cost of generating reference data or multiple thematic maps for subsequent comparative analysis. In case of inaccessible area such as North Korea, the high resolution satellite imagery may be used as in situ data so as to overcome the lack of reliable reference data. The objective of this paper is to investigate the possibility of utilizing QuickBird (0.6m) of North Korea obtained from Google Earth data provided thru internet. Monthly NDVI images of nine months from the summer of 2004 were classified into L=54 cluster using ISODATA algorithm, and these L clusters were assigned to 7 classes; coniferous forest, deciduous forest, mixed forest, paddy field, dry field, water and built-up area. The overall accuracy and Kappa index were 85.98% and 0.82, respectively, which represents about 10% point increase of classification accuracy than our previous study based on GCP point data around North Korea. Thus we can conclude that Google Earth may be used to substitute the traditional in situ data collection on the site where the accessibility is severely limited.

  • PDF

An optimal classification method for risk assessment of water inrush in karst tunnels based on grey system theory

  • Zhou, Z.Q.;Li, S.C.;Li, L.P.;Shi, S.S.;Xu, Z.H.
    • Geomechanics and Engineering
    • /
    • v.8 no.5
    • /
    • pp.631-647
    • /
    • 2015
  • Engineers may encounter unpredictable cavities, sinkholes and karst conduits while tunneling in karst area, and water inrush disaster frequently occurs and endanger the construction safety, resulting in huge casualties and economic loss. Therefore, an optimal classification method based on grey system theory (GST) is established and applied to accurately predict the occurrence probability of water inrush. Considering the weights of evaluation indices, an improved formula is applied to calculate the grey relational grade. Two evaluation indices systems are proposed for risk assessment of water inrush in design stage and construction stage, respectively, and the evaluation indices are quantitatively graded according to four risk grades. To verify the accuracy and feasibility of optimal classification method, comparisons of the evaluation results derived from the aforementioned method and attribute synthetic evaluation system are made. Furthermore, evaluation of engineering practice is carried through with the Xiakou Tunnel as a case study, and the evaluation result is generally in good agreement with the field-observed result. This risk assessment methodology provides a powerful tool with which engineers can systematically evaluate the risk of water inrush in karst tunnels.

Accuracy Assessment of Supervised Classification using Training Samples Acquired by a Field Spectroradiometer: A Case Study for Kumnam-myun, Sejong City (지상 분광반사자료를 훈련샘플로 이용한 감독분류의 정확도 평가: 세종시 금남면을 사례로)

  • Shin, Jung Il;Kim, Ik Jae;Kim, Dong Wook
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.24 no.1
    • /
    • pp.121-128
    • /
    • 2016
  • Many studies are focused on image data and classifier for comparison or improvement of classification accuracy. Therefore studies are needed aspect of the training samples on supervised classification which depend on reference data or skill of analyst. This study tries to assess usability of field spectra as training samples on supervised classification. Classification accuracies of hyperspectral and multispectral images were assessed using training samples from image itself and field spectra, respectively. The results shown about 90% accuracy with training sample collected from image. Using field spectra as training sample, accuracy was decreased 10%p for hyperspectral image, and 20%p for multispectral image. Especially, some classes shown very low accuracies due to similar spectral characteristics on multispectral image. Therefore, field spectra might be used as training samples on classification of hyperspectral image, although it has limitation for multispectral image.

Method for Assessing Landslide Susceptibility Using SMOTE and Classification Algorithms (SMOTE와 분류 기법을 활용한 산사태 위험 지역 결정 방법)

  • Yoon, Hyung-Koo
    • Journal of the Korean Geotechnical Society
    • /
    • v.39 no.6
    • /
    • pp.5-12
    • /
    • 2023
  • Proactive assessment of landslide susceptibility is necessary for minimizing casualties. This study proposes a methodology for classifying the landslide safety factor using a classification algorithm based on machine learning techniques. The high-risk area model is adopted to perform the classification and eight geotechnical parameters are adopted as inputs. Four classification algorithms-namely decision tree, k-nearest neighbor, logistic regression, and random forest-are employed for comparing classification accuracy for the safety factors ranging between 1.2 and 2.0. Notably, a high accuracy is demonstrated in the safety factor range of 1.2~1.7, but a relatively low accuracy is obtained in the range of 1.8~2.0. To overcome this issue, the synthetic minority over-sampling technique (SMOTE) is adopted to generate additional data. The application of SMOTE improves the average accuracy by ~250% in the safety factor range of 1.8~2.0. The results demonstrate that SMOTE algorithm improves the accuracy of classification algorithms when applied to geotechnical data.

Kansas Vegetation Mapping Using Multi-Temporal Remote Sensing Data: A Hybrid Approach (계절별 위성자료를 이용한 미국 캔자스주 식생 분류 - 하이브리드 접근방식의 적용 -)

  • ;Stephen Egbert;Dana Peterson;Aimee Stewart;Chris Lauver;Kevin Price;Clayton Blodgett;Jack Cully, Jr,;Glennis Kaufman
    • Journal of the Korean Geographical Society
    • /
    • v.38 no.5
    • /
    • pp.667-685
    • /
    • 2003
  • To address the requirements of gap analysis for species protection, as well as the needs of state and federal agencies for detailed digital land cover, a 43-class map at the vegetation alliance level was created for the state of Kansas using multi-temporal Thematic Mapper imagery. The mapping approach included the use of three-date multi-seasonal imagery, a two-stage classification approach that first masked out cropland areas using unsupervised classification and then mapped natural vegetation with supervised classification, visualization techniques utilizing a map of small multiples and field experts, and extensive use of ancillary data in post-hoc processing. Accuracy assessment was conducted at three levels of generalization (Anderson Level I, vegetation formation, and vegetation alliance) and three cross-tabulation approaches. Overall accuracy ranged from 51.7% to 89.4%, depending on level of generalization, while accuracy figures for individual alliance classes varied by area covered and level of sampling.

A Study on Statistical Classification of Wear Debris Morphology

  • Cho, Unchung
    • KSTLE International Journal
    • /
    • v.2 no.1
    • /
    • pp.35-39
    • /
    • 2001
  • In this paper, statistical approach is undertaken to investigate the classification of wear debris which is the key function of objective assessment of wear debris morphology. Wear tests are run to produce various kinds of wear debris. The images of wear debris from wear tests are captured with image acquisition equipment. By thresholding, two-dimensional binary images of wear debris are made and, then, morphological parameters are used to quantify the images of debris. Parametric and nonparametric discriminant method are employed to classify wear debris into predefined wear conditions. It is demonstrated that classification accuracy of parametric and nonparametric discriminant method is similar. The selected use of morphological parameters by stepwise discriminant analysis can generally improve the classification accuracy of parametric and nonparametric discriminant method.

  • PDF

The Utilization of Google Earth Images as Reference Data for The Multitemporal Land Cover Classification with MODIS Data of North Korea

  • Cha, Su-Young;Park, Chong-Hwa
    • Korean Journal of Remote Sensing
    • /
    • v.23 no.5
    • /
    • pp.483-491
    • /
    • 2007
  • One of the major obstacles to classify and validate Land Cover maps is the high cost of acquiring reference data. In case of inaccessible areas such as North Korea, the high resolution satellite imagery may be used for reference data. The objective of this paper is to investigate the possibility of utilizing QuickBird high resolution imagery of North Korea that can be obtained from Google Earth data via internet for reference data of land cover classification. Monthly MODIS NDVI data of nine months from the summer of 2004 were classified into L=54 cluster using ISODATA algorithm, and these L clusters were assigned to 7 classes - coniferous forest, deciduous forest, mixed forest, paddy field, dry field, water, and built-up areas - by careful use of reference data obtained through visual interpretation of the high resolution imagery. The overall accuracy and Kappa index were 85.98% and 0.82, respectively, which represents about 10% point increase of classification accuracy than our previous study based on GCP point data around North Korea. Thus we can conclude that Google Earth may be used to substitute the traditional reference data collection on the site where the accessibility is severely limited.