• Title/Summary/Keyword: accuracy analysis

Search Result 11,955, Processing Time 0.036 seconds

A sensitivity analysis of machine learning models on fire-induced spalling of concrete: Revealing the impact of data manipulation on accuracy and explainability

  • Mohammad K. al-Bashiti;M.Z. Naser
    • Computers and Concrete
    • /
    • v.33 no.4
    • /
    • pp.409-423
    • /
    • 2024
  • Using an extensive database, a sensitivity analysis across fifteen machine learning (ML) classifiers was conducted to evaluate the impact of various data manipulation techniques, evaluation metrics, and explainability tools. The results of this sensitivity analysis reveal that the examined models can achieve an accuracy ranging from 72-93% in predicting the fire-induced spalling of concrete and denote the light gradient boosting machine, extreme gradient boosting, and random forest algorithms as the best-performing models. Among such models, the six key factors influencing spalling were maximum exposure temperature, heating rate, compressive strength of concrete, moisture content, silica fume content, and the quantity of polypropylene fiber. Our analysis also documents some conflicting results observed with the deep learning model. As such, this study highlights the necessity of selecting suitable models and carefully evaluating the presence of possible outcome biases.

Analysis of Geolocation Accuracy of Precision Image Processing System developed for CAS-500 (국토관측위성용 정밀영상생성시스템의 위치정확도 분석)

  • Lee, Yoojin;Park, Hyeongjun;Kim, Hye-Sung;Kim, Taejung
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.5_2
    • /
    • pp.893-906
    • /
    • 2020
  • This paper reports on the analysis of the location accuracy of a precision image generation system manufactured for CAS 500. The planned launch date of the CAS 500 is 2021, and since it has not yet been launched, the analysis was performed using KOMPSAT-3A satellite images having similar specifications to the CAS 500. In this paper, we have checked the geolocation accuracy of initial sensor model, the model point geolocation accuracy of the precise sensor model, the geolocation accuracy of the precise sensor model using the check point, and the geolocation accuracy of the precise orthoimage using 30 images of the Korean Peninsula. In this study, the target geolocation accuracy is to have an RMSE within 2 pixels when an accurate ground control point is secured. As a result, it was confirmed that the geolocation accuracy of the precision sensor model using the checkpoint was about 1.85 pixels in South Korea and about 2.04 pixels in North Korea, and the geolocation accuracy of the precise orthoimage was about 1.15 m in South Korea and about 3.23 m in North Korea. Overall, it was confirmed that the accuracy of North Korea was low compared to that of South Korea, and this was confirmed to have affected the measured accuracy because the GCP (Ground Control Point) quality of the North Korea images was poor compared to that of South Korea. In addition, it was confirmed that the accuracy of the precision orthoimage was slightly lower than that of precision sensor medel, especially in North Korea. It was judged that this occurred from the error of the DTM (Digital Terrain Model) used for orthogonal correction. In addition to the causes suggested by this paper, additional studies should be conducted on factors that may affect the position accuracy.

Analysis of Geolocation Accuracy of KOMPSAT-3 Imagery (KOMPSAT-3 영상의 기하정확도 분석)

  • Jeong, Jaehoon;Kim, Jaein;Kim, Taejung
    • Korean Journal of Remote Sensing
    • /
    • v.30 no.1
    • /
    • pp.37-45
    • /
    • 2014
  • This paper reports the geolocation accuracy of KOMPSAT-3 imagery. KOMPSAT-3 was launched successfully on May 18, 2012 and has been released last March. In this paper, we have checked the geolocation accuracy of initial sensor model, precise sensor model and stereo-and multi-image model using four KOMPSAT-3 images covering the same area. The KOMPSAT-3 images without GCPs provided the geolocation accuracy of about 30m and the geocorrected KOMPSAT-3 images provided the geolocation accuracy of about 1m or less. KOMPSAT-3 stereo- and multi-images models yield threedimensional points with sub-meter accuracy in horizontal and vertical direction. Overall, KOMPSAT-3 showed much improved performance in terms of the geolocation accuracy over KOMPSAT-2. KOMPSAT-3 is expected to be able to replace foreign satellite data with sub-meter accuracy level for achieving accurate geometric information.

Genetic evaluation and accuracy analysis of commercial Hanwoo population using genomic data

  • Gwang Hyeon Lee;Yeon Hwa Lee;Hong Sik Kong
    • Journal of Animal Reproduction and Biotechnology
    • /
    • v.38 no.1
    • /
    • pp.32-37
    • /
    • 2023
  • This study has evaluated the genomic estimated breeding value (GEBV) of the commercial Hanwoo population using the genomic best linear unbiased prediction (GBLUP) method and genomic information. Furthermore, it analyzed the accuracy and realized accuracy of the GEBV. 1,740 heads of the Hanwoo population which were analyzed using a single nucleotide polymorphism (SNP) Chip has selected as the test population. For carcass weight (CWT), eye muscle area (EMA), back fat thickness (BFT), and marbling score (MS), the mean GEBVs estimated using the GBLUP method were 3.819, 0.740, -0.248, and 0.041, respectively and the accuracy of each trait was 0.743, 0.728, 0.737, and 0.765, respectively. The accuracy of the breeding value was affected by heritability. The accuracy was estimated to be low in EMA with low heritability and high in MS with high heritability. Realized accuracy values of 0.522, 0.404, 0.444, and 0.539 for CWT, EMA, BFT, and MS, respectively, showing the same pattern as the accuracy value. The results of this study suggest that the breeding value of each individual can be estimated with higher accuracy by estimating the GEBV using the genomic information of 18,499 reference populations. If this method is used and applied to individual selection in a commercial Hanwoo population, more precise and economical individual selection is possible. In addition, continuous verification of the GBLUP model and establishment of a reference population suitable for commercial Hanwoo populations in Korea will enable a more accurate evaluation of individuals.

Accuracy Analysis of Low-cost UAV Photogrammetry for Road Sign Positioning (드론사진측량에 의한 도로표지 위치정보 정확도 평가)

  • Sung, Hongki;Chong, Kyusoo;Lee, Chang No
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.37 no.4
    • /
    • pp.243-251
    • /
    • 2019
  • The road sign location information installed on national roads is continuously updated using MMS (Mobile Mapping System) technology. It is possible to map accurate road facilities by MMS, but the equipment is very expensive and requires specialized technology. Also, the accuracy of the position of the object greatly depends on the GPS (Global Positioning System) accuracy. In the case of road facility mapping, the advantage of drone is more remarkable than that of field survey or conventional aerial photogrammetry. In particular, it is more efficient than field surveying and it is possible to acquire high resolution images with low budget compared to conventional aerial photogrammetry. In this study, the accuracy of the location information measured by the existing MMS is compared with the GPS survey result and the accuracy analysis is performed by the drone aerial photogrammetry. In order to confirm the space accuracy that can be obtained when conducting drone aerial photogrammetry, the accuracy of the change in the number of ground control points and the degree of overlap was evaluated. As a result of the experiment, it was possible to obtain sufficient accuracy with two ground control points distributed at both ends of the road and 60% overlap.

Meshless Local Petrov-Galerkin (MLPG) method for dynamic analysis of non-symmetric nanocomposite cylindrical shell

  • Ferezghi, Yaser Sadeghi;Sohrabi, Mohamadreza;Nezhad, Seyed Mojtaba Mosavi
    • Structural Engineering and Mechanics
    • /
    • v.74 no.5
    • /
    • pp.679-698
    • /
    • 2020
  • In this paper, the meshless local Petrov-Galerkin (MLPG) method is developed for dynamic analysis of non-symmetric nanocomposite cylindrical shell equations of elastic wave motion with nonlinear grading patterns under shock loading. The mechanical properties of the nanocomposite cylinder are obtained based on a micro-mechanical model. In this study, four kinds of grading patterns are assumed for carbon nanotube mechanical properties. The displacements can be approximated using shape function so, the multiquadrics (MQ) Radial Basis Functions (RBF) are used as the shape function. In order to discretize the derived equations in time domains, the Newmark time approximation scheme with suitable time step is used. To demonstrate the accuracy of the present method for dynamic analysis, at the first a problem verifies with analytical solution and then the present method compares with the finite element method (FEM), finally, the present method verifies by using the element free Galerkin (EFG) method. The comparison shows the high capacity and accuracy of the present method in the dynamic analysis of cylindrical shells. The capability of the present method to dynamic analysis of non-symmetric nanocomposite cylindrical shell is demonstrated by dynamic analysis of the cylinder with different kinds of grading patterns and angle of nanocomposite reinforcements. The present method shows high accuracy, efficiency and capability to dynamic analysis of non-symmetric nanocomposite cylindrical shell, which it furnishes a ground for a more flexible design.

Analysis of 3D Motion Recognition using Meta-analysis for Interaction (기존 3차원 인터랙션 동작인식 기술 현황 파악을 위한 메타분석)

  • Kim, Yong-Woo;Whang, Min-Cheol;Kim, Jong-Hwa;Woo, Jin-Cheol;Kim, Chi-Jung;Kim, Ji-Hye
    • Journal of the Ergonomics Society of Korea
    • /
    • v.29 no.6
    • /
    • pp.925-932
    • /
    • 2010
  • Most of the research on three-dimensional interaction field have showed different accuracy in terms of sensing, mode and method. Furthermore, implementation of interaction has been a lack of consistency in application field. Therefore, this study is to suggest research trends of three-dimensional interaction using meta-analysis. Searching relative keyword in database provided with 153 domestic papers and 188 international papers covering three-dimensional interaction. Analytical coding tables determined 18 domestic papers and 28 international papers for analysis. Frequency analysis was carried out on method of action, element, number, accuracy and then verified accuracy by effect size of the meta-analysis. As the results, the effect size of sensor-based was higher than vision-based, but the effect size was extracted to small as 0.02. The effect size of vision-based using hand motion was higher than sensor-based using hand motion. Therefore, implementation of three-dimensional sensor-based interaction and vision-based using hand motions more efficient. This study was significant to comprehensive analysis of three-dimensional motion recognition for interaction and suggest to application directions of three-dimensional interaction.

Repeatability Assessment of Autorefractor and Accuracy Analysis of Refraction Measurements by Fourier Analysis (자동굴절검사기의 신뢰성 평가 및 Fourier analysis에 의한 정확도 분석)

  • Kim, Tae-Hun;Ye, Ki-Hun;Kim, Jae-Kwang;Sung, A-Young
    • Journal of Korean Ophthalmic Optics Society
    • /
    • v.13 no.2
    • /
    • pp.29-36
    • /
    • 2008
  • Purpose: We have evaluated both the reliability and accuracy of refractive measurement from autorefractor by comparing with subjective refraction data. Methods: Measurements of refractive error were performed on 198 eyes of 99 subjects in noncycloplegic condition. Also we analyzed refraction results and evaluated repeatability and accuracy of subjective refraction and autorefraction. Furthermore we analyzed accuracy of autorefractor by Fourier analysis. Results: Reliability coefficient of the autorefraction for the right eye were determined to by 0.993, 0.974 and 0.925 respectively, in the spherical, cylinderical component and cylinderical Axis. Also, the reliability coefficient of the autorefraction for the left eye were found to be 0.991, 0.948 and 0.886, respectively, in the spherical, cylinderical component and cylinderical Axis. From the Fourier analysis no statistically significant differences in $J_{0}$ component were found between the auto and subjective refraction measurements (p>0.05) whereas difference of refractive power of $J_{45}$ component when compared with the subjective refraction were -0.019, -0.164. Conclusions: We conclude that autorefractormeter can be effectively used to measure the refractive power within the error limits.

  • PDF

The Classification Accuracy Improvement of Satellite Imagery Using Wavelet Based Texture Fusion Image (웨이브릿 기반 텍스처 융합 영상을 이용한 위성영상 자료의 분류 정확도 향상 연구)

  • Hwang, Hwa-Jeong;Lee, Ki-Won;Kwon, Byung-Doo;Yoo, Hee-Young
    • Korean Journal of Remote Sensing
    • /
    • v.23 no.2
    • /
    • pp.103-111
    • /
    • 2007
  • The spectral information based image analysis, visual interpretation and automatic classification have been widely carried out so far for remote sensing data processing. Yet recently, many researchers have tried to extract the spatial information which cannot be expressed directly in the image itself. Using the texture and wavelet scheme, we made a wavelet-based texture fusion image which includes the advantages of each scheme. Moreover, using these schemes, we carried out image classification for the urban spatial analysis and the geological structure analysis around the caldera area. These two case studies showed that image classification accuracy of texture image and wavelet-based texture fusion image is better than that of using only raw image. In case of the urban area using high resolution image, as both texture and wavelet based texture fusion image are added to the original image, the classification accuracy is the highest. Because detailed spatial information is applied to the urban area where detail pixel variation is very significant. In case of the geological structure analysis using middle and low resolution image, the images added by only texture image showed the highest classification accuracy. It is interpreted to be necessary to simplify the information such as elevation variation, thermal distribution, on the occasion of analyzing the relatively larger geological structure like a caldera. Therefore, in the image analysis using spatial information, each spatial information analysis method should be carefully selected by considering the characteristics of the satellite images and the purpose of study.

Analyzing the Effect of Characteristics of Dictionary on the Accuracy of Document Classifiers (용어 사전의 특성이 문서 분류 정확도에 미치는 영향 연구)

  • Jung, Haegang;Kim, Namgyu
    • Management & Information Systems Review
    • /
    • v.37 no.4
    • /
    • pp.41-62
    • /
    • 2018
  • As the volume of unstructured data increases through various social media, Internet news articles, and blogs, the importance of text analysis and the studies are increasing. Since text analysis is mostly performed on a specific domain or topic, the importance of constructing and applying a domain-specific dictionary has been increased. The quality of dictionary has a direct impact on the results of the unstructured data analysis and it is much more important since it present a perspective of analysis. In the literature, most studies on text analysis has emphasized the importance of dictionaries to acquire clean and high quality results. However, unfortunately, a rigorous verification of the effects of dictionaries has not been studied, even if it is already known as the most essential factor of text analysis. In this paper, we generate three dictionaries in various ways from 39,800 news articles and analyze and verify the effect each dictionary on the accuracy of document classification by defining the concept of Intrinsic Rate. 1) A batch construction method which is building a dictionary based on the frequency of terms in the entire documents 2) A method of extracting the terms by category and integrating the terms 3) A method of extracting the features according to each category and integrating them. We compared accuracy of three artificial neural network-based document classifiers to evaluate the quality of dictionaries. As a result of the experiment, the accuracy tend to increase when the "Intrinsic Rate" is high and we found the possibility to improve accuracy of document classification by increasing the intrinsic rate of the dictionary.