• Title/Summary/Keyword: test accuracy

Search Result 4,913, Processing Time 0.028 seconds

Bone Age Assessment Using Artificial Intelligence in Korean Pediatric Population: A Comparison of Deep-Learning Models Trained With Healthy Chronological and Greulich-Pyle Ages as Labels

  • Pyeong Hwa Kim;Hee Mang Yoon;Jeong Rye Kim;Jae-Yeon Hwang;Jin-Ho Choi;Jisun Hwang;Jaewon Lee;Jinkyeong Sung;Kyu-Hwan Jung;Byeonguk Bae;Ah Young Jung;Young Ah Cho;Woo Hyun Shim;Boram Bak;Jin Seong Lee
    • Korean Journal of Radiology
    • /
    • v.24 no.11
    • /
    • pp.1151-1163
    • /
    • 2023
  • Objective: To develop a deep-learning-based bone age prediction model optimized for Korean children and adolescents and evaluate its feasibility by comparing it with a Greulich-Pyle-based deep-learning model. Materials and Methods: A convolutional neural network was trained to predict age according to the bone development shown on a hand radiograph (bone age) using 21036 hand radiographs of Korean children and adolescents without known bone development-affecting diseases/conditions obtained between 1998 and 2019 (median age [interquartile range {IQR}], 9 [7-12] years; male:female, 11794:9242) and their chronological ages as labels (Korean model). We constructed 2 separate external datasets consisting of Korean children and adolescents with healthy bone development (Institution 1: n = 343; median age [IQR], 10 [4-15] years; male: female, 183:160; Institution 2: n = 321; median age [IQR], 9 [5-14] years; male: female, 164:157) to test the model performance. The mean absolute error (MAE), root mean square error (RMSE), and proportions of bone age predictions within 6, 12, 18, and 24 months of the reference age (chronological age) were compared between the Korean model and a commercial model (VUNO Med-BoneAge version 1.1; VUNO) trained with Greulich-Pyle-based age as the label (GP-based model). Results: Compared with the GP-based model, the Korean model showed a lower RMSE (11.2 vs. 13.8 months; P = 0.004) and MAE (8.2 vs. 10.5 months; P = 0.002), a higher proportion of bone age predictions within 18 months of chronological age (88.3% vs. 82.2%; P = 0.031) for Institution 1, and a lower MAE (9.5 vs. 11.0 months; P = 0.022) and higher proportion of bone age predictions within 6 months (44.5% vs. 36.4%; P = 0.044) for Institution 2. Conclusion: The Korean model trained using the chronological ages of Korean children and adolescents without known bone development-affecting diseases/conditions as labels performed better in bone age assessment than the GP-based model in the Korean pediatric population. Further validation is required to confirm its accuracy.

Verification Test of High-Stability SMEs Using Technology Appraisal Items (기술력 평가항목을 이용한 고안정성 중소기업 판별력 검증)

  • Jun-won Lee
    • Information Systems Review
    • /
    • v.20 no.4
    • /
    • pp.79-96
    • /
    • 2018
  • This study started by focusing on the internalization of the technology appraisal model into the credit rating model to increase the discriminative power of the credit rating model not only for SMEs but also for all companies, reflecting the items related to the financial stability of the enterprises among the technology appraisal items. Therefore, it is aimed to verify whether the technology appraisal model can be applied to identify high-stability SMEs in advance. We classified companies into industries (manufacturing vs. non-manufacturing) and the age of company (initial vs. non-initial), and defined as a high-stability company that has achieved an average debt ratio less than 1/2 of the group for three years. The C5.0 was applied to verify the discriminant power of the model. As a result of the analysis, there is a difference in importance according to the type of industry and the age of company at the sub-item level, but in the mid-item level the R&D capability was a key variable for discriminating high-stability SMEs. In the early stage of establishment, the funding capacity (diversification of funding methods, capital structure and capital cost which taking into account profitability) is an important variable in financial stability. However, we concluded that technology development infrastructure, which enables continuous performance as the age of company increase, becomes an important variable affecting financial stability. The classification accuracy of the model according to the age of company and industry is 71~91%, and it is confirmed that it is possible to identify high-stability SMEs by using technology appraisal items.

Comparison of Monoexponential, Biexponential, Stretched-Exponential, and Kurtosis Models of Diffusion-Weighted Imaging in Differentiation of Renal Solid Masses

  • Jianjian Zhang;Shiteng Suo;Guiqin Liu;Shan Zhang;Zizhou Zhao;Jianrong Xu;Guangyu Wu
    • Korean Journal of Radiology
    • /
    • v.20 no.5
    • /
    • pp.791-800
    • /
    • 2019
  • Objective: To compare various models of diffusion-weighted imaging including monoexponential apparent diffusion coefficient (ADC), biexponential (fast diffusion coefficient [Df], slow diffusion coefficient [Ds], and fraction of fast diffusion), stretched-exponential (distributed diffusion coefficient and anomalous exponent term [α]), and kurtosis (mean diffusivity and mean kurtosis [MK]) models in the differentiation of renal solid masses. Materials and Methods: A total of 81 patients (56 men and 25 women; mean age, 57 years; age range, 30-69 years) with 18 benign and 63 malignant lesions were imaged using 3T diffusion-weighted MRI. Diffusion model selection was investigated in each lesion using the Akaike information criteria. Mann-Whitney U test and receiver operating characteristic (ROC) analysis were used for statistical evaluations. Results: Goodness-of-fit analysis showed that the stretched-exponential model had the highest voxel percentages in benign and malignant lesions (90.7% and 51.4%, respectively). ADC, Ds, and MK showed significant differences between benign and malignant lesions (p < 0.05) and between low- and high-grade clear cell renal cell carcinoma (ccRCC) (p < 0.05). α was significantly lower in the benign group than in the malignant group (p < 0.05). All diffusion measures showed significant differences between ccRCC and non-ccRCC (p < 0.05) except Df and α (p = 0.143 and 0.112, respectively). α showed the highest diagnostic accuracy in differentiating benign and malignant lesions with an area under the ROC curve of 0.923, but none of the parameters from these advanced models revealed significantly better performance over ADC in discriminating subtypes or grades of renal cell carcinoma (RCC) (p > 0.05). Conclusion: Compared with conventional diffusion parameters, α may provide additional information for differentiating benign and malignant renal masses, while ADC remains the most valuable parameter for differentiation of RCC subtypes and for ccRCC grading.

A Study on the Calculation of Consolidation Constants using Moisture Content of Sedimentary Clay in Busan and Gyeongnam Regions (부산·경남지역 퇴적 점토의 함수비를 이용한 압밀정수 산정 연구)

  • Sung-Uk Kang;Dae-Hwan Kim;Tae-hyung Kim;Chin-Gyo Chung;In-Gon Joo
    • Journal of the Korean Geosynthetics Society
    • /
    • v.23 no.1
    • /
    • pp.39-47
    • /
    • 2024
  • In this study, physical property tests and standard consolidation tests were conducted on the marine clay of Busan New Port and North Port, the middle and lower reaches of the Nakdong River including Gimhae and Yangsan, and Ulsan regions. The moisture content, a property unrelated to sample disturbance with small individual test errors, was used for regression analysis with the compression index, virgin compression index, consolidation coefficient, expansion index, and secondary compression index, among others. Subsequently, the correlation and accuracy were evaluated. Upon analyzing the correlation between the moisture content, void ratio, and liquid limit commonly used physical properties for calculating compression indexes, it was confirmed that the liquid limit had the lowest correlation. Through a linear regression analysis of the consolidation constants using the current moisture content in the natural state, a high correlation was demonstrated. Relationship equations were then presented to determine settlement and settlement time. This study suggests that moisture content can be utilized as an alternative for evaluating and calculating consolidation constants when examining ground settlement in sedimentary clays distributed in the Busan and Gyeongnam regions.

Development of Wireless Measurement System for Bridge Using PDA and Fiber Optical Sensor (PDA와 광섬유 센서를 이용한 교량의 무선계측 시스템 개발)

  • Kwak, Kae-Hwan;Hwang, Hae-Sung;Jang, Hwa-Sup;Kim, Woo-Jong;Kim, Hoi-OK
    • Journal of the Korea institute for structural maintenance and inspection
    • /
    • v.13 no.1 s.53
    • /
    • pp.88-96
    • /
    • 2009
  • This study proposes a wireless measurement system that is a new safety management system by using an FBG sensor and a PDA. The sensor part has many advantages of implementing a wireless measurement system, and the study emploies an FBG-LVDT sensor, FBG-STRAIN sensor, FBG-TEMP sensor, and FBG-ACC sensor, using FBG sensors. Also, the study show a configuration of a signal process system for operating a wireless transmission system of FBG sensors applied to the signal process system, and engrafted the cutting edge information technology industry in order to display from a remote distance using a PDA. In order to verify the applicability of the developed FBG sensors and wireless measurement monitoring system to the field, their accuracy, and usability, the study has conducted a static and dynamic test to a bridge in the field. The study made an assessment of service for the vibration of the bridge by applying dynamic data measured by an FBG-LVDT sensor and FBG-ACC sensor to Meister's curve and prepared methods for assessing the vibration of the bridge by proposing a standard of vibration limitation given the service of vibration of the bridge. As a follow up for this study, it would be necessary to set up an overall model for the standard of service assessment established in this study.

Effect of digital competence on scan time and scan error in intraoral scanning (디지털 역량이 구강스캐너의 스캔 시간 및 스캔 오차에 미치는 영향)

  • Yun-Woo Kim;Do-Seon Lim;Hee-Jung Lim;Im-Hee Jung
    • Journal of Korean society of Dental Hygiene
    • /
    • v.24 no.4
    • /
    • pp.271-280
    • /
    • 2024
  • Objectives: This study aimed to test whether the digital competence of dental hygienists can affect their intraoral scanning potential in terms of scan time and error. Methods: Dental hygienists and dental hygiene students who had never used an intraoral scanner were surveyed to determine their digital competence. Individual data collected using an intraoral scanner was compared with reference data collected using a model scanner to identify scanning errors, and participants' scanning times were measured. Results: A significant decrease in scanning time was observed as the overall level of digital competence increased. The increase in digital skills and digital knowledge led to a decrease in scanning time by 3.73 and 3.98 minutes, respectively. Conclusions: This study found that digital competence was associated with reduced scan times, but less so with scan errors. This may be due to recent advances in scanning software, and future studies may need to develop a digital competence assessment tool that is more appropriate for the dental field.

Strength and Deformation Capacities of Short Concrete Columns with Circular Section Confined by GFRP (GFRP로 구속된 원형단면 콘크리트 단주의 강도 및 변형 능력)

  • Cho, Soon-Ho
    • Journal of the Korea Concrete Institute
    • /
    • v.19 no.1
    • /
    • pp.121-130
    • /
    • 2007
  • To investigate the enhancement in strength and deformation capacities of concrete confined by FRP composites, tests under axial loads were carried out on three groups of thirty six short columns in circular section with diverse GFRP confining reinforcement. The major test variables considered include fiber content or orientation, wrap or tube type by varying the end loading condition, and continuous or discontinuous confinement depending on the presence of vortical spices between its two halves. The circumferential FRP strains at failure for different types of confinements were also investigated with emphasis. Various analytical models capable of predicting the ultimate strength and strain of the confined concrete were examined by comparing to observed results. Tests results showed that FRP wraps or tubes provide the substantial increase in strength and deformation, while partial wraps comprising the vertical discontinuities fail in an explosive manner with less increase in strength, particularly in deformation. A bilinear stress-strain response was observed throughout all tests with some variations of strain hardening. The failure hoop strains measured on the FRP surface were less than those obtained from the tensile coupons in all tests with a high degree of variation. In overall, existing predictive equations overestimated ultimate strengths and strains observed in present tests, with a much larger scatter related to the latter. For more accuracy, two simple design- oriented equations correlated with present tests are proposed. The strength equation was derived using the Mohr-Coulomb failure criterion, whereas the strain equation was based on entirely fitting of test data including the unconfined concrete strength as one of governing factors.

Performance Test of Portable Hand-Held HPGe Detector Prototype for Safeguard Inspection (안전조치 사찰을 위한 휴대형 HPGe 검출기 시제품 성능평가 실험)

  • Kwak, Sung-Woo;Ahn, Gil Hoon;Park, Iljin;Ham, Young Soo;Dreyer, Jonathan
    • Journal of Radiation Protection and Research
    • /
    • v.39 no.1
    • /
    • pp.54-60
    • /
    • 2014
  • IAEA has employed various types of radiation detectors - HPGe, NaI, CZT - for accountancy of nuclear material. Among them, HPGe has been mainly used in verification activities required for high accuracy. Due to its essential cooling component(a liquid-nitrogen cooling or a mechanical cooling system), it is large and heavy and needs long cooling time before use. New hand-held portable HPGe has been developed to address such problems. This paper deals with results of performance evaluation test of the new hand-held portable HPGe prototype which was used during IAEA's inspection activities. Radioactive spectra obtained with the new portable HPGe showed different characteristics depending on types and enrichments of nuclear materials inspected. Also, Gamma-rays from daughter radioisotopes in the decay series of $^{235}U$ and $^{238}U$ and characteristic x-rays from uranium were able to be remarkably separated from other peaks in the spectra. A relative error of enrichment measured by the new portable HPGe was in the range of 9 to 27%. The enrichment measurement results didn't meet partially requirement of IAEA because of a small size of a radiation sensing material. This problem might be solved through a further study. This paper discusses how to determine enrichment of nuclear material as well as how to apply the new hand-held portable HPGe to safeguard inspection. There have been few papers to deal with IAEA inspection activity in Korea to verify accountancy of nuclear material in national nuclear facilities. This paper would contribute to analyzing results of safeguards inspection. Also, it is expected that things discussed about further improvement of a radiation detector would make contribution to development of a radiation detector in the related field.

Validity of Long Form Assessment in Interactive Metronome® as a Measure of Children's Praxis (아동의 운동기능평가에 대한 Interactive Metronome® LFA의 타당도 연구)

  • Kim, Kyeong-Mi;Heo, Seo-Yoon;Kim, Mi-Su;Lee, Soo-Min
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.13 no.1
    • /
    • pp.13-22
    • /
    • 2015
  • Objective : The aim of this study is to verify validity of Long Form Assessment, which is an Interactive Metronome $measure^{(R)}$(LFA-IM), as a measurement of praxis of children. Methods : The study was implemented from March 2015 to July 2015. Twenty-five children with Attention Deficit Hyperactivity Disorder (ADHD) and those without ADHD (age of 6~11) were selected from a local university hospital and community in Gyeoung-Nam province and Busan for this study. In order to examine discriminative validity of LFA-IM, Bruininks-Oseretsky Test of Motor Proficiency, second edition (BOT-2) was used to compare the difference of results with LFA-IM for both children with- and without ADHD. For concurrent validity, correlation between LFA-IM and BOT-2 was investigated using spearman correlation coefficients. Results : For the comparison between children with ADHD and children without ADHD, there were significant differences in the total scores of LFA-IM (p<.05). Regarding the concurrent validity, there was a strong negative correlation between the total scores of LFA-IM and BOT-2 (p<.05). In addition, there was high correlation between LFA-IM and BOT-2 for the area of hand control (rs=-.532), and high negative correlation for the area of fine-motor accuracy (rs=-.447), hand dexterity (rs=-.532), and balance control (rs=-.623) (p<.05). Conclusion : This study identified validities of LFA-IM as an assessment of praxis of children. The results showed that it is appropriate to evaluate praxis of children with the total score of LFA-IM and, thus, it is believed that LFA-IM has a potential clinical utility. However, there should be more researches with large number of subjects.

Evaluation on Protrusion of the Imaginary Prostate Volume Using Three-Dimensional Volume Rendering (3차원 볼륨 렌더링을 이용한 가상 돌출형 전립선 부피 평가)

  • Seoung, Youl-Hun;Joo, Yong-Hyun;Rhim, Jae-Dong;Choe, Bo-Young
    • Progress in Medical Physics
    • /
    • v.20 no.4
    • /
    • pp.208-215
    • /
    • 2009
  • This study is to compare the accuracy of evaluation regarding the volume of the prostate, which three-dimensional volume rendering was produced the shape of protrusion, by measuring two kinds of craniocaudal length from the top of the protrusion and from the exclusion of the protrusion as the starting points. For the imaginary protrusion prostate models, total of 10 models were roughly made by using devils-tongue jelly and changing each of the 10 ml of capacity from 10 ml to 100 ml. For the protrusion prostate models aimed at estimating the real volume, through 64 cannel computed tomography (CT) and 3.0 tesla magnetic resonance image (MRI) were conducted by planimetry technique from three-dimensional volume rendering. And then we performed to evaluate on significance of these volumes by wilcoxon signed rank test. Also the obtained volumes data by ellipsoid volume formula were measured the volume of protrusion prostate models two times with each method using the two kinds of craniocaudal length from top of the protrusion and from exclusion of the protrusion as the starting points. Finally, the significance of differences using wilcoxon signed rank test was evaluated between the real volume by planimetry technique and the measured volume by ellipsoid volume formula from three-dimensional volume rendering. The average of the protrusion length on the models was $0.90{\pm}0.18\;mm$ in CT and was $0.75{\pm}0.11\;mm$ in MRI. There were not statistically significant difference between MRI and CT from the volume of protrusion prostate models (p=0.414). In MRI (p=0.139) and CT (p=0.057), there were not statistically significant difference between the real volume by planimetry technique and the measured volume by ellipsoid volume from exclusion of the protrusion as the starting points. While, there were statistically significant difference between the real volume by planimetry technique and the measured volume by ellipsoid volume from top of the protrusion as the starting points in MRI (p=0.005) and CT (p=0.005). For the accurate measurement of the protrusion prostate models, the craniocaudal length of the prostate should be measured from the exclusion of the protrusion as the starting points.

  • PDF