• Title/Summary/Keyword: predictive validity

Search Result 231, Processing Time 0.027 seconds

Comparing Construct and Predictive Validities of the Measurement of Children's Approximate Number Acuity Depending on Numerosity Comparison Task Format (수량 비교 과제의 형식에 따른 아동의 수 민감도 측정치의 구성 타당도 및 예측 타당도 비교)

  • Park, Yunji;Cho, Soohyun
    • Korean Journal of Cognitive Science
    • /
    • v.25 no.2
    • /
    • pp.159-187
    • /
    • 2014
  • Approximate number sense(hereafter, ANS) is the ability to compare and operate upon numerosity information. The numerosity comparison task is used to measure ANS. However, there is considerable variance among previous reports of ANS acuity which may be related to different task formats used. Here, we aim to investigate whether the format of the numerosity comparison task influences measurements of ANS acuity. We compared two task formats; 1) an intermixed format presenting two intermixed arrays of black and white dots, and 2) a side-by-side format showing two arrays of dots side by side. The intermixed format likely makes additional demands on general cognitive resources for inhibitory control, selective attention, or visuospatial working memory. The performance on the intermixed format was significantly lower than that of the side-by-side format resulting in an underestimation of ANS acuity compared to the expected trajectory of ANS development. In addition, the ANS acuity measured from only the side-by-side format was correlated with children's mathematical achievement and age. Our results demonstrate that measurement of ANS from the side-by-side format has higher construct and predictive validity compared to that of the intermixed format.

Application of the Onsite EEW Technology Using the P-Wave of Seismic Records in Korea (국내 지진관측기록의 P파를 이용한 지진현장경보기술 적용)

  • Lee, HoJun;Jeon, Inchan;Seo, JeongBeom;Lee, JinKoo
    • Journal of the Society of Disaster Information
    • /
    • v.16 no.1
    • /
    • pp.133-143
    • /
    • 2020
  • Purpose: This study aims to derive a predictive empirical equation for PGV prediction from P-wave using earthquake records in Korea and to verify the reliability of Onsite EEW. Method: The noise of P wave is removed from the observations of 627 seismic events in Korea to derive an empirical equation with PGV on the base rock, and reliability of Onsite alarms is verified from comparing PGV's predictions and observations through simulation using the empirical equation. Result: P-waves were extracted using the Filter Picker from earthquake observation records that eliminated noises, a linear regression with PGV was used to derive a predictive empirical equation for Onsite EEW. Through the on-site warning simulation we could get a success rate of 80% within the MMI±1 error range above MMI IV or higher. Conclusion: Through this study, the design feasibility and performance of Onsite EEWS using domestic earthquake records were verified. In order to increase validity, additional medium-sized seismic observations from abroad are required, the mis-detection of P waves is controlled, and the effect of seismic amplification on the surface is required.

Factor analysis using S-detect Method in Breast Ultrasound (유방 초음파 검사 시 S-detect 방법을 활용한 인자 분석)

  • Chun, Hye Ri;Jang, Hyon Chol;Cho, Pyong Kon
    • Journal of the Korean Society of Radiology
    • /
    • v.13 no.1
    • /
    • pp.9-14
    • /
    • 2019
  • This study aimed to investigate the performance of the S-detect method in breast ultrasonography and to determine how to reduce unnecessary biopsy by comparing the results of the S-detect method and biopsy. Thirty patients who had undergone breast ultrasonography between August and October 2018 and were scheduled to undergo biopsy because of the presence of breast nodules were retrospectively analyzed. The McNemar test was performed to determine whether detection of a malignant breast mass significantly differed between the S-detect method and biopsy. The following results were obtained from the analysis of the S-detect method: sensitivity, 90.9%; specificity, 84.21%; validity, 86.66%; positive predictive value, 76.92%; and negative predictive value, 94.11%. Analysis of the degree of agreement between the S-detect method and biopsy revealed a kappa value as high as 0.724 (p < 0.05), exhibiting good agreement between the two methods. The S-detect method in breast ultrasonography is diagnostically valuable in terms of distinguishing between malignant and benign breast masses, and if used properly before breast biopsy, unnecessary biopsy can be reduced.

Application of Multiple Linear Regression Analysis and Tree-Based Machine Learning Techniques for Cutter Life Index(CLI) Prediction (커터수명지수 예측을 위한 다중선형회귀분석과 트리 기반 머신러닝 기법 적용)

  • Ju-Pyo Hong;Tae Young Ko
    • Tunnel and Underground Space
    • /
    • v.33 no.6
    • /
    • pp.594-609
    • /
    • 2023
  • TBM (Tunnel Boring Machine) method is gaining popularity in urban and underwater tunneling projects due to its ability to ensure excavation face stability and minimize environmental impact. Among the prominent models for predicting disc cutter life, the NTNU model uses the Cutter Life Index(CLI) as a key parameter, but the complexity of testing procedures and rarity of equipment make measurement challenging. In this study, CLI was predicted using multiple linear regression analysis and tree-based machine learning techniques, utilizing rock properties. Through literature review, a database including rock uniaxial compressive strength, Brazilian tensile strength, equivalent quartz content, and Cerchar abrasivity index was built, and derived variables were added. The multiple linear regression analysis selected input variables based on statistical significance and multicollinearity, while the machine learning prediction model chose variables based on their importance. Dividing the data into 80% for training and 20% for testing, a comparative analysis of the predictive performance was conducted, and XGBoost was identified as the optimal model. The validity of the multiple linear regression and XGBoost models derived in this study was confirmed by comparing their predictive performance with prior research.

Coronary Computed Tomography Angiography for the Diagnosis of Vasospastic Angina: Comparison with Invasive Coronary Angiography and Ergonovine Provocation Test

  • Jiesuck Park;Hyung-Kwan Kim;Eun-Ah Park;Jun-Bean Park;Seung-Pyo Lee;Whal Lee;Yong-Jin Kim;Dae-Won Sohn
    • Korean Journal of Radiology
    • /
    • v.20 no.5
    • /
    • pp.719-728
    • /
    • 2019
  • Objective: To investigate the diagnostic validity of coronary computed tomography angiography (cCTA) in vasospastic angina (VA) and factors associated with discrepant results between invasive coronary angiography with the ergonovine provocation test (iCAG-EPT) and cCTA. Materials and Methods: Of the 1397 patients diagnosed with VA from 2006 to 2016, 33 patients (75 lesions) with available cCTA data from within 6 months before iCAG-EPT were included. The severity of spasm (% diameter stenosis [%DS]) on iCAGEPT and cCTA was assessed, and the difference in %DS (Δ%DS) was calculated. Δ%DS was compared after classifying the lesions according to pre-cCTA-administered sublingual nitroglycerin (SL-NG) or beta-blockers. The lesions were further categorized with %DS ≥ 50% on iCAG-EPT or cCTA defined as a significant spasm, and the diagnostic performance of cCTA on identifying significant spasm relative to iCAG-EPT was assessed. Results: Compared to lesions without SL-NG treatment, those with SL-NG treatment showed a higher Δ%DS (39.2% vs. 22.1%, p = 0.002). However, there was no difference in Δ%DS with or without beta-blocker treatment (35.1% vs. 32.6%, p = 0.643). The significant difference in Δ%DS associated with SL-NG was more prominent in patients who were aged < 60 years, were male, had body mass index < 25 kg/m2, and had no history of hypertension, diabetes, or dyslipidemia. Based on iCAG-EPT as the reference, the per-lesion-based sensitivity, specificity, positive predictive value, negative predictive value, and accuracy of cCTA for VA diagnosis were 7.5%, 94.0%, 60.0%, 47.1%, and 48.0%, respectively. Conclusion: For patients with clinically suspected VA, confirmation with iCAG-EPT needs to be considered without completely excluding the diagnosis of VA simply based on cCTA results, although further prospective studies are required for confirmation.

A Validation Study for the Practical Use of Screening Scale for Potential Drug-use Adolescents(SPDA) (청소년 약물사용 잠재군 선별척도(SPDA) 활용을 위한 타당화 연구)

  • Lee, Ki-Young;Kim, Young-Mi;Im, Hyuk;Park, Mi-Jin;Park, Sun-Hee
    • Korean Journal of Social Welfare
    • /
    • v.57 no.3
    • /
    • pp.305-335
    • /
    • 2005
  • This paper is a result from validation study for SPDA(A Screening Scale For Potential Drug-use Adolescents) created in 2003 and newly developed during 2004. SPDA aims to screen adolescents in their early stage of drug-use and to help practitioners make a preventive approach for the adolescents. 4307 junior and senior high school students were selected as primary research subjects by stratified and quota sampling methods. 305 adolescents on probation were also selected as a comparison group and asked to answer the same questionnaire. Reliability for SPDA recorded 0.914, which proved to be better than previous year's (0.898). Exploratory and confirmatory factor analyses to test construct validity proved that SPDA could be divided into 7 factors and that each factor structure of SPDA could be a proper measurement model with high level of fitness and factor loadings. Discriminant analysis to test predictive validity confirmed that SPDA could classify the adolescents excellently by the frequency of drug-use, with hit ratio of 86.6 percent(78.8% and 87.4% for junior and senior high school students respectively). For concurrent validity test, Hare Home Self-Esteem Scale, Hare School Self-Esteem, Zuckerman-Kuhlman Sensation-seeking Scale were employed to find correlation with SPDA and all the three scales had significant Pearson correlation coefficients with SPDA. Known-groups validity test indicated that SPDA had an adequate power to classify out adolescents on probation from those in schooling, with a hit ratio of 71.8 percent. Cut-off point to detect adolescents with high risk of substance use was 77, which indicated approximately T score, 55 (0.5 SD), satisfying sensitivity, specificity, and efficiency criteria.

  • PDF

A Study on Development of Questionaire for Use in Epidmiologic Survey on Respiratory Illness in Korea (호흡기계(系) 질환의 역학적(疫學的) 조사방법 게발에 관한 연구(II) -한국(韓國) 실정에 맞는 설문조사서 개발-)

  • Ahn, Yoon-Ok;Kim, Keun-Youl;Kwon, E-Hyock
    • Journal of Preventive Medicine and Public Health
    • /
    • v.15 no.1
    • /
    • pp.57-73
    • /
    • 1982
  • Questionaires on symptoms of respiratory disease have been used in Korea to elicit the probable health effects of air pollution in epidemiologic studies: The objectives of such studies often include comparing prevalence of symptoms of respiratory system between different population groups or between the same population groups, at different times. Unfortunately, little attention has, been paid to standardization of those questionaires, whether those are Korean. versions or not. Furthermore, no attempt to develop Korean ,questionaire on respiratory symptoms and relevant information has been made. Followed by 'a comparative study on responses to Korean version questionaires(English origin) of CMI, MRC, and ATS-DLD-78' two types of questionaires on respiratory symptoms and relevant information for Korean adult, which are short form (SUN-81-AS) and long forms (optional questions are added to the short one, SUN-81-AL), have been designed suitable to Korean background by authors (see Annex). The self-administered and closed-question questionaire were tested their validity and reliability by administration to l80 normal adults (medical and nursing students) and 60 clinical patients of Seoul National University Hospital, with spirometric exam. The results obtained and conclusions drawn are as follow: 1. It took less than 10 minutes to complete the questionaire SNU-81-AS and SNU-81-AL. 2. The test-retest reliability of each questions in AS and AL ,were observed as 92.7% and 92.1%, respectively. And all of the level of agreement are statistically significant with kappa statistic. 3. In addition to higher prevalence rate of symptoms in patients group compared, with, normal. group, the correlations between FEV 1.0/FVC predictive value(%) and number of symptoms were statistically significant inpatients group (See Fig. 1 and, Table 7). 4. The answer rate to optional questions in AL form among those who are not to do was about 10%, while the no-answer rate among who are to do was about 15% in Normal (medical and nursing students) group. 5. From the viewpoints of validity and reliability, the new Korean questionaire (SNU-81-AS and AL) developed by authors are to be recommendable to use in epidemiologic studies on respiratory illness in Korea. The self-administration, however, of optional questions in AL form may not assure the quality of data gathered.

  • PDF

Analysis of the Feasibility and Reliability of Models Measuring National Innovative Capability: with a Focus on the IUS of the EU (국가혁신역량 측정모형의 신뢰성과 타당성 분석: 유럽연합의 IUS를 중심으로)

  • Um, Ik-Cheon;Cho, Joo-Yeon;Kim, Dae-In
    • Journal of Korea Technology Innovation Society
    • /
    • v.17 no.1
    • /
    • pp.45-67
    • /
    • 2014
  • National Innovative Capability (NIC) is an important decisive factor where economic growth is concerned. As such, it is very important to measure and manage NIC. The composite index approach is one of the widely used approaches to measuring NIC, but there have been insufficient reviews of its feasibility and reliability. This paper conducted an analysis of the feasibility and reliability of the report on the last three years (i.e. 2011 through 2013) of the Innovation Union Scoreboard (IUS) of the EU, which is the most representative means of measuring NIC. It turned out that its reliability meets the recommended criteria as a result of Chronbach's alpha-based test of the models of IUS-related composite index. However, neither the absolute fit index nor the incremental fit index was found to meet the recommended criteria in a construct validity analysis. It also turned out that predictive validity is very low as a result of panel linear regression analysis of sectors and items of IUS-related composite index. This paper presents a number of considerations to be made when measuring national innovative capability using the composite index approach, as well as major policy suggestions based on the results of the analysis.

Availability of the Time and Change Test in Screening for Dementia in the Elderly (노인에서 치매 조기선별을 위한 시각.금전계산 검사의 유용성)

  • Chung, Eun-Kyung;Shin, Min-Ho;Rhee, Jung-Ae
    • Journal of Preventive Medicine and Public Health
    • /
    • v.36 no.2
    • /
    • pp.101-107
    • /
    • 2003
  • Objectives : Dementia has emerged as a leading public health problem in elderly persons, and its early detection is important for the treatment of curable cases, and in the educational support for other family members. Although dementia screening tests are available, they have not gained widespread use in community or primary care settings. Our goal was to validate the Tine and Change (T&C) Test, -including its validity and reliability in patients, and to assess it as a simple, standardized method for the screening of dementia in the rural elderly. Methods : The participants in this study comprised of 59 patients from an urban hospital and 405 persons from a rural community aged 65 years or older. The time test evaluated the understanding of clock hands indicating 11:10, and the change test the ability to make 1,000 Won from a group of coins, consisting of one 500, seven 100, and seven 50 Won coins. The T&C ratings were validated against a reference standard based on the physician's diagnosis of the patients. The convergent validity in relation to other cognitive measure, test-retest agreement, and inter-observer reliability were assessed. To assess the relationship between the Korean Mini-Mental State Exam (K-MMSE) and the T&C Test, the mean K-MMSE scores were compared with the results of the T&C Test in the elderly from a rural community. Results The T&C Test had a sensitivity and specificity of 73.0, and 90.9%, and positive and negative predictive values of 93.1, and 66.7%, respectively. The test-retest and inter-observer agreement rates were both 95%. The K-MMSE scores and T&C Test were significantly related in the elderly from a rural community (p<0.01), The T&C Test was not influenced by the educational status. The Time and Change Tests took a mean of 6.3 and 12.7 seconds, respectively, to complete Conclusion : The T&C Test is a simple, accurate and reliable, performance-based tool in the screening for dementia. Because it is quick, and easy-to-use, it is hoped the T&C Test will be used for the widespread cognitive screening of aging populations.

Accuracy of Temperature Measurements, Nursing Time for Measuring Temperature and the Validity of Fever Detection (체온측정방법의 정확도와 간호시간 및 발열감별 타당도 비교)

  • Sohng Kyeong-Yae;Kang Sung-Sil;Hwang Jin-Soon;Kim Myung-Ja
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.5 no.1
    • /
    • pp.33-45
    • /
    • 1998
  • The aim of this study was to investigate what is the most accurate and quick temperature measurement among rectal, auxiliary and tympanic routes. The body temperatures of 86 preform infants in incubators, a controlled environment, were measured at three different sites. The measurements were taken to examine the accuracy of the temperatures, proper nursing time for measuring the temperatures and the validity of fever detection. The results were as follows : 1. The mean temperature was significantly lower in the auxiliary site($36.71^{\circ}C$) and higher in the tympanic site($37.27^{\circ}C$) than in the rectal site($37.03^{\circ}C$). 2. The mean nursing time for measuring body temperature was significantly longer in the auxiliary site(171.65 seconds) and shorter in the tympanic site(17.70 seconds) than in the rectal site(83.33 seconds). 3. The nursing time for measuring body temperature included the time needed for preparation, measuring, as well as the post-measuring time. It was found that the time required to prepare for measuring the temperature of the rectal site was significantly longer than for other sites. In addition, the time needed to measure the temperature of the auxiliary site was significantly longer than in the other sites. Finally, the nursing time needed for measuring the auxiliary temperature(171.65 seconds) was the longest among the three sites whereas the nursing time for the tympanic site was the shortest(17.70 seconds). 4. Rectal temperature was significantly correlated to the tympanic(r=0.67) and auxiliary temperatures(r=0.69). Tympanic temperature was also significantly correlated to the auxiliary temperature(r=0.74). 5. The sensitivity, specificity, positive and negative predictive values of tympanic temperatures for detecting fever were 1.00, 0.80, 0.24, and 1.00, respectively. Those for the auxiliary temperatures were 0.00, 0.99, 0.00, and 0.94, respectively. Thus the level of fever detection was lower in the auxiliary temperatures than in tympanic temperatures. The above findings indicate that the tympanic method of temperature measurement offers a useful alternative to conventional methods.

  • PDF