• Title/Summary/Keyword: Reliability of the Test Results

Search Result 3,700, Processing Time 0.036 seconds

One year test-retest reliability of the Korea Sasang constitutional diagnostic questionnaire (KS-15) in university students (1년간 검사-재검사법을 통한 단축형 사상체질 진단 설문 (KS-15)의 신뢰도 평가)

  • Bae, Kwang-Ho;Kim, Sang-Hyuk;Go, Ho-Yeon;Park, Ki-Hyun;Lee, Siwoo;Lee, Soojin
    • Journal of Sasang Constitutional Medicine
    • /
    • v.31 no.2
    • /
    • pp.12-21
    • /
    • 2019
  • Objectives This study was aimed to evaluate the one-year test-retest reliability of the Korea Sasang constitutional diagnostic questionnaire (KS-15) in university students. Methods In March 2017, and March 2018, a survey was sent by email to 583 Korean medicine students in two universities. Of these, 149 (25.6%) participated and completed the first survey (test) and second survey (retest). Participants responded to the KS-15 questionnaire and the general characteristics including their age, sex, height, and weight. Cohen's kappa Spearman's rank correlation coefficient and agreement rate (%) were used for the test-retest reliability for each question item and the diagnosis of the Sasang constitution. The independent T-test was used to determine the difference in BMI between Sasang constitutional accordance and discordance groups obtained from the test-retest results of KS-15. Results The agreement of Sasang constitutional diagnosis was 75.8% (Kappa = 0.618), indicating that KS-15 had a certain level (substantial) of test-retest reliability. However, the kappa of each item was 0.161 ~ 0.620, which showed a large difference between the items. The agreements of each Sasang constitution were 85.1% for Taeeumin, 73.6% for Soeumin, and 58.6% for Soyangin. There was no significant difference in the BMI change between Sasang constitutional accordance and discordance groups in the test-retest. Conclusions These results indicate KS-15 has a reliable one-year test-retest reliability. However, further studies will be required to improve reliability, validity and application across different age ranges for the practical utilization of KS-15.

Investigation of Various Reliability Indices of Pre-service Mathematics Teachers' Teaching Aptitude and Personality Test based on Setting Cut Scores (예비수학교사의 교직 적성·인성 검사에서 분할점수 변화에 따른 다양한 신뢰도 탐색)

  • Kim, Sungyeun
    • The Mathematical Education
    • /
    • v.57 no.1
    • /
    • pp.55-74
    • /
    • 2018
  • The purpose of this study is first to examine the relative influence of each error source and to investigate the optimal measurement conditions to ensure satisfactory multiple reliability coefficients based on the teaching aptitude and personality test for pre-service teachers. Participants were 33 students enrolled in mathematics education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was highest, followed by nesting of items within domains, graduate students, interactions of graduate students with domains, and domains. Second, total 96 items, with 12 domains containing 8 items in each domain, with cut score of 598, and original 210 items, with 14 domains containing 15 items in each domain, with cut scores of 615 or 716 were optimal measurement conditions to reach acceptable reliability levels based on the joint consideration of dependability coefficients, cut score dependability coefficients, adjusted dependability coefficients, and standard errors of measurement. Third, larger deviations between the arithmetic mean and the cut score indicated higher reliability coefficients of the test results. Finally, this study suggests ways for practitioners to consider how to apply generalizability theory for criterion-referenced tests and how to develop future research based on limitations.

Reliability and Validity of the Side-lying Instability and Prone Instability Tests in Patients with Lumbar Segmental Instability

  • Kim, Bo-Eon;Lee, Kwan-Woo;Park, Dae-Sung
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.16 no.1
    • /
    • pp.1-7
    • /
    • 2021
  • PURPOSE: The purpose of this study is to conduct inter-rater and intra-rater reliability tests in patients with low back pain (LBP) using the prone instability test (PIT) and side-lying instability test (SIT). We have analyzed the Korean version Oswestry disability index (K-ODI) correlations and radiograph finding (RF) for validity. METHODS: Individuals (n = 51) (mean age of 40.27 ± 13.28) with LBP for at least over a week were recruited, together with two participating physical therapist examiners. The measurement consisted of PIT, PST, K-ODI, and RF. Sensitivity (Sn), specificity (Sp), positive predictive value, negative predictive value, prevalence index, agreement %, Cohen's kappa, and prevalence-adjusted bias-adjusted kappa (PABAK) were calculated. The PIT and SIT were compared with RF for validity analysis, while PIT, SIT, K-ODI, and RF were calculated for the correlation analysis. RESULTS: The intra-rater reliability test measured for the PIT (kappa = .79, PABAK = .88) and SIT (kappa = .73, PABAK = .84), and inter-rater reliability test measured for the SIT (kappa = .80, PABAK = .88) showed good agreements. The PIT (Sn = .65, Sp = .63) and SIT validities (Sn = .68, Sp = .70) were compared with RF, showing a significant correlation in PIT and RF (r = .69), SIT and RF (r = .73), and PIT and K-ODI (r = .53). CONCLUSION: The SIT is a more comfortable position test than the PIT in patients. Both PIT and SIT have acceptable reliability and validity.

The Study on the Rater Reliabilities of Physical Therapy Students Pediatric Balance Scales items (물리치료과 학생들을 대상으로 아동균형척도의 항목별 측정자 신뢰도에 관한 연구)

  • Hwang, Ryoung;Kim, Gi-Won
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.8 no.1
    • /
    • pp.137-145
    • /
    • 2013
  • PURPOSE: The purpose of this study is to examine assessment of test-retest reliability for 13 items of pediatric balance scales, then the intrarater reliability among the raters. METHODS: Study participants included 6 children with spastic cerebral palsy who could walk. Raters were consist of seventy-four, 2nd year physical therapy major students. The children's ability to achieve physical balance was wideotaped for PBS items. The raters watched the tapes and evlauated each child twice. Test-retest reliability was analyzed using the Spearman correlation, and interrater reliability was analyzed using the Kendall's coefficient of concordance for ranks. RESULTS: The total PBS scores averaged 49.22 and 50.06 for first and second tests. Test-retest reliability of PBS individual items were between low and high. The low itmes were 3 items, and high were 4 itmes. Interrater reliability were low agreement. CONCLUSION: Based on the study, the pediatric balance scale is an effective evaluating tool for measuring functional balance of school age child. However, the agreement of students or beginner's interpretation is necessary in conjunction to this study results. On top of that, it is important to provide detailed explanation and repetitive training, which improves the analysis reliability. Also, each category subscores level for the pediatric balance scale must be examined carefully in conjunction to performing test, only after improving match quality via preceding practice.

A Study on the Reliability Evaluation System for O-ring of Semiconductor Equipments (반도체장비용 오링의 종합 신뢰성 평가기술에 관한 연구)

  • 김동수;김광영;최병오;박화영
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2001.04a
    • /
    • pp.613-617
    • /
    • 2001
  • The test items like as endurance, air leakage and oil endurance test is requested for reliability evaluation about O-ring which is a kind of core machinery accessories of semi-conduct manufacturing equipment. For verification of these, we design and manufactured a test system for endurance, air leakage and oil endurance of O-ring for semi-conduct manufacturing equipment, and also performed the test for two kinds of O-ring, as it were Viton and Kalretz. The characteristics of this test equipment consist in realization of the test conditions of semi-conduct manufacturing equipment and satisfying the test method. The test conditions are cut gas, vacuum grade, temperature and revolution numbers in the endurance test system, vacuum grade and temperature in the air leakage test system, temperature and time in the oil endurance test system. The separating test results for wearing which is an oil endurance test item, the wearing index of domestic produced Viton O-ring is higher than foreign product by 2%, wearing rate of Kalretz O-ring better than Viton O-ring by 17%, and particles existed in various place. The test result of air leakage which is measured through the RGA sensor used Helium, the vacuum grade was $10^-3$Torr. And the test result of oil endurance, the volume change rate was 7~15%. Hereafter, we intend to analysis the reliability test evaluation and to utilize for domestic manufacturing companies by establishing data base and developing reliability softwares.

  • PDF

A Study on Warranty and Quality Assurance Model for Guided Missiles Based on Storage Reliability (저장신뢰도 기반의 유도탄 품질보증모델에 대한 연구)

  • Jung, Sanghoon;Lee, Sangbok
    • Journal of Applied Reliability
    • /
    • v.17 no.2
    • /
    • pp.83-91
    • /
    • 2017
  • Purpose: The purpose of this study is to develop a quality assurance model and to determine appropriate warranty period for a guided missile using its field data. Methods: 10 years of actual firing data is collected from the defense industry company and military. Parametric maximum likelihood estimation for a reliability function is determined with the data. Results: The reliability function estimates average lifetime of the missile. That function shows a user requirement, 80% reliability (lifetime) is come up when 8 years have passed, which is longer than the estimates in the missile's development phase. Conclusion: Quality assurance warranty for a guided missile must be established with actual test data. It is necessary to update and modify the reliability prediction and the warranty period with actual field test data.

The Reliability and Validity of Korean Pediatric Functional Muscle Testing in Children with Motor Disorder

  • Seo, Hye-Jung;Kim, Joong-Hwi
    • The Journal of Korean Physical Therapy
    • /
    • v.28 no.4
    • /
    • pp.232-242
    • /
    • 2016
  • Purpose: This study was conducted to develop a Korean version of the pediatric functional muscle test (K-PFMT) for children with motor developmental disorders, and to verify its reliability and validity. Methods: The subjects were 40 children, aged below 5 years. Each was scored on the K-PFMT by 14 physical therapists to determine inter-rater reliability and internal consistency. Additionally, 3 of the 14 therapists tested 20 children again one or two weeks later to determine test-retest reliability. The internal consistency was calculated by Cronbach's alpha. The inter-rater and test-retest reliability were calculated using the intraclass correlation coefficient (ICC). One-way ANOVA and the paired t-test were used to compare differences among the three evaluator groups and between the test and retest group. Concurrent validity was evaluated by Pearson's correlation with a total score of GMFM. Results: Chronbach's alpha was over 0.98 for each test item and 0.99 for the total items. There was no significant differences in the score of K-PFMT among the three evaluator groups except for a few items. The test-retest ICC was from 0.89 to 1.00 and from 0.82 to 1.00, respectively. There was no significant difference between the test and retest group, except for a few items. There were high significant correlations between K-PFMT and GMFM. Conclusion: This study showed that a K-PFMT with relatively high reliability and validity was successfully developed. The K-PFMT will be a useful tool for measurement of muscle strength of children with motor developmental disorder.

Accelerated Creep Testing of Geogrids for Slopes and Embankments: Statistical Models and Data Analysis

  • Koo, Hyun-Jin;Kim, You-Kyum;Kim, Dong-Whan
    • Proceedings of the Korean Reliability Society Conference
    • /
    • 2004.07a
    • /
    • pp.227-232
    • /
    • 2004
  • The failure of geogrids can be defined as an excessive creep strain which causes the collapse of slopes and embankments. In this study, the accelerated creep tests were applied to two different types of polyester geogrids, at 75, 80, 85$^{\circ}C$ by applying 50% load of ultimate tensile strengths using a newly designed test equipment which is allowed the creep testing at higher temperatures. And then the creep curves were shifted and superposed in the time axis by applying time-temperature supposition principles. In predicting the lifetimes of geogrids, the underlying distribution for failure times were determined based on identification of the failure mechanism. The results indicate that the conventional procedures with the newly designed test equipment are shown to be effective in prediction of the lifetimes of geogrids with shorter test times. In addition, the predicted lifetimes of geogrids having different structures at various creep strains give guidelines for users to select the proper geogrids in the fields.

  • PDF

The Reliability of Thickness Measurement of the Deep Fiber of the Lumbar Multifidus Using Ultrasonography

  • Jung, Doh-Heon;Kim, Su-Jung;Yi, Chung-Hwi;Cynn, Heon-Seock;Choi, Houng-Sik
    • Physical Therapy Korea
    • /
    • v.17 no.4
    • /
    • pp.49-54
    • /
    • 2010
  • The reliability of the thickness measurement of the lumbar multifidus (LMD using real-time ultrasonography (US) was determined in only the superficial fiber of the lumbar multifidus (SM). However, previous studies have not examined the reliability of the deep fiber of the LM (DM). The purpose of this study was to determine the intrarater and the interrater reliability of the thickness measurements of DM using US. Eleven heathy males participated in the study. The thickness of the DM was measured with an US in the prone position. Reliability was examined using intraclass correlation coefficients (ICC), standard error of the measurement (SEM), and the Bland and Altman plot. ICC(3,1) was used to calculate the interrater reliability of the thickness measurement of DM using the values from both the first and second test sessions. Additionally, ICC(3,1) was used to calculate the intrarater reliability of the measurements over two days using the measurements obtained in test session 1 and lest session 2. The results of this study were as follows: 1) the ICC(3,1) value for interrater reliability was .94 in the first test session, and .93 in the second test session. 2) the ICC(3,1) values for intrarater reliability of the measurements over two days was .90 in both the first examiner and the second examiner. The interrater reliability and interrater reliability of the DM measurements, obtained via the US protocol used in this research was excellent. Therefore, we conclude that the thickness measurement of the DM obtaioned from the US protocol used in this research would be useful for clinician assessment of the thickness of the DM.

Creep Lifetime Prediction of Composite Geogrids using Stepped Isothermal Method

  • Koo, Hyun-Jin;Cho, Hang-Won
    • Proceedings of the Korean Reliability Society Conference
    • /
    • 2006.05a
    • /
    • pp.158-164
    • /
    • 2006
  • The creep behavior of newly developed composite geogrids which consists of PET yarns sheathed in PP were evaluated using SIM. For the SIM procedure, three test parameters, the applied loads, temperature steps and number of ribs were investigated, The study confirmed that temperature steps of 10 and 14$^{\circ}C$ up to 80$^{\circ}C$ are applicable for composite geogrids due to the different transition temperatures between two materials. At applied loads of 40 and 50%, only primary creep state was measured, while secondary creep state appeared at the applied loads of 60%, The lifetimes of composite geogrids were estimated at each of loading level using statistical reliability analysis technique. The results show that the lifetimes longer than 100 years can be predicted within 16 hours. Therefore, SIM is very effective and economical accelerated creep test methods, especially for lifetime prediction. This gives guidelines for users to select the appropriate factor of safety against creep considering the field condition within shorter test times.

  • PDF