• Journal of the Ergonomics Society of Korea
• /
• v.32 no.3
• /
• pp.267-271
• /
• 2013

Objective: The purpose of this study is to examine the test-retest reliability of paper-pencil test for investigating population stereotype of burner-control linkages of four-stove gas ranges. Background: Much of the research on gas-range stereotype strength has been performed using the paper-pencil test. While the use of the paper-pencil tests has the advantage of collecting data in a large group of subjects against reasonable costs, concerns regarding the reliability of the paper-pencil test has also been stated. Method: Three paper-pencil tests classified by intervals of test-retest were performed, in which eight types of burner-control arrangements were investigated. Sixty eight subjects were test-retested within two weeks, 85 subjects were test-retested within four weeks and 58 subjects were test-retested three times in series with interval of two and four weeks. Results: Chi-square test showed that three intervals of test-retest including two, four and two & four weeks have not statistically significant effect on subjects' responses irrespective of eight types of burner-control linkages dealt with in this study(p>0.10). Concordance rates of subjects' responses ranged between 73.5% and 100.0% for two-week test-retest, between 67.1% and 97.6% for four-week test-retest, and between 65.5% and 100.0% for two- and four-week serial test-retest. The concordance rates were linearly correlated with proportion of subjects' responses for stereotypes of burnercontrol linkages. Conclusion: It is concluded that the paper-pencil tests for investigating gas range relevant stereotypes could reproduce reliable results compared to baseline test within interval of four weeks. Application: The results of this study would be useful as an ergonomic guideline when designing the paper-pencil tests for stereotype relevant studies.

• Journal of Sasang Constitutional Medicine
• /
• v.35 no.1
• /
• pp.35-45
• /
• 2023

Objectives We tried to examine the change in the test-retest response for the questionnaire itself regarding the QSCCII. Methods Tests were conducted twice times with an interval of 6 months between tests for test-retest reliability analysis. We examined the test-retest answer agreement rate (%) in all items of QSCCII . We conducted NcNemar analysis to examine test-retest reliability for 77 items selected from the QSCCII. Results The body shape-multiple-choice items showed a tendency of low test-retest agreement rate and most of the questions about when I was not well and when I felt my body condition improve showed an high test-retest agreement rate tendency in all items of QSCCII. As a result of the research on the selected 77 items, there was a significant change in the answer in item No.25, 58(in the item of Soeumin) item No.45, 103(in the item of Taeumin) and item No.87 (in the item of Soeumin) (Table.3, 4, 5, 6). Conclusion The QSCCII is shown as a questionnaire composed of mostly no significant response changes in test-retest in each item through this study. Some items were appropriately deleted in the process of developing the advanced model, but there are also items that should be considered further. It is thought that some items should be used after being refined in content and form.

• Journal of Sasang Constitutional Medicine
• /
• v.21 no.1
• /
• pp.79-84
• /
• 2009

1. Objectives This study was proposed to use the test-retest method to verify the independence and agreement between the questions (Short Form Sasang Classification Questionnaire for American ; SF_SSCQ-A). 2. Methods The questionnaire was administered to 50 American and they were asked to complete the questionnaire again two weeks after the first administration. The final subjects are 42 except of 5 dropouts and 3 insufficient respondents. A reliability analysis for each individual question was conducted using the test-retest method to verify the independence and agreement between the questions. To verify independence, a Chi-square test with crosstabs analysis and p-values was used. The agreement verification was conducted by using the Cohen kappa coefficient. In addition, the constitutional variable was defined as the constitutional attribute of each question, and Pearson's correlation coefficient was confirmed after testing the scale. 3. Results and Conclusions The test-retest method showed that Pearson's correlation coefficients for the results of the two tests ranged from 0.66 to 0.87. The Chi-square test results indicated that there are 7 independent item. Among the other 114 questions, the agreement test revealed that 88 questions (70.5%) showed above common agreement.

• Journal of the Optical Society of Korea
• /
• v.16 no.4
• /
• pp.418-424
• /
• 2012

The purpose of this study was to assess repeatability and reliability of a new phoria test as compared to established phoria tests and to assess the possibility of mobile or online testing using the auto-flashed presentation. Near dissociated phoria was measured using the von Graefe method, the Howell card test, the modified Thorington test, and a new dichromatic card test (Red-Blue Phoria card test; RBP card test) on 109 subjects. The inter-examiner difference and test-retest difference were calculated. With the auto-flashed presentation of the RBP card test, near dissociated phoria was measured and the intraclass correlation coefficient and test-retest repeatability was assessed on 26 subjects. The variation in inter-examiner repeatability was the smallest for the modified Thorington test (+3.1/-2.6). The RBP card test was +3.0/-3.1, the Howell card test was +3.5/-2.7, and the von Graefe test was +6.2/-6.0. The variation in test-retest repeatability was the smallest for the RBP card test (+0.4/-1.4). The modified Thorington test was +1.3/-1.3, the Howell card test was +1.27/-1.45, and the von Graefe test was +1.59/-2.20. The ICC was 0.919 for the auto-flashed presentation of the RBP card test. The RBP card test is considered a highly repeatable method clinically and can be made a useful application for testing in mobile or online.

• Journal of Preventive Medicine and Public Health
• /
• v.56 no.5
• /
• pp.407-412
• /
• 2023

Objectives: Work stress is associated with non-communicable diseases, increased healthcare costs, and decreased work productivity among employees in the information technology sector. There is a need for regular work-stress screening among employees using valid and reliable tools. The Tool to Assess and Classify Work Stress (TAWS-16) was developed to overcome limitations in existing stress assessment tools in India. This study aimed to test the reliability of TAWS-16 in a sample of managerial-supervisory employees. Methods: This observational reliability study included data from 62 employees. Test-retest and inter-method reliability were investigated using a TAWS-16 web application and interview by telephone, respectively. Kappa values and intra-class correlation coefficients were calculated. Internal consistency was assessed through Cronbach's alpha. Results: For both test-retest and inter-method reliability, the agreement for both work-related factors and symptoms suggestive of work stress exceeded 80%, and all kappa values were 0.40 or higher. Cronbach's alpha for test-retest and inter-method reliability was 0.983 and 0.941, respectively. Conclusions: TAWS-16 demonstrated acceptable reliability. It measured stressors, coping abilities, and psychosomatic symptoms associated with work stress. We recommend using TAWS-16 to holistically identify work stress among employees during periodical health check-ups in India.

• Journal of Korean Ophthalmic Optics Society
• /
• v.17 no.2
• /
• pp.209-213
• /
• 2012

Purpose: To assess the repeatability of the monocular spherical endpoints, a test was performed with four methods which are the retinoscopy, the MPMVA (maximum plus maximum visual acuity) method, the R/G duochrome method, and the crossed cylinder method. Methods: The monocular spherical endpoints was measured by four kinds of method (Retinoscopy, MPMVA method, R/G duochrome method, Crossed cylinder method) on 20 subjects (40 eyes) of average age 23.0 year-old men and women. After a week, retest was performed by same procedure and the test-retest repeatability was assessed by using the Bland-Altman plot analysis. Results: The test-retest mean difference of retinoscopy was the smallest diopters of -0.03 and that of R/G duochrome method was the largest diopters of -0.19. The upper/lower 95% limits of agreement for repeatability was the narrowest in retinoscopy and was the widest in crossed cylinder method. When compared the spherical endpoints of each eye between by retinoscopy and by other three methods, the error rate of ${\pm}0.25D$ in total eyes was 85% in MPMVA method, 80% in R/G duochrome method, and 24% in crossed cylinder method. Conclusions: Test-retest repeatability is the highest in the retinoscopy, and the retinoscopy, the MPMVA method, and R/G duochrome method are suitable for monocular spherical endpoints test.

• Journal of Korean Academy of Nursing
• /
• v.29 no.6
• /
• pp.1294-1303
• /
• 1999

The purpose of this study was to develop a tool to assess the powerlessness and to measure the powerlessness of elderly. From the result of pre-test, twenty seven items were finally selected to survey the elderly's powerlessness. The questionnaires on the elderly's powerlessness were drafted so that such tool may be evaluated in accordance with the four point Likert Scale. The number of subjects is 1,150 with ages of 60 years or more and who live in a large city, a small and middle-sized city and a rural area. The subjects of the test and retest were 85 elderlies. Collected data were analyzed by utilizing SAS program with Cronbach's $\alpha$ and Pearson's correlation, factor analysis method and known group techniques, descriptive statics, t-test and ANOVA. The results from this study were summarized below:1. When the factor analysis method was applied for validity, the tool for powerlessness of elderly was separated into 5 factors: loss of self-confidence to deal with physical, emotional, social aspects of life; expulsion by others from meaningful human relate; perception that life is meaningless and time passes quickly; falling behind young people; being rejected by other people, having no influence on others. An application of the known group technique showed a significant difference with the result of the degree of elderly's powerlessness tools developed by the two groups, with illness and without. 2. In testing reliability, it was found that coefficient of test-retest was .9435(P<.0001) when the test-retest method was used as a test of stability, and that the alpha coefficient of internal consistency was .9141 over all items within the tool of elderly's powerlessness 3. In powerlessness of elderly, total mean is 2.8493. And in factor of powerlessness, the highest factor is falling behind young people (M=3.1713), the lowest factor is loss of self- confidence to deal with physical, emotional, social aspects of life(M=2.6080). 4. The results from the test for the degree of powerlessness, according to the subject's demographic variables, showed that there were significant differences between age, sex, marital status, educational level, religion, possession of house, job, monthly pocket money, health status, illness and a place of residence.

• Physical Therapy Korea
• /
• v.20 no.2
• /
• pp.60-68
• /
• 2013

The purpose of this study was to assess the intra-rater test-retest reliability of tibial external rotation angle measurement using a smartphone-based photographic goniometer, DrGoniometer (DrG) compared to a three-dimensional motion analysis system (Vicon). The current study showed an interchangeable method using DrG to measure the tibial external rotation angle in standing knee flexion at $90^{\circ}$. Twelve healthy subjects participated in this study. A rest session was conducted 30 minutes later for within-day reliability and five days later for between-day intra-rater test-retest reliability. To assess the validity of the measurement using DrG, we used a three dimensional motion analysis system as a gold standard to measure the angle of tibial external rotation. Intra-class correlation coefficient (ICC) and the standard error of measurement (SEM) values were used to determine the within- and between- day intra-rater test-retest reliability of using DrG and a three dimensional motion analysis system. To assess validity, Pearson correlation coefficients were used for two measurement techniques. The measurement for tibial external rotation had high intra-rater test-retest reliability of within-day (ICC=.88) and between-day (ICC=.83) reliability using DrG and of within-day (ICC=.93) and between-day (ICC=.77) reliability using a three-dimentional motion analysis system. Tibial external rotation angle measurement using DrG was highly correlated with those of the three-dimensional motion analysis system (r=.86). These results represented that the tibial external rotation angle measurement using DrG showed acceptable reliability and validity compared with the use of three-dimensional motion analysis system.

• Physical Therapy Korea
• /
• v.19 no.4
• /
• pp.46-54
• /
• 2012

Ely's test is commonly used to assess rectus femoris muscle flexibility. however, a reliability limit of this test was demonstrated by a previous study. In this study, we present an alternative method using an application for a digital horizontal level in a smartphone (DHLS) to complement the reliability limit of Ely's test. The aim of this study was to examine the reliability of Ely's test using DHLS on the pelvis, compared to using visual observation (VO) of pelvic and hip motions. Nineteen patients with lumbar extension-rotation syndrome were recruited for this study. An examiner examined the rectus femoris flexibility (both pass/fail and goniometer scoring) through Ely's test using both DHLS and VO. A retest session was completed two hours later for within-day reliability and seven days later for between-day intra-rater test-retest reliability. Results showed higher Kappa values for pass/fail scoring and higher intraclass correlation coefficient values for goniometer scoring in Ely's test using DHLS, compared to using VO. Measurement error and Bland and Altman plots further demonstrated the degree of intra-rater variance during Ely's test using DHLS in a clinical setting, compared to using VO. These results demonstrated that Ely's test using DHLS showed acceptable reliability compared to using VO. Ely's test using DHLS could be widely used for measuring the rectus femoris muscle flexibility in patients with lumbar extension-rotation syndrome, although the inter-rater reliability needs to be established first.

• Journal of The Korean Society of Integrative Medicine
• /
• v.5 no.1
• /
• pp.43-53
• /
• 2017

Purpose : To examine the relative absolute reliability and validity of step test (ST) scores in subjects with chronic stroke. Method : A total of 27 stroke patients, participated in the study. A relative reliability index (intraclass correlation coefficient, ICC) was used to examine the level of agreement of inter-rater test-retest reliability for ST score. Absolute reliability indices, including the standard error of measurement(SEM) and the minimal detectable change (MDC), and limits of agreement by Bland and Altman analysis. The validity was demonstrated by spearman correlation of ST score with 10 m Walk Test (10mWT), Fugl-Meyer Assessment-Lower/Extremity (FMA-L/E)-total score, Berg Balance Scale (BBS)-total score. Result : An excellent inter-rater reliability in ST scores was found (paretic, ICC=0.993~0.996; nonparetic, ICC=0.982~0.991). In addition, excellent test-retest reliability was found (paretic, ICC=0.992; nonparetic, ICC=0.967). It all showed acceptable SEM of the ST score as paretic and nonparetic were 0.22 and 0.46 respectively (average score <10 %), and the MDC of the paretic and nonparetic were 0.61 and 1.27 respectively (possible highest score <20 %). indicating that measures had a small and acceptable measurement error. The ST score of paretic and nonparetic were also found to be significantly associated with 10MWT (r=0.77~0.79), FMA-LE scores (r=0.73~0.81) and BBS scores (r=0.72~0.76). Conclusion : The ST showed highly sufficient Inter-rater test-retest agreement and validity and acceptable measurement errors caused by due to chance variation in measurement. It also can be used by clinicians and researchers to assess the balance and mobility performance and monitor functional change in chronic stroke patients.