• Title/Summary/Keyword: Test-retest Method

Search Result 88, Processing Time 0.024 seconds

The Development of Infant Montessori Performance Assessment Scales - Centered on 6 to 24 Month Infants - (영아용 몬테소리 수행평가 도구 개발 - 6~24개월 영아를 중심으로 -)

  • Kim, Myung-Hee;Shin, Hwa-Sik;Kim, Ji-Young;Kim, Min-Sun
    • Korean Journal of Child Studies
    • /
    • v.26 no.2
    • /
    • pp.27-41
    • /
    • 2005
  • The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

  • PDF

Analysis of Visual Sensibility Evaluation of Naturally Colored Organic Cotton: Identification of Reliability and Proper Scouring Method

  • Park, Jang-Woon;Chang, Yoon;Hong, Won-Gi;Lee, Myung-Eun;Han, Ah-Reum;Chae, Young-Joo;Cho, Gil-Soo;You, Hee-Cheon
    • Journal of the Ergonomics Society of Korea
    • /
    • v.30 no.2
    • /
    • pp.311-317
    • /
    • 2011
  • Objective: The present study was intended to identify (1) the intra- and inter-rater reliabilities of a visual sensibility evaluation protocol and (2) the effects of NaCOC color and scouring method on the visual sensibility of NaCOC. Thirty female participants(20s & 30s) were participated in the visual sensibility evaluation of NaCOC. Background: Interests in naturally colored organic cotton(NaCOC) increase rapidly in parallel with the social trend of eco-friendly living and wellbeing. Method: Three color sets (ivory, green, and coyote-brown) of NaCOC specimens including one untreated and four treated specimens($Na_2CO_3$; NaOH; enzyme; boiling water) were examined in the study. The visual sensibility evaluation was conducted by the test-retest method using nine pairs of bipolar visual sensibility adjectives(bright-dark; clear-murky; heavy-light; vivid-subdued; warm-cool; fresh-stale; strong-weak; showy-plain; and luxurious-cheap). Results: As a result of reliability of a visual sensibility evaluation protocol, inter-rater variability(average SD=1.06) of visual sensibility evaluation was more than 1.4 times the intra-rater variability(average SD=0.74). However, both the sensibility evaluation reliabilities did not show any systematic pattern of changes. Lastly, ANOVA and post-hoc analysis showed that preferred scouring methods for a visual sensibility adjective pair significantly vary depending on NaCOC color. Application: Both the reliability of visual sensibility evaluation protocol and the analysis of proper scoring method of NaCOC in the study would be useful information to design the affective textile.

Reliability of Quantifying Maximal Mouth Opening and Lateral Mandibular Shift in Individuals With and Without Temporomandibular Disorder Using Three-dimensional Ultrasound-based Motion Analysis

  • Oh, Jae-seop;Kim, Si-hyun;Kyung, Moon-su;Park, Kyue-nam
    • Physical Therapy Korea
    • /
    • v.26 no.3
    • /
    • pp.99-105
    • /
    • 2019
  • Background: Although magnetic resonance imaging is accurate, it is expensive to measure the movement of temporomandibular joint. The three-dimensional (3D) motion analysis system is an inexpensive measurement tool. Objects: This study examined the reliability of quantifying the mouth opening and lateral mandibular shift and differences between individuals with and without temporomandibular disorder (TMD) using the hygienic method of surface markers on the skin with 3D ultrasound-based motion analysis. Methods: This study included 24 subjects (12 with and 12 without TMD). Temporomandibular joint motion during mouth opening was recorded using two surface markers with 3D ultrasound-based motion analysis. An intraclass correlation coefficient [ICC (3,k)] was used to confirm the intrarater reliability of quantifying kinematic temporomandibular joint motion, and an independent t-test was used to evaluate differences in maximal mouth opening and lateral mandibular shift between the two groups. Results: Assessment of mouth opening and lateral mandibular shift showed excellent test-retest reliability with low standard error of measurement. The lateral mandibular shift and opening-lateral mandibular shift ratio were significantly increased in the TMD group during maximum mouth opening (p<.05). However, no significant difference in maximal mouth opening was observed between the groups with and without TMD (p>.05). Conclusion: This hygienic and simple surface marker method can be used to quantify the mouth opening and lateral mandibular shift at the end-range of mouth opening. The TMD group showed an increased lateral mandibular shift movement at the end-range of mouth opening. The lateral mandibular shift movement can be regarded as a symptom in the diagnosis and treatment of TMD.

A Study on the Measurement of Clothing Behavior of Elementary School Children (학령기 아동의 의복행동 측정도구 개발에 관한 연구 -4, 5, 6학년 아동을 중심으로-)

  • Lee Myoung Hee
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.11 no.2 s.24
    • /
    • pp.1-11
    • /
    • 1987
  • The purpose of this study was to develope a questionaire measuring clothing behavior of elementary school children. At first, after pretest, the clothing behavior questionaire consisted of 70 items which were devidad. into 7 subscales i.e. Clothing interest. Clothing satisfaction. Clothing management, Clothing sex-role. Clothing comfort. Clothing conformity. and Clothing independence. Each item was rated on a 3-point scale. Samples were 447 boys and girls (4 th, 5 th, 6 th grade) of three elementary schools in Seoul. Korea. The data were analyzed by item analysis and factor analysis. Factor analysis was useful in attempting to establish contruct validity. Item validity was examined based on the correlation coefficients and item discriminating power through the chi-square. Reliability was examined based on the Cronbach's Alpha Reliability Coefficient and test-retest method. With this analysis the subscales were reconstructed to following 6 factors. Clothing conformity items were not clustered by the factor analysis. 52 items of 6 factors selected by the analysis. The factors characteristics were as follows: 1. Clothing interest (10 items) 2. Clothing satisfaction (11 items) 3. Clothing management (8 items) 4. Clothing sex-role (12 items) 5. Clothing comfort (6 items) 6. Clothing independence (5 items)

  • PDF

Evaluation of Survey Data Quality Based on Interviewers' Assessments: An Example from Taiwan's Election and Democratization Study

  • Tsai, Chi-lin;Liu, Tsung-Wei;Chen, Yi-ju
    • Asian Journal for Public Opinion Research
    • /
    • v.7 no.1
    • /
    • pp.57-74
    • /
    • 2019
  • Researchers usually examine the quality of survey data by several conventional measures of reliability and validity. However, those measures are mainly designed to examine the quality of an individual measurement, rather than the quality of a data set as a whole. There is a relative lack of methods for evaluation of the overall data quality. This paper attempts to fill this gap. We propose using interviewers' assessments as one of criteria for evaluating the overall data quality. Interviewers are the ones who literally conduct and thus directly observe interviews. Taiwan's Election and Democratization Studies (TEDS) have required interviewers to assess how trustworthy the responses of each of their interviewees are, and to provide several descriptions about the process and environment of the interviews. We use this information to evaluate the data quality of TEDS surveys and compare it with the results from the conventional test-retest method. The findings are that the interviewer assessment is a fair indicator of the overall reliability of attitudinal questions but not a good indicator when factual questions are examined. Regarding the evaluation of data validity, more data is required to see whether or not interviewers' assessment is informative in terms of data quality.

Development and Validation of an Instrument to Measure the Job Satisfaction of Perioperative Nurses (수술실 간호사의 직무 만족도 측정 도구 개발 연구)

  • Yoon, Ke Sook;Park, Sung Ae
    • Journal of Korean Clinical Nursing Research
    • /
    • v.15 no.1
    • /
    • pp.93-106
    • /
    • 2009
  • Purpose: The purpose of this study was to develop a valid and reliable instrument to explore and measure job satisfaction as perceived by perioperative nurses, specifically from the perspective of contemporary perioperative nursing in Korea. Method: Items (69) were developed from the responses to two open-ended questions by 168 perioperative nurses in one teaching hospital; (a) reasons that make work enjoyable, (b) reasons that make work unpleasant. Finally 55 items were selected, excluding items with lower correlation with the total scale. The instrument was completed by 885 perioperative nurses from 89 different hospitals nationwide who were attending the annual conference of the Korean Association Operating Room Nurses (KAORN), yielding a response rate of 95.6%. Results: Ten factors were extracted by factor analysis, which explained 60.0% of the total variance; Reliability and internal consistency were established (Cronbach's alpha=.95). A smaller sample of 39 perioperative nurses completed the instrument on two occasions, with a 2-week interval between. Mean scores were computed and two sets of scores were analyzed by Weighted Kappa (W-Kappa=0.680, p=.029). Conclusion: This instrument is a concise, highly practical and flexible tool, which can be used for the perioperative nurse in a wide range of hospital settings.

A Short form of the Gray-Wheelwright Test (단축형 그레이-휠라이트 검사)

  • Ju-Kab Lee;Sung-Hyun Kim;Yong-Wook Shin
    • Sim-seong Yeon-gu
    • /
    • v.33 no.1
    • /
    • pp.61-80
    • /
    • 2018
  • We investigated whether the 81 items of the Gray-Wheelwright test correctly measure the concept of Jung's typology and aimed to refine the test. Participants (n=431) completed the Gray-Wheelwright test, and the results were analyzed using factor analysis with the varimax rotation and the maximum likelihood extraction method. A pair of opposing attitudes, introversion/extroversion, or one of the two pairs of opposing functional types, thinking/feeling or intuition/sensation, was labeled to the extracted factor according to the majority type of the items in the factor. The minority items or items not included in any factors were excluded from making a short form of the Gray-Wheelwright test with 45 items. We used intraclass correlation (ICC) coefficient and Cronbach's alpha for the test-retest reliability and internal consistency of the test, respectively. The newly developed short form of the Gray-Wheelwright test measured the Jung's personality types well, which was comparable to the original one while reducing time and effort required for the testing.

Structural Model Of Delinquent Behavior Influencing by Media Violence (폭력매체에 의한 비행행동의 구조모형 개발)

  • 김현실
    • Journal of Korean Academy of Nursing
    • /
    • v.30 no.1
    • /
    • pp.148-159
    • /
    • 2000
  • The purpose of this study was to test the theoretical model designed to explain juvenile delinquency by media violence. Data were collected through questionnaire survey over a period of 3 months. Subjects served for this study consisted of 537 adolescents including 217 delinquent adolescents and 320 student adolescents in Korea, sampled from Korean student population and delinquent adolescent population confined in juvenile correctional institutions, using proportional stratified random sampling method. In this study, exogeneous variable was family dynamic environment and endogeneous variables were character of adolescent including need satisfaction/ frustration, sociability, antisocial personality tendency, complaints of psychosomatic symptoms and depressive trend, juvenile delinquent behavior and media violence themes including the extent of interest in and exposure and modelling impulsiveness and modelling to media violence themes. A total of 18 instruments were used to operationalized concepts in this model. A validation study indicated that internal consistencies for the 18 instruments which the researcher used were reliable. The one month test-retest correlation for these instruments ranged from 0.54 to 0.88. Statistical methods employed were descriptive statistics and covariance structural modelling. In summarized conclusion, it was found that media violence served as the most contributor to juvenile delinquency by direct effect of 0.64(t=10.18). That is, as the adolescents have to be the higher extent of interest in and exposure and modelling impulsiveness and modelling to media violence themes, they will show the more frequency of delinquent behavior. The single most powerful contributor by total effect of 0.73(t=7.90) (direct effect=0.19, indirect effect=0.54) to the development of delinquent behavior identified in this study was a construct defining family dynamic environment. That is, as the adolescents had to be more unstable family dynamic environment, they became more frustrated to their psychological need, and revealed the more maladaptive personality pattern, consequently they behaved the higher misconducts such as juvenile delinquency through media violence.

  • PDF

Development of the Attention-Deficit Hyperactivity Disorder-After School Checklist

  • Yoo, Hanik K.;Huh, Hannah;Lee, Sukhyun;Jung, Kwangmo;Kim, Bongseog
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.29 no.2
    • /
    • pp.47-53
    • /
    • 2018
  • Objectives: This study aimed to develop the attention-deficit hyperactivity disorder (ADHD)-After School Checklist (ASK) to evaluate the severity of ADHD symptoms and self-management ability in children and adolescents in South Korea. Additionally, we evaluated the reliability and validity of the scale. Methods: We developed the ASK to evaluate the effect of ADHD psychopathologies on self-management and interpersonal impulsivity. We investigated the reliability and validity of the scale with 1349 parents (male 56.9%; 1202 parents of non-ADHD children, 147 parents of children with ADHD) in Seoul and Gyeonggi Province, Korea. Results: According to the construct validity test using principal constant analysis with the varimax rotation method, two factors explained 60.7% of the cumulative variance in ASK scores. Cronbach's alpha for the whole scale was 0.71. There was no statistical difference between mean ASK scores at test and retest. Mean total ASK scores of the ADHD group were significantly higher than those of the non-ADHD group (p<0.001). Conclusion: The ASK can be used as a reliable and valid tool to evaluate not only self-management capability of children and adolescents with ADHD in their academic and everyday life, but also their impulsiveness in interpersonal relationships.

A Study on the Reliability Assessment of Sasang Constitution Questionnaire Developed by KIOM for Japanese (일본인 대상자를 통해 살펴본 KIOM 체질 설문지의 신뢰도 평가)

  • Yoo, Jong-Hyang;Jang, Eun-Su;Kim, Yun-Yung;Park, Ki-Hyun;Lee, Si-Woo
    • Journal of Sasang Constitutional Medicine
    • /
    • v.24 no.2
    • /
    • pp.8-18
    • /
    • 2012
  • 1. Objectives : This study aimed to assessing the reliability of questionnaire for Japanese as one of method to diagnose Sasang Constitution and evaluating the possibility of applying domestic questionnaire to foreign site. 2. Methods : A cross-sectional survey approved by IRB (Independent Review Board) at Tohoku University was performed for 119 participants with informed consent at a particular city in Japan using self-reported questionnaires developed by KIOM (Korea Institute of Oriental Medicine). Among the entire samples, 112 were retested. The test-retest reliability was assessed by Kappa for normal variables and internal consistency was evaluated by Cronbach's alpha. 3. Results : Four of 77 questions are impossible to calculate consistency owing to unsymmetric matrix between primary reply and secondary one. Seventeen of them (22%) showed 0.4 or below in Kappa, 56 were ranged from 0.4 to 0.8 and no question marked 0.8 or over. Internal consistency was possibly checked for several questions about character, digestion, sweat, excrement, urine, cold-heat pattern. Cronbach's alpha for questions except urine and cold-heat pattern was over 0.6 4. Conclusions : On the basis of Kappa value by two self reported questionnaire, 72.7% of questions showed 0.4 or over so that reliability were highly secured. And other questions except for urine and heat-cold pattern marked 0.6 or over in order that internal consistency was also successfully maintained. Accordingly, when subsequently applying KIOM questionnaire to foreign site, domestic questionnaire should be properly adjusted in social and cultural background, lifestyle, etc.