• Title/Summary/Keyword: Interrater reliability

Search Result 76, Processing Time 0.023 seconds

Sustainability education in textile and apparel programs in higher education - A web-based content analysis -

  • Yoh, Eunah;Kim, Hye-Shin
    • The Research Journal of the Costume Culture
    • /
    • v.26 no.2
    • /
    • pp.203-216
    • /
    • 2018
  • This study explores sustainability education in textile and apparel (T&A) programs in U.S. higher education institutions. Specifically, the researchers study whether more courses with sustainability focus are offered in higher-ranked institutions and explore whether sustainability is taught more in specific T&A related subject fields. Content analysis was conducted for 3,200 courses found in online course catalogs or the course information sites of 69 institutions. Institutions were selected from the 2015 rankings of the top 50 fashion design and top 50 fashion merchandising schools in the US on www.fashion-schools.org. All cases were coded by two coders with a Cohen's Kappa score of 97.5%, indicating good interrater reliability. Coded data were analyzed through descriptive statistics, correlation analysis, and t-tests. The findings show that sustainability is being integrated into the curricula and across courses of T&A programs in the U.S. Over half of the institution surveyed offered at least one sustainability embedded course. Higher ranked institutions provided more sustainability-related courses than power-ranked institutions. A natural match between the subject field and specific sustainability theme was observed (e.g., cultural diversity in history/culture and social psychology/education; recycle/reuse in textile science; sustainability in fashion design; social responsibility and ethics in industry/consumer). The need to introduce sustainability in courses holistically is discussed, whereby sustainability within the industry supply chain is examined in a connected way.

Study on the Practical 3D Facial Diagnosis using Kinect Sensors (키넥트 센서를 이용한 실용적인 3차원 안면 진단기 연구)

  • Jang, Jun-Su;Do, Jun-Hyeong;Kim, Jang-Woong;Nam, Jiho
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.29 no.3
    • /
    • pp.218-222
    • /
    • 2015
  • Facial diagnosis based on quantitative facial features has been studied in many Korean medicine fields, especially in Sasang constitutional medicine. By the rapid growing of 3D measuring technology, generic and cheap 3D sensors, such as Microsoft Kinect, is popular in many research fields. In this study, the possibility of using Kinect in facial diagnosis is examined. We introduce the development of facial feature extraction system and verify its accuracy and repeatability of measurement. Furthermore, we compare Sasang constitution diagnosis results between DSLR-based system and the developed Kinect-based system. A Sasang constitution diagnosis algorithm applied in the experiment was previously developed by a huge database containing 2D facial images acquired by DSLR cameras. Interrater reliability analysis result shows almost perfect agreement (Kappa = 0.818) between the two systems. This means that Kinect can be utilized to the diagnosis algorithm, even though it was originally derived from 2D facial image data. We conclude that Kinect can be successfully applicable to practical facial diagnosis.

Development of Fall Assessment Scale in Adult Inpatients (한국형 성인 환자 낙상위험 사정도구 개발)

  • Choi, Eun Hee;Ko, Mi Suk;Hong, Sang Hee;Kim, In Sook
    • Journal of Korean Clinical Nursing Research
    • /
    • v.25 no.2
    • /
    • pp.179-188
    • /
    • 2019
  • Purpose: The purpose of this study was to develop a valid Adult Fall Assessment Scale Korean version (FAS-K) for inpatients in general hospitals in Korea. Methods: This a 14 item FAS-K was developed based on a review of national and international research and expert opinions in related field. Interrater reliability of FAS-K was analyzed using the ICC (Intraclass Correlation Coefficients). To examine the validity of FAS-K, a CVI (Content Validity Index), the Pearson correlation coefficients between FAS-K and two widely used scales, the Morse Fall Scale (MFS) and the Johns Hopkins Hospital Fall Risk Assessment Tool (JHFRAT), and the Mann-Whitney test were used. Results: The ICC was .958. The CVI ranged from .70 to 1.00. The FAS-K was significantly associated with the MFS (r=.74, p<.001) and with the JHFRAT (r=.87, p<.001), verifying the concurrent validity of FAS-K. As for the construct validity of FAS-K, significant differences between the fall and non-fall groups were found not only in the MFS (Z=-3.23, p=.001) but also in the FAS-K (Z=-3.10, p=.002). Conclusion: The findings indicate that the FAS-K is a reliable fall risk assessment tool with high validity.

The Marital Interaction Coding System-Global(MICS-G): A Validation Study (포괄적 부부상호작용 코딩시스템(MICS-G) 국내 타당화 연구)

  • Park, Woochul
    • Human Ecology Research
    • /
    • v.57 no.1
    • /
    • pp.109-125
    • /
    • 2019
  • Few studies have utilized observational methods in the field of couple research even though using self-report questionnaires is prone to the subjective biases of the reporter. This study validates the Marital Interaction Coding System-Global (MICS-G), a global version of the well-established microanalytic observational coding system, Marital Interaction Coding System (MICS). Participants in the study consisted of 30 married couples with varied levels of marital adjustment who visited one of the Healthy Family and Multicultural Family Support Centers in Seoul, either for couple therapy or the "Marriage Checkup"program. Ten-minute problem-solving discussions were rated by two undergraduate student raters who were trained for 10 hours. Interobserver agreement based on percentage agreement and intraclass correlation coefficients showed a high level of agreement between raters in establishing interrater reliability. Convergent validity was established by: correlations among marital adjustment, psychological aggression, mental health, and MICS-G categories of conflicts, validation, invalidation, facilitation, and withdrawal. MICS-G categories also were successful in discriminating between distressed and nondistressed couples, which provides evidence of discriminant validity for MICS-G. This study showed that MICS-G is a promising method for researchers to observe couple interactions in a more cost-effective way. Methodological issues and practical applications are also discussed.

Measurement Scale Development of Waterpark Service Quality (워터파크의 서비스품질 척도개발)

  • Kwak, Han-Pyong;Kim, Kyong-Sik;Lee, Chang-Soo
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.1
    • /
    • pp.426-435
    • /
    • 2010
  • The object of this study was to develop an index of service quality of waterparks and verify the validity and reliability of the index. This study represents the waterparks user population in 2009, and 250 people were extracted by using the purposive sampling method. In other words, five locations have major waterparks were chosen and 50 people per each location were collected. Conference, panel survey, exploratory factor analysis and confirmatory factor analysis were performed to verify the validity of the questionnaire while item analysis, interrater reliability and internal consistency reliability were conducted to probate the reliability. Through these methods and procedures, the results of this study like these; (i) Validity of this index was significantly high and the index include amenity/cleanness, safety, price, programs, facilities, accessibility and promotion. Among them, amenity/cleanness was the major factor for the validity value; (ii) Reliability of this index was also high. There are high correlations between questions and fields and questions and total score. And the Cronbach's $\alpha$ values of the internal consistency reliability was over 0.603 except in the case of promotion which was below 0.6. After all the analysis, the index of service quality proved to be very proper and reliable index. Therefore, the major factors of service quality have to be figured out and reflected to the management innovation to improve service quality of waterparks.

Study of Validity and Interrater Reliability of Korean Version of the Peabody Developmental Motor Scale 2 (한글판 Peabody Developmental Motor Scale 2의 타당도와 검사자간 신뢰도 연구)

  • Lee, Ji-Ho;Kim, Kyeong-Mi;Chang, Moon-Young;Hong, Eunkyoung
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.17 no.3
    • /
    • pp.14-25
    • /
    • 2019
  • Objective : This study aims to verify the content validity and inter-rater reliability of the Korean version of the Peabody Developmental Motor Scale 2 (PDMS-2) and to identify the concurrent validity by comparing it with the Korean version of the Bruininks-Oseretsky Test of Motor Proficiency-2 (BOT-2). Methods : PDMS-2 was translated by the researcher and an eighth-year clinical occupational therapist. The content consistency of the Korean version of the PDMS-2 was verified by three professors with experience using it. After the verification of the content consistency of the PDMS-2 by the five clinical occupational therapists and the additional revision, the Korean version of the PDMS-2 was completed. The researcher and another occupational therapist evaluated the Korean version of PDMS-2 in 50 children and measured the inter-rater reliability. Concurrent validity was measured by comparing the results of the Korean version of PDMS-2 and Korean version of BOT-2. Results : The content consistency test showed overall agreement of mean 3.45, and the content understanding test showed a high level of understanding of mean 3.69. The inter-rater reliability and concurrent validity of the Korean version of the PDMS-2 showed a statistically significant correlation. Conclusion : The Korean version of the PDMS-2 showed high content understanding, reliability, and validity. It can assist clinicians and researchers who work in fields related to child treatment or development.

Development of a Pain Assessment Tool for Critically Ill Patients (중환자 통증사정 도구 개발)

  • Choi, Eun Hee;Kim, Jin Hee;Choi, Kyung Ok;Yoo, Jung Sook;Kim, Mi Soon;Kim, Pil Ja;Jang, In Sun
    • Journal of Korean Clinical Nursing Research
    • /
    • v.18 no.1
    • /
    • pp.136-148
    • /
    • 2012
  • Purpose: The purpose of this study was to develop a reliable and valid pain assessment tool suitable for critically ill patients with communication problem in Korean intensive care unit. Methods: This pain assessment tool, Critical Care Non-verbal Pain Scale (CNPS), was developed based on review of national and international researches. Data were collected from ten intensive care units at five major general hospitals in Seoul. Reliability and validity were tested during performance of position change and endotracheal suctioning. Pain was measured before, during, and 20 minutes after the two procedures. Results: Interrater reliability of the CNPS was analyzed by ICC (Intraclass correlation coefficients). ICC values were significant from .833 to .883. Significant correlation between the FPS (Face Pain Scale) scores and the CNPS scores verified concurrent validity of the CNPS. For position change, CNPS scores increased significantly between before and during (t=-23.399, p<.001) and decreased significantly between during and 20 minutes after (t=22.760, p<.001). For endotracheal suctioning, CNPS scores increased significantly between before and during (t=-29.064, p<.001) and significantly decreased between during and 20 minutes after (t=28.194, p<.001), verifying construct validity of the CNPS. Conclusion: Results indicate that the CNPS can be used to assess pain of critically ill patients who have communication problem.

DEVELOPMENT OF KOREAN FORM OF CHILDREN'S YALE-BROWN OBSESSIVE-COMPULSIVE SCALE(CY-BOCS):A RELIABILITY AND VALIDITY STUDY (한국판 아동용 예일-브라운 강박 척도 ; 신뢰도와 타당도 연구)

  • Lee, Jeoung-Seop;Kang, Yun-Hyong;Cho, Seong-Jin;Suh, Dong-Hyuck;Hong, Kang-E;Chung, Sung-Ju
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.11 no.1
    • /
    • pp.60-69
    • /
    • 2000
  • Objective:This study was carried out to evaluate the reliability and validity of the Korean form of the Children's Yale-Brown Obsessive Compulsive Scale(CY-BOCS). Method:Forty-two children with obsessive-compulsive disorder(OCD)(31 boys and 11 girls, aged 7 to 18 years) were assessed with CY-BOCS. Interrater agreement was assessed by two raters in subsample(n=20). discriminant and convergent validity were assessed by comparing CY-BOCS scores to Clinical Global Impression-OCD(CGI-OCD), Leyton Obsessional Inventory-Child Version (LOI-CV), State-Trait Anxiety Inventory for Children(STAI-C), and Child Depression Inventory(CDI). Results:Internal consistency was high, measuring 0.86 for the 10 items and total score. The intraclass correlations for the CY-BOCS total, obsession, and compulsion scores were 0.94, 0.94, 0.84, suggesting excellent interrater agreement for subscale and total scores. The CY-BOCS total score showed highest correlation with CGI-OCD(r=0.88), and significant correlation with LOI-CV(r=0.51), Trait Anxiety score(r=0.43), and CDI scores(r=0.49), but it was not correlated with State-Anxiety score(r=0.25). Conclusion:The results of this study indicate that the Korean form of CY-BOCS is a reliable and valid scale for rating obsessive-compulsive symptom severity.

  • PDF

Reliability and Validity of the Behavioral Observation Method for Assessing Low Back Pain in Patients with Spinal Diseases (척추질환자의 요통사정을 위한 통증행위 관찰법의 신뢰도 및 타당도 검정)

  • Yoon, Ho-Soon;Lee, Eun-Ok
    • Journal of muscle and joint health
    • /
    • v.1 no.1
    • /
    • pp.97-115
    • /
    • 1994
  • The purpose of this study was to examine the reliability and validity of the observed behaviors of subjects who suffered from low back pain with spinal diseases, Thirty two low back pain patients admitted on the neurosurgical unit in an army hospital were compared with 30 normal controls belonged to an army unit, by means of matching the age, hight and weight. Observed pain behaviors were developed by the researcher on the bases of literature and patient observation. This tool consists of 18 behaviors seperated into two major groups : mutually exclusive and concomittent behaviors. The mutually exclusive behaviors included coding cathegories for 6. body motions assumed by the subjects during the observation session. These 6 standardized motions consisted of sitting from standing first, and serially tying down, reclining, sitting again, and then standing, 6 steps walking. Concomittent behaviors consisted of 12 observable patterns that can be observed systematically from the face, grimacing, bracing, rubbing, walking with arms fixed, support with hands on sitting or standing, guarded movement, limping, unbalaced weightbearing, stopped movement from tying position to sitting, sighing and graoning. Subjects were videotrecorded as they performed a 6-standardized sequence of motions, simultanously researcher measured the time spent performing each motion and step length. Patients were asked torate their subjective pain score on the 10 mm graphic rating scale ranging from 'no pain' to 'sever pain'. For scoring of the pain behaviors, two trained nursing officiers independently and simutanously viewwd each videorecording and checked subject 'pain behaviors at the observational item checklist. The result of the study are summarized as follows : 1. Reability of the observational tool was a=.845. 2. Spearman's rho and percentage agreement were p=.97 and 81.7 persent respectively, that indicate adequate interrater reability of this tool. 3. The sensitivity rate of the tool was .875 while specificity rate .866 for differentiating patient from the normal. 4. When difference in the objective pain indices between patient group and control were compared, there was significant difference of all indices, such as pain behavior(t=7.71, p=.0001). spent time performing motion(t=14.2, p=.0001), step length (t=-10.72, p=.0001). 5. There were differences in the objective indices the subjective pain subgroups (low, medium, high). Differences in the mean score of objective pain behavior (F=6.376. p=.005) and spent time for moyion(F=4.631, p=.018). But there were no significant differences in the step length among the subgroups(F=.667, p=.521). 6. Highly correlated pain behavior items wiyh subjective pain score were 'stopped movement from lying position to sitting', 'limping', 'support with hands on sitting or standing', 'bracing', 'guarding' and 'walking with arms fixed'. In summary, although some of rho behavior items such as sighing and groaning in this study could not be observed because of videotaped datd, the reliability and validity of the over all observation method were satifactory. Thus, the results of the present study demonstrate rye potetional utility of the tool in assessing objective pain complementing self-reported pain in low back pain patients.

  • PDF

Development of an evaluation tool for the quality of nursing care in abdominal surgery patients (복부수술 환자간호의 질평가 도구 개발)

  • Lee, Byoung-Sook
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.4 no.1
    • /
    • pp.107-127
    • /
    • 1998
  • The purpose of this study was to develop an evaluation tool for the quality of nursing care in abdominal surgery patient. The target subjects of the tool were adult patients having abdominal surgery under general anesthesia. Process-outcome framework was selected for the development of the tool in this study. The results were as follows. 1. Nine standards. 40 criteria and 88 indicators were developed. A standard was summary statement of the ideal level of excellencein a dimension of quality of nursing care. which could be evaluated by criteria. Several criteria indicated a specific standard and each criterion could be measured by observable and measurable indicators. 2. The standards were divided into two dimensions. One was process dimension which contained four standards(23 criteria), the other was outcome dimension which contatined five standards(17 criteria). 3. Average CVI was .985 at 9 standards. .947 at 40 criteria. and .987 at 88 indicators. 4. The evaluation tool for the quality of nursing care in abdminal surgery patients was a criterion-referenced tool. And data collection methods of the tool were investigation of patient's record and interview( or questionnaire) with the patients. 5. Interrater reliabilities of the tool were ; r= .7572 (agreement between two raters), and pI=.8487 (intraclass correlation between five raters who rated the 84 patients). 6. Internal consistency reliability ${\alpha}$ was .6194, which was obtained from 32 criteria. Eight criteria were missed in the analyzing process because of data omission. 7. Scores of the process and the outcome dimensions showed significant. but low correlation(r= .3759, p < .001). 8. There were significant differences in total scores between the hospitals and the departments of surgery(F = 15.233. p .0001). There was also significant interaction effect between hospitals and departments to total score(F = 8.396. p = .0001). Construct validity of the toool was verified by the known-group method. these kinds of difference were expected by the nursing experts participated in the study. From these results, more specific patient classification is suggested for the development of evaluation tool of the quallity of nursing care. And indicators to be used for objective measurement for the quality of nursing care must be developed.

  • PDF