• Title/Summary/Keyword: Cohen's Kappa

Search Result 93, Processing Time 0.029 seconds

Reliability of Lateral Deviation Measurement in the Hyoid Bone With Center Point and Lateral Motion Tests

  • Min, Hye-jin;Yoon, Tae-lim
    • Physical Therapy Korea
    • /
    • v.26 no.3
    • /
    • pp.76-83
    • /
    • 2019
  • Background: The hyoid bone is the only non-jointed structure among the skeletal tissues of the head and neck region, and its movement and posture depend on the attached muscle, ligament, and fascia. The location of the hyoid bone is important for airway maintenance, vocalization, chewing, swallowing, breathing, and head and scapular position. In general, the location of the hyoid bone is measured using radiographs and 3D computed tomography, and no studies have reported on clinical measurement methods. Objects: This study was performed to suggest clinical measurement methods for lateral deviation of the hyoid bone and to evaluate their reliability. Methods: In this study, 24 healthy volunteers (12 males, 12 females) in Cheongju-si participated. Two examiners performed the center point test and lateral motion test twice each to measure the lateral displacement of the hyoid bone. The reliability of the center point test was analyzed using intra-class correlation coefficients (ICC), and the reliability of the lateral motion test was analyzed using Cohen's kappa coefficient. Results: The intra-rater reliability of the center point test was good, and the inter-rater reliability was moderate. The intra- and inter-rater reliability of the lateral motion test showed substantial reliability. Conclusion: Based on these results, the center point test and the lateral motion test can be used as an alternative methods of the measurement of lateral deviation of the hyoid bone for people who have musculoskeletal disorders of the head, neck, and scapula.

Developing and Applying a Checklist for Science Gifted Students' Construction of Scientific Inquiry Posters (과학 영재학생들의 과학탐구 포스터 작성을 위한 점검표의 개발과 적용)

  • Lee, Insun;Park, Jongwon
    • Journal of Korean Elementary Science Education
    • /
    • v.38 no.3
    • /
    • pp.426-438
    • /
    • 2019
  • The purpose of this study is to help science gifted students construct posters after conducting scientific open inquiry. To this end, we analyzed 25 posters written by elementary science gifted students and extracted deficient aspects from the posters. Based on this, a checklist consisting of 17 items in 5 categories was developed to help students construct posters. By applying the developed checklist to the evaluation of 14 posters constructed by science gifted students in middle school, the correlations between evaluators and Cohen's kappa values showed high reliability. In addition, by comparing the evaluation results of the seven 7 posters constructed using the checklist with the evaluation results of control group, a significant difference at the level of p<.01 was obtained, therefore, the usefulness of the checklist was confirmed. Students who used checklists responded positively, including that the checklist helped them to recognize deficiencies in their inquiry and to construct posters systematically without omitting key items of the posters. Finally, additional considerations were discussed for the preparation and presentation of the students' posters.

Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination

  • Yim, Mikyoung
    • Korean journal of medical education
    • /
    • v.30 no.4
    • /
    • pp.347-357
    • /
    • 2018
  • Purpose: The purpose of this study was to apply alternative standard setting methods for the Korean Medical Licensing Examination (KMLE), a criterion-referenced written examination, and to compare them to the conventional cut score used on the KMLE. Methods: The process and results of criterion-referenced standard settings (i.e., the modified-Angoff and bookmark methods) were evaluated. The ratio of passing and failing examinees determined using these alternative standard setting methods was compared to the results of the conventional criteria. Additionally, the external, internal and procedural evaluation of these methods were reviewed. Results: The modified-Angoff method yielded the highest cut score, followed sequentially by the conventional method and the bookmark method. The classification agreement between the modified-Angoff and bookmark methods was 0.720 measured by Cohen's ${\kappa}$ coefficient. The intra-panelist classification consistency of modified-Angoff method was higher than bookmark method. However, the inter-panelist classification consistency was vice versa. The standard setting panelists' survey results showed that the procedures of both methods were satisfactory, but panelists had more confidence in the results of the modified-Angoff method. Conclusion: The modified-Angoff method showed results that were more similar to those of the conventional method. Both new methods showed very high concordance with the conventional method, as well as with each other. The modified-Angoff method was considered feasible for adoption on the KMLE. The standard setting panelists responded positively to the modified-Angoff method in terms of its practical applicability, despite certain advantages of the bookmark method.

Research on features of eco-friendly fashion products for the development of typology of eco-friendly fashion products (친환경 패션제품 유형분류체계 개발을 위한 친환경 패션제품 특성 연구)

  • Eunah Yoh
    • The Research Journal of the Costume Culture
    • /
    • v.32 no.1
    • /
    • pp.86-107
    • /
    • 2024
  • Although interest in eco-friendly fashion products is increasing among scholars and industry leaders, the concept of eco-friendly products remains unclear, preventing consistent assessment of which fashion products are eco-friendly. This study conducted a content analysis of eco-friendly product information from 87 domestic and 102 foreign brands to reveal key standards for categorizing eco-friendly fashion products. Product characteristic information was coded according to the four material-based standards (i.e., organic material, regenerative material, alternative material, and sustainably produced/upcycled material). Consistency between coders was confirmed by Cohen's kappa. In results, eco-friendly fashion products are categorized by four material-based standards and two certification standards (i.e., certified, not certified). Among the four material-based categories, the greatest number of domestic and foreign companies produced eco-friendly products that were classified as the regenerative material group. In addition, companies acquired eco-friendly certifications related to the use of organic, regenerative, and alternative materials. The greatest number of eco-friendly material brands used for eco-friendly fashion products belonged to the regenerative material group. Based on the study results, a typology of eco-friendly products was suggested. This typology can benefit practitioners and academics by highlighting a need for classification system for the eco-friendly fashion products, as well as by providing insight into the categorization of eco-friendly fashion products.

One year test-retest reliability of the Korea Sasang constitutional diagnostic questionnaire (KS-15) in university students (1년간 검사-재검사법을 통한 단축형 사상체질 진단 설문 (KS-15)의 신뢰도 평가)

  • Bae, Kwang-Ho;Kim, Sang-Hyuk;Go, Ho-Yeon;Park, Ki-Hyun;Lee, Siwoo;Lee, Soojin
    • Journal of Sasang Constitutional Medicine
    • /
    • v.31 no.2
    • /
    • pp.12-21
    • /
    • 2019
  • Objectives This study was aimed to evaluate the one-year test-retest reliability of the Korea Sasang constitutional diagnostic questionnaire (KS-15) in university students. Methods In March 2017, and March 2018, a survey was sent by email to 583 Korean medicine students in two universities. Of these, 149 (25.6%) participated and completed the first survey (test) and second survey (retest). Participants responded to the KS-15 questionnaire and the general characteristics including their age, sex, height, and weight. Cohen's kappa Spearman's rank correlation coefficient and agreement rate (%) were used for the test-retest reliability for each question item and the diagnosis of the Sasang constitution. The independent T-test was used to determine the difference in BMI between Sasang constitutional accordance and discordance groups obtained from the test-retest results of KS-15. Results The agreement of Sasang constitutional diagnosis was 75.8% (Kappa = 0.618), indicating that KS-15 had a certain level (substantial) of test-retest reliability. However, the kappa of each item was 0.161 ~ 0.620, which showed a large difference between the items. The agreements of each Sasang constitution were 85.1% for Taeeumin, 73.6% for Soeumin, and 58.6% for Soyangin. There was no significant difference in the BMI change between Sasang constitutional accordance and discordance groups in the test-retest. Conclusions These results indicate KS-15 has a reliable one-year test-retest reliability. However, further studies will be required to improve reliability, validity and application across different age ranges for the practical utilization of KS-15.

Pediatric Dehydration Assessment at Triage: Prospective Study on Refilling Time

  • Caruggi, Samuele;Rossi, Martina;De Giacomo, Costantino;Luini, Chiara;Ruggiero, Nicola;Salvatoni, Alessandro;Salvatore, Silvia
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • v.21 no.4
    • /
    • pp.278-288
    • /
    • 2018
  • Purpose: Dehydration is a paediatric medical emergency but there is no single standard parameter to evaluate it at the emergency department. Our aim was to evaluate the reliability and validity of capillary refilling time as a triage parameter to assess dehydration in children. Methods: This was a prospective pilot cohort study of children who presented to two paediatric emergency departments in Italy, with symptoms of dehydration. Reliability was assessed by comparing the triage nurse's measurements with those obtained by the physician. Validity was demonstrated by using 6 parameters suggestive of dehydration. Comparison between refilling time (RT) and a validated Clinical Dehydration Score (CDS) was also considered. The scale's discriminative ability was evaluated for the outcome of starting intravenous rehydration therapy by using a receiver operating characteristic (ROC) curve. Results: Participants were 242 children. All nurses found easy to elicit the RT after being trained. Interobserver reliability was fair, with a Cohen's kappa of 0.56 (95% confidence interval [CI], 0.41 to 0.70). There was a significant correlation between RT and weight loss percentage (r-squared=-0.27; 95% CI, -0.47 to -0.04). The scale's discriminative ability yielded an area under the ROC curve (AUC) of 0.65 (95% CI, 0.57 to 0.73). We found a similarity between RT AUC and CDS-scale AUC matching the two ROC curves. Conclusion: The study showed that RT represents a fast and handy tool to recognize dehydrated children who need a prompt rehydration and may be introduced in the triage line-up.

Manual Contouring Based Volumetric Evaluation for Colorectal Cancer with Liver Limited Metastases: A Comparison with RECIST

  • Fang, W.J.;Lam, K.O.;Ng, S.C.Y.;Choi, C.W.;Kwong, D.L.W.;Zheng, S.S.;Lee, V.H.F.
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.14 no.7
    • /
    • pp.4151-4155
    • /
    • 2013
  • Background: To compare response evaluation criteria in solid tumours (RECIST) and volumetric evaluation (VE) for colorectal cancer with liver-limited metastasis. Patients and Methods: VE of liver metastases was performed by manual contouring before and after chemotherapy on 45 pairs of computed tomography (CT) images in 36 patients who suffered from metastatic colorectal cancer (mCRC) with liver metastasis only. Cohen kappa was used to compare the agreement between VE and RECIST. Pearson correlation was performed for their comparison after cubic root transformation of the aggregate tumor volumes. Logistic regression was done to identify clinical and radiographic factors to account for the difference which may be predictive in overall response (OR). Results: There were 16 partial response (PR), 23 stable disease (SD) and 6 progressive disease (PD) cases with VE, and 14 PR, 23 SD and 8 PD with RECIST. VE demonstrated good agreement with RECIST (${\chi}$=0.779). Discordant objective responses were noted in 6 pairs of comparisons (13.3%). Pearson correlation also showed excellent correlation between VE and RECIST ($r^2$=0.966, p<0.001). Subgroup analysis showed that VE was in slightly better agreement with RECIST for enlarging lesions than for shrinking lesions ($r^2$=0.935 and $r^2$=0.780 respectively). No factor was found predictive of the difference in OR between VE and RECIST. Conclusions: VE exhibited good agreement with RECIST. It might be more useful than RECIST in evaluation shrinking lesions in cases of numerous and conglomerate liver metastases.

Reliability of a Questionnaire for Evaluation of Dry Mouth Symptoms (구강건조증 증상 평가를 위한 설문지의 신뢰도에 관한 연구)

  • Lee, Jeong-Yun;Lee, Young-Ok;Kho, Hong-Seop
    • Journal of Oral Medicine and Pain
    • /
    • v.30 no.4
    • /
    • pp.383-389
    • /
    • 2005
  • Xerostomia is defined as a subjective complaint of dry mouth that may be perceived when there is insufficient mucosal wetting. However, the diagnosis and treatment of xerostomia is not that simple because of the fact that the subjective awareness of dry mouth is not always correlated with a diminution in the flow of saliva and there is always a difference between individuals in salivary flow rates needed for normal oral function. In the present study, the aim was to develop a questionnaire to evaluate the dry mouth symptoms and to analyze its reliability and usability as a diagnostic and analytic tool for xerostomia. The questionnaire which consists of 6 Visual Analogue Scale(VAS) type questions to evaluate the subjective oral dryness and 4 questions to evaluate behavior to avoid oral dryness was developed and administered twice with 1 week's interval to the healthy 88 young adults without dry mouth symptoms(44 males and 44 females; mean age was $25.6{\pm}3.1$ years in male and $24.3{\pm}2.1$ years in female). The results were as follows. 1 The intraclass correlation coefficients of 6 questions to evaluate the subjective oral dryness were as significantly high as 0.767 for the degree of oral dryness at other times of the day, 0.850 for the amount of saliva in the mouth, and 0.791 for the degree of effect on daily life due to oral dryness and as high as 0.563 for the degree of oral dryness at night or on awakening, 0.674 for the degree of oral dryness during eating, and 0.641 for the degree of difficulty in swallowing foods. 2. Cronbach's alpha value of 6 questions was 0.982. It can be concluded that the series of questions to evaluate the subjective oral dryness has high internal consistency. 3. Cohen's kappa values of 4 questions to evaluate behavior to relieve oral dryness were as significantly high as 0.850 for the frequency of keeping a glass of water at the bedside and as high as 0.506 the frequency of awakening during sleeping due to oral dryness, 0.419 for the frequency of sipping liquids to aid in eating dry foods, and 0.407 for the frequency of using a candy or chewing gum due to oral dryness. From the results, it can be concluded that the questionnaire consisting of 6 VAS type questions to evaluate the subjective oral dryness and 4 questions to evaluate behavior to relieve oral dryness has reliability of good to excellent level, and that the series of 6 VAS type questions has significantly high internal consistency to evaluate the subjective oral dryness.

Development Cut-off Value for Yin-deficiency Questionnaire and Diagnostic Ability of Yin-deficiency in Xerostomia (구강건조증 환자에서 음허 측정 설문지 절단점 개발 및 진단능 평가)

  • Jang, Seung-Won;Kim, Jin-Sung
    • The Journal of Internal Korean Medicine
    • /
    • v.35 no.4
    • /
    • pp.483-497
    • /
    • 2014
  • Objectives: The aims of study were developing cut-off value of Yin-deficiency questionnaire (YDQ) for diagnosis of Yin-deficiency (YD) and compare diagnostic ability between YDQ and Yin-deficiency scale score (YDS) in xerostomia patients. Methods: We recruited 58 xerostomia patients. They were diagnosed YD or non-YD by 3 Korean medicine doctors (KMD). We assessed YD using YDQ and YDS. We evaluated xerostomia using VAS, Dry Mouth Symptom Questionnaire (DMSQ), Salivary Flow Rate (SFR), oral moisture on buccal mucosa and tongue surface (OMB and OMT). We surveyed tongue coatings using Winkel Tongue Coating Index (WTCI). Results: We diagnosed 23 patients YD and 35 patients non-YD. There were no significant differences of age, sex and body mass index between the YD and non-YD groups. Using receiver operating characteristic curve analysis, the optimal cut-off value of YDQ was defined as 304. Sensitivity, specificity and Youden index of YDQ were 86.96%, 71.43% and 1.5839 respectively. Using Cohen's coefficient of agreement, we found that degree of agreement between KMD and YDQ diagnosis was moderate (${\kappa}$=0.524, p<0.001). Using Pearson's correlation analysis, we found concurrent validity of YDQ and YDS were significant correlated. Using area under curve value, we found diagnostic ability between YDQ and YDS were not significantly different (p=0.505), but there were more strong correlations between DMSQ-symptoms and YDQ (r=0.731, p<0.001) than correlations between DMSQ-symptoms and YDS (r=0.418, p<0.01). Conclusions: The cut-off value of YDQ can diagnose YD in xerostomia and diagnostic ability of YDQ in xerostomia is better than YDS.

Personal technique for definite repair of complete unilateral cleft lip: modified Millard technique

  • Han, Kihwan;Park, Jeongseob;Lee, Seongwon;Jeong, Woonhyeok
    • Archives of Craniofacial Surgery
    • /
    • v.19 no.1
    • /
    • pp.3-12
    • /
    • 2018
  • Background: Millard's rotation-advancement repair, which is used by many surgeons, can make a natural philtral column, but most surgeons use a modification of the rotation-advancement flap. The purpose of this article is to introduce a modification utilized by the authors and to provide detailed surgical procedure. Methods: We retrospectively reviewed 82 patients' medical records and presented surgical technique and outcomes. The main features of the authors' strategy are emphasizing horizontal length of the lip, orbicularis oris muscle duplication for improving the definition of the philtral column, overcorrection of domal portion than the non-cleft side in order to compensate for the recurrence during growth. Two judges rated two times the appearance of the patients' nose and lip using Asher-McDade aesthetic index. Intra- and interobserver reliabilities were determined using Cohen's kappa statistics. Results: All patients recovered eventually after surgery; however, two patients have a minor complications (wound infection in one patient, wound disruption due to trauma in the other patient). The improvement of the aesthetic results can be achieved with this modified Millard technique. Total mean scores of the Asher-McDade index was 2.08, fair to good appearance. The intraobserver reliabilities were substantial to almost perfect agreement and the interobserver reliabilities were moderate to almost perfect agreement. Conclusion: We modified Millard method for repair of complete unilateral cleft lip. The surgical outcomes were favorable in long-term follow-up. We hope our technique will serve as a guide for those new to the procedure.