• Title/Summary/Keyword: Cohen's Kappa

Search Result 94, Processing Time 0.023 seconds

Development of an Evaluation Instrument for Service Quality in Nursing Homes (노인요양시설 서비스 질 평가 도구 개발)

  • Lee, Ji-A;Ji, Eun-Sun
    • Journal of Korean Academy of Nursing
    • /
    • v.41 no.4
    • /
    • pp.510-519
    • /
    • 2011
  • Purpose: The purposes of this study were to identify the factors influencing service quality in nursing homes, and to develop an evaluation instrument for service quality. Methods: A three-phase process was employed for the study. 1) The important factors to evaluate the service quality in nursing homes were identified through a literature review, panel discussion and focus group interview, 2) the evaluation instrument was developed, and 3) validity and reliability of the study instrument were tested by factor analysis, Pearson correlation coefficient, Cronbach's ${\alpha}$ and Cohen's Kappa. Results: Factor analysis showed that the factors influencing service quality in nursing homes were healthcare, diet/assistance, therapy, environment and staff. To improve objectivity of the instrument, quantitative as well as qualitative evaluation approaches were adopted. The study instrument was developed with 30 items and showed acceptable construct validity. The criterion-related validity was a Pearson correlation coefficient of .85 in 151 care facilities. The internal consistency was Cronbach's ${\alpha}$=.95. Conclusion: The instrument has acceptable validity and a high degree of reliability. Staff in nursing homes can continuously improve and manage their services using the results of the evaluation instrument.

Sustainability education in textile and apparel programs in higher education - A web-based content analysis -

  • Yoh, Eunah;Kim, Hye-Shin
    • The Research Journal of the Costume Culture
    • /
    • v.26 no.2
    • /
    • pp.203-216
    • /
    • 2018
  • This study explores sustainability education in textile and apparel (T&A) programs in U.S. higher education institutions. Specifically, the researchers study whether more courses with sustainability focus are offered in higher-ranked institutions and explore whether sustainability is taught more in specific T&A related subject fields. Content analysis was conducted for 3,200 courses found in online course catalogs or the course information sites of 69 institutions. Institutions were selected from the 2015 rankings of the top 50 fashion design and top 50 fashion merchandising schools in the US on www.fashion-schools.org. All cases were coded by two coders with a Cohen's Kappa score of 97.5%, indicating good interrater reliability. Coded data were analyzed through descriptive statistics, correlation analysis, and t-tests. The findings show that sustainability is being integrated into the curricula and across courses of T&A programs in the U.S. Over half of the institution surveyed offered at least one sustainability embedded course. Higher ranked institutions provided more sustainability-related courses than power-ranked institutions. A natural match between the subject field and specific sustainability theme was observed (e.g., cultural diversity in history/culture and social psychology/education; recycle/reuse in textile science; sustainability in fashion design; social responsibility and ethics in industry/consumer). The need to introduce sustainability in courses holistically is discussed, whereby sustainability within the industry supply chain is examined in a connected way.

Establishment and Evaluation of GC/MS Methods for Urinalysis of Multiple Phenethylamines

  • Po-Han Shih;Tsung-Hsien Lin;Shih-Ting Zeng;Shu-Yu Fan;Chi-Zong Zang;Ya-Chun Ko;Ya-Hui Hsu;Shou-Chieh Huang;Mei-Chih Lin;Su-Hsiang Tseng
    • Mass Spectrometry Letters
    • /
    • v.15 no.2
    • /
    • pp.79 -94
    • /
    • 2024
  • Over the past few decades, new psychoactive substances (NPS) have become prevailing. With the widespread emergence of NPS, phenethylamines (PEAs) have become one of the groups abused most which PEAs, along with other stimulants, make up the majority of stimulants. When determining the NPS, the methods for screening and confirmation are crucial which assesses the reliability of testimony. In this study, a set of GC/MS methods employing two derivatizing agents for determining 76 target PEAs in urine was established and further applied for authentic sample analysis. Five PEAs (N,N-DMA, PMMA, 4-CA, amphetamine, and methamphetamine) with contents over their LLOQs were detected in thirteen of the twenty tested samples. In order to compare the result from the GC/MS methods with the previously established LC-MS/MS method, Cohen's kappa coefficient and McNemar's test were applied for statistical analysis. Perfect agreement between GC/MS and LC-MS/MS techniques for determining target PEAs is demonstrated by the Kappa coefficient for each of the five detected targets.

A Study of Changes in Body Shape, Temperament, Symptoms and Sasang Constitutional Values Using the Korea Sasang Constitutional Diagnostic Questionnaire (KS-15) : 5 Year Follow Up (사상체질 진단설문지(KS-15)를 이용한 외형, 성정, 병증의 추적관찰 및 체질값 변화 연구 : 5년 추적)

  • Kyoungsik Jeong;Bok-Nam Seo;Yunyoung Kim;Eunsu Jang
    • Journal of Sasang Constitutional Medicine
    • /
    • v.36 no.2
    • /
    • pp.1-11
    • /
    • 2024
  • Objectives The purpose of this study was to compare between baseline and follow up data after 5 years about the change of Sasang constitutional value. Methods Cohort data of educational personnel in D University was used. Korean Sasang Constitutional Diagnostic Questionnaire was used to compare Sasang value including body shape, temperament, and pathological symptoms in baseline with those of follow up. Paired t test, chi-square test, correlation analysis and cohen's kappa coefficient was used. Results Total 150 subjects participated in this analysis. Taeeumin, Soeumin and Soyangin was 71, 46 and 33 respectively. Height decreased in follow-up, and weight increased, accordingly body mass index increased(p<.05). The score of nocturia was significantly increased, and the temperature of drinking water was significantly decreased. The consistency rate of the Sasang constitutional values in KS-15 between baseline and follow up was 76%, and the kappa value was 0.607. Compared to the expert's diagnosis, the agreement rate was 66.7% in baseline and 69.3% in follow up. Conclusion As times goes by, Sasang Constitutional phenotype, such as body mass index, nocturia, and temperature of drinking water, and accordingly, the predicted value of Sasang constitution may be changed. Those who use Sasang constitutional type and therapy in clinics should consider these factors.

Automatic Detection of Slow-Wave Sleep Based on Electrocardiogram (심전도를 이용한 서파 수면 자동 검출 알고리즘 개발)

  • Yoon, Hee Nam;Hwang, Su Hwan;Jung, Da Woon;Lee, Yu Jin;Jeong, Do-Un;Park, Kwang Suk
    • Journal of Biomedical Engineering Research
    • /
    • v.35 no.6
    • /
    • pp.211-218
    • /
    • 2014
  • The objective of this research is to develop an automatic algorithm based on electrocardiogram (ECG) to estimate slow-wave sleep (SWS). An algorithm is based on 7 indices extracted from heart rate on ECG which simultaneously recorded with standard full night polysomnography from 31 subjects. Those 7 indices were then applied to independent component analysis to extract a feature that discriminates SWS and other sleep stages. Overall Cohen's kappa, accuracy, sensitivity and specificity of the algorithm to detect 30s epochs of SWS were 0.52, 0.87, 0.70 and 0.90, respectively. The automatic SWS detection algorithm could be useful combining with existing REM and wake estimation technique on unattended home-based sleep monitoring.

A Validation Study of the Abbreviated Self-Rated Korean Version of MINI (MINI Patient Health Survey) (한국판 단축된 자기보고형 MINI (MINI 정신건강 평가)의 타당도 연구)

  • Lim, Se-Won;Song, Han-Soo;Oh, Yun-Hee;Shin, Ho-Chul;Cho, Kwang-Hyun;Chung, Sang-Keun;Oh, Kang-Seob
    • Anxiety and mood
    • /
    • v.3 no.1
    • /
    • pp.32-40
    • /
    • 2007
  • Objectives : To investigate the validity of an abbreviated self-rated Korean version of MINI (Mini International Neuropsychiatric Interview) patient health survey which screening social anxiety disorder, panic disorder, generalized anxiety disorder, and major depressive disorder. Methods : 115 subjects completed MINI and MINI patient health survey. The validity of MINI patient health survey was assessed by whether the results from MINI patient health survey were compatible with the results from MINI or not. The Cohen's kappa value, specificity, sensitivity, positive predictive value, and negative predictive value was calculated for this purpose. Results : The Kappa values of social anxiety disorder (0.60), panic disorder (0.49), generalized anxiety disorder (0.60) and major depressive disorder without other co-morbid disorder (0.59) were at least moderate in strength of agreement. Conclusion : The abbreviated self-rated Korean version of MINI patient health survey has the moderate to good validity in social anxiety disorder, panic disorder, generalized anxiety disorder, and major depressive disorder without other co-morbid disorders. Our result suggests that this instrument might be useful for screening above 4 disorders if it is used under careful supervision of experienced clinicians.

  • PDF

IOTA Simple Rules in Differentiating between Benign and Malignant Adnexal Masses by Non-expert Examiners

  • Tinnangwattana, Dangcheewan;Vichak-ururote, Linlada;Tontivuthikul, Paponrad;Charoenratana, Cholaros;Lerthiranwong, Thitikarn;Tongsong, Theera
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.9
    • /
    • pp.3835-3838
    • /
    • 2015
  • Objective: To evaluate the diagnostic performance of IOTA simple rules in predicting malignant adnexal tumors by non-expert examiners. Materials and Methods: Five obstetric/gynecologic residents, who had never performed gynecologic ultrasound examination by themselves before, were trained for IOTA simple rules by an experienced examiner. One trained resident performed ultrasound examinations including IOTA simple rules on 100 women, who were scheduled for surgery due to ovarian masses, within 24 hours of surgery. The gold standard diagnosis was based on pathological or operative findings. The five-trained residents performed IOTA simple rules on 30 patients for evaluation of inter-observer variability. Results: A total of 100 patients underwent ultrasound examination for the IOTA simple rules. Of them, IOTA simple rules could be applied in 94 (94%) masses including 71 (71.0%) benign masses and 29 (29.0%) malignant masses. The diagnostic performance of IOTA simple rules showed sensitivity of 89.3% (95%CI, 77.8%; 100.7%), specificity 83.3% (95%CI, 74.3%; 92.3%). Inter-observer variability was analyzed using Cohen's kappa coefficient. Kappa indices of the four pairs of raters are 0.713-0.884 (0.722, 0.827, 0.713, and 0.884). Conclusions: IOTA simple rules have high diagnostic performance in discriminating adnexal masses even when are applied by non-expert sonographers, though a training course may be required. Nevertheless, they should be further tested by a greater number of general practitioners before widely use.

Interobserver agreement on the diagnosis of carotid artery calcifications on panoramic radiographs

  • Yoon, Suk-Ja;Shim, Sung-Kyun;Lee, Jae-Seo;Kang, Byung-Cheol;Lim, Hoi-Jeong;Kim, Min-Seok;Kim, Sun-Hun
    • Imaging Science in Dentistry
    • /
    • v.44 no.2
    • /
    • pp.137-141
    • /
    • 2014
  • Purpose: This study was performed to investigate the interobserver agreement on the detection of carotid artery calcifications on panoramic radiographs. Materials and Methods: This study consisted of panoramic radiographs acquired from 634 male patients of the age of 50 years or older. Having excluded carotids of no diagnostic quality, 1008 carotids from the panoramic radiographs of the patients were interpreted by two oral and maxillofacial radiologists independently for the presence of carotid artery calcifications. Statistical analysis was used to calculate the interobserver agreement. Results: Interobserver agreement was obtained for 932 carotids (92.4%). Inconsistent interpretation of 76 carotids (7.5%) between the two observers was found. Cohen's kappa value was 0.688 (p<0.001). Conclusion: The probability of a match between the two observers was substantially high.

Characteristics of the Bullying in Children with Attention-Deficit/Hyperactivity Disorder (주의력결핍 과잉행동장애 아동에서 집단따돌림 양상)

  • Shin, Dong-Won;Lee, Seung-Min
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.20 no.2
    • /
    • pp.90-96
    • /
    • 2009
  • Objectives: This study examined clinical characteristics associated with bullying in children with attention-deficit/hyperactivity disorder(ADHD). Methods.: Children and their parents were asked to fill out a structured self-report form regarding bullying incidents. To evaluate the characteristics of the children, the results of the ADHD Rating Scale, the Korean version of the Child Behavior Checklist, the ADHD Diagnostic system and the Emotional Recognition Test were used. The agreement of bullying data between each child and their mother and father was measured using Cohen's kappa. The association between victim and perpetrator was analyzed by calculating a contingency coefficient based on chi-square. To compare the characteristics of victimized children and didn't, an independent sample T-test was performed. Results: When children were victims of bullying incidents there was significant agreement between children and parents on the information provided on the self-reports. However, more children reported themselves as a perpetrator of bullying than their parents did. Victimization, that is, the tendency towards being a perpetrator, is associated with the higher level of parental reports of aggressiveness. Conclusion: Victimization of bullying is associated with aggression in children with ADHD. This study suggests that victimized children with ADHD warrant careful evaluation, in particular with regard to the credence placed on parental reports of aggressiveness, and management for aggression.

  • PDF

Correlations in the results of virus neutralization test, hemagglutination inhibition test, and enzyme-linked immunosorbent assay to determine infectious bronchitis virus vaccine potency

  • Park, Mi-Ja;Joh, Seong-Joon;Choi, Kang-Seuk;Kim, Aeran;Seo, Min-Goo;Song, Jae-Young;Yun, Seon-Jong
    • Korean Journal of Veterinary Research
    • /
    • v.56 no.3
    • /
    • pp.189-192
    • /
    • 2016
  • The virus neutralization (VN) test was used to determine potency of the infectious bronchitis (IB) vaccine. The results of VN, hemagglutination inhibition (HI), and enzyme-linked immunosorbent assay (ELISA) were compared with those of the IBV M41. The $r^2$ values between VN and HI titers and the ELISA antibody titer were 0.8782 and 0.0336, respectively, indicating a high correlation between VN and HI, but not VN and ELISA. The Cohen's kappa coefficient between the VN titer of 2 $log_{10}$ and HI titer of 5 $log_2$ was 0.909. Our results showed that VN could be replaced with HI for testing the potency of IBV M41.