• 제목/요약/키워드: Rater Reliability

검색결과 227건 처리시간 0.024초

치매선별검사로서의 시계 그리기 검사(CDT)에 관한 기초연구 (The Pilot study of Clock Drawing Test as a screening test for dementia)

  • 김광호;임재환;김종우;황의완;조성훈
    • 동의신경정신과학회지
    • /
    • 제12권2호
    • /
    • pp.185-191
    • /
    • 2001
  • Objectives: This study aimed to evaluate the usefulness as a screening test of Clock Drawing Test(CDT) compared with the standard K-DRS in probably dementia. Methods: The subjects for this study consisted of 19 elderly persons who visited to the outpatient department of Oriental Neuropsychiatry of the Kyunghee Oriental hospital. They received the K-DRS and the Clock Drawing Test. Three observers evaluated them with circle, numbers, hands. Inter-rater reliability of scores from Clock Drawing Test was assessed and Pearson correlation coefficients were used to examined the relationships between scores from Clock Drawing Test and K-DRS. Results: Correlations between individual raters was highly significant (r= .957, .974, and .970, respectively: p<.001). There was stastically significant correlations between K-DRS and CDT scores (r= 0.849, p<.001). Conclusions: The CDT can be rated reliably by observers and correlations between CDT and K-DRS is significantly high. We confirmed the usefulness of CDT as simple, easily administered, low cost, and reliable general screening test for dementia.

  • PDF

Perturbation and Perceptual Analysis of Pathological Sustained Vowels according to Signal Typing

  • 이지연;최성희;;한민수;최홍식
    • 말소리와 음성과학
    • /
    • 제2권2호
    • /
    • pp.109-115
    • /
    • 2010
  • In this paper, we investigate a signal typing on the basis of visual impression of distinctive spectrogram. Pathological voices are classified into signal type 1, 2, 3, or 4 to estimate perturbation parameters and to mark perceptual rating based on Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V). The results suggest that perturbation analysis can be applied to only type 1 and 2 signals and the perceptual ratings of overall grade increase with each signal type, overall. A good inter-rater reliability is showed among three raters. We recommend that pathological voices should be marked the signal typing and CAPE-V, together, to definitely describe the characteristics of pathological voices.

  • PDF

Reliability and Validity of the Appropriateness Evaluation Protocol for Public Hospitals in Korea

  • Lee, Clara;Kim, Stella Jung-Hyun;Lee, Changwoo;Shin, Euichul
    • Journal of Preventive Medicine and Public Health
    • /
    • 제52권5호
    • /
    • pp.316-322
    • /
    • 2019
  • Objectives: This study was conducted to assess the applicability of the Appropriateness Evaluation Protocol (AEP) for public hospitals in Korea. Methods: In May 2016, 1500 admission claims were collected from Korean public district hospitals using stratified random sampling. Of these claims, 560 admissions to 37 hospitals were retrieved for analysis. Medical records administrators determined the appropriateness of admission using the criteria detailed in the AEP, and a physician separately assessed the appropriateness of admission based on her clinical judgment. To examine the applicability of the AEP, the concordance of the decisions made between a pair of AEP reviewers and between an AEP reviewer and a physician reviewer was compared. Results: The results showed an almost perfect inter-rater agreement between the AEP reviewers and a moderate agreement between the AEP reviewers and the physician. The sensitivity and specificity of the AEP were calculated as 0.86 and 0.56, respectively. Conclusions: Our findings suggest that the AEP could potentially be applied to Korean public hospitals as a reliable and valid instrument for assessing the appropriateness of admissions.

Morphological variation of the velum in children and adults using magnetic resonance imaging

  • Kotlarek, Katelyn J.;Haenssler, Abigail E.;Hildebrand, Kori E.;Perry, Jamie L.
    • Imaging Science in Dentistry
    • /
    • 제49권2호
    • /
    • pp.153-158
    • /
    • 2019
  • Purpose: The purpose of this study was to investigate variations in velar shape according to age, sex, and race using magnetic resonance imaging (MRI). Materials and Methods: The study sample consisted of 170 participants (85 children, 85 adults) between 4 and 34 years of age. Velar morphology was visually classified using midsagittal MRI scans for each participant by 2 independent raters. Inter- and intra-rater reliability was assessed. Statistical analyses were performed to identify correlations of velar shape with sex, age, and race. Results: The most frequent velar shape was "butt" for both adults(41%) and children (58%) in this study. The least common shapes for adults were "leaf" and "S." The children did not exhibit any "leaf" or "straight" velar shapes. A statistically significant difference was noted for age with respect to velar shape (P=0.014). Sex and race were found to have no significant impact on velar shape in this study. Conclusion: When using MRI to evaluate velar morphology, the "butt" shape was most common in both children and adults. Velar shape varied significantly with age, while race and sex did not have a significant impact.

Real Time Versus Photographic Assessment of Stool Consistency Using the Brussels Infant and Toddler Stool Scale: Are They Telling Us the Same?

  • Aman, Berthold Albert;Levy, Elvira Ingrid;Hofman, Benjamine;Vandenplas, Yvan;Huysentruyt, Koen
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • 제24권1호
    • /
    • pp.38-44
    • /
    • 2021
  • Purpose: Digital communication is becoming increasingly important in clinical practice and research. The finding that stool consistency can be evaluated similarly using either "in vivo" or photographic material by health care professionals will decrease subjective interpretation by parents. The primary outcome of this study was the reliability of stool consistency scoring using the Brussels Infant and Toddler Stool Scale (BITSS) between fresh stools and their photos; the secondary outcome was the inter-rater reliability based on the fresh stools. Methods: Fresh stool samples from healthy children were collected in a day care center. These stools, and one month later the corresponding photos presented in a random order, were presented to 14 observers. Reliabilities were analyzed using absolute agreements and weighted and unweighted Cohen's κ. Results: In total, 202 samples were rated 576 times. Absolute agreement between photographic and real time assessment ranged between 71.1% and 83.3% among observers. This corresponded with substantial agreement (unweighted κ=0.70 [95% CI, 0.61-0.78]; weighted κ=0.86 [95% CI, 0.78-0.88]). The inter-observer agreement showed similar percentages of absolute agreement (81.4-82.0%) and κ-values corresponding with fair-to-moderate agreement. Conclusion: Our findings suggest that the assessment of fresh stool consistency can also reliably be done on photographic material when using the BITSS. This opens opportunities in scientific surroundings and in our daily life communication with parents and caretakers.

Correlation Between Knee Muscle Strength and Maximal Cycling Speed Measured Using 3D Depth Camera in Virtual Reality Environment

  • Kim, Ye Jin;Jeon, Hye-seon;Park, Joo-hee;Moon, Gyeong-Ah;Wang, Yixin
    • 한국전문물리치료학회지
    • /
    • 제29권4호
    • /
    • pp.262-268
    • /
    • 2022
  • Background: Virtual reality (VR) programs based on motion capture camera are the most convenient and cost-effective approaches for remote rehabilitation. Assessment of physical function is critical for providing optimal VR rehabilitation training; however, direct muscle strength measurement using camera-based kinematic data is impracticable. Therefore, it is necessary to develop a method to indirectly estimate the muscle strength of users from the value obtained using a motion capture camera. Objects: The purpose of this study was to determine whether the pedaling speed converted using the VR engine from the captured foot position data in the VR environment can be used as an indirect way to evaluate knee muscle strength, and to investigate the validity and reliability of a camera-based VR program. Methods: Thirty healthy adults were included in this study. Each subject performed a 15-second maximum pedaling test in the VR and built-in speedometer modes. In the VR speedometer mode, a motion capture camera was used to detect the position of the ankle joints and automatically calculate the pedaling speed. An isokinetic dynamometer was used to assess the isometric and isokinetic peak torques of knee flexion and extension. Results: The pedaling speeds in VR and built-in speedometer modes revealed a significantly high positive correlation (r = 0.922). In addition, the intra-rater reliability of the pedaling speed in the VR speedometer mode was good (ICC [intraclass correlation coefficient] = 0.685). The results of the Pearson correlation analysis revealed a significant moderate positive correlation between the pedaling speed of the VR speedometer and the peak torque of knee isokinetic flexion (r = 0.639) and extension (r = 0.598). Conclusion: This study suggests the potential benefits of measuring the maximum pedaling speed using 3D depth camera in a VR environment as an indirect assessment of muscle strength. However, technological improvements must be followed to obtain more accurate estimation of muscle strength from the VR cycling test.

만성 신부전 환자간호의 질평가 도구개발 (Development of An Evaluation Tool for the Quality of Patient Care Chonic Renal Failure)

  • 양영옥;김문실
    • 간호행정학회지
    • /
    • 제2권1호
    • /
    • pp.57-72
    • /
    • 1996
  • Provision of better nursing care to patients is a difficult but important task. The first problem for nursing quality improvement is development of evaluation tool for the quality of nursing care. This study tries to develop a patient care tool for patients with chronic renal failure. This study as a procedural evaluation of patient care, tries to show what, how, at what order to provide care to patients with chronic renal failure. This study is divided into process of development of tool, its reliability and validity. Among process of development of tool is focal group, small expert group and expert evaluation group. To develop approprieteness of tool, nurses working is four major hospitals is Seoul were selected. To evaluate the credibility of subjects, 19 patient who were hospitalized and discharged within 3 months were selected. The period for collecting data for reliability and valiability evaluation was between Sept. 20 to Oct. 18, 1995. The development process of this study is as follows ; 1. Make preliminary list of the tool by focal group consisting of 8 clinical nurses. 2. Modify and add preliminary list by 4 expert nursing panel. 3. Calculate content validity of the tool by 23 nursing expert panel of judge. 4. Verity relability and validity of the tool. 5. Finalize an evaluation tool for the quality of nursing care in chronic renal failure patient. The result of this study were as follows ; 1. Development of evaluation tool for the quality of nursing care in chronic renal failure. 1) The evaluation of this study was developed 5 standards, 28 criteria. and 130 indicators 2) Nursing care evaluation scores for chronic renal failure patients were average 68.8. 2. Verity reliability and validity of the tool. 1) 5 standards were divided into 4 point scale and according to 28 creteria, indicators of standard were 3.72 and of criteria were 3.77 2) Inter - rater reliability (consentaneity score) of the tool by pearson correlation coefficient betwwen rates were r= .72, r= .75 and interreliabilities by single - facet crossed design were r= .96. 3) The alpha coeffecient relating to internal consistency was .7259 over 27 items of 28 criterias of developed tool. Through this study, I'm sure that the developed tool for the quality of patient care in chronic-renal failure patient will show the way of more improvement of the quality of nursing care and effective nursing intervention.

  • PDF

정상교합자의 치관경사도에 관한 연구 (Clinical crown angulation and inclination of normal occlusion in a large Korean sample)

  • 이신재;안석준;김태우
    • 대한치과교정학회지
    • /
    • 제35권5호
    • /
    • pp.331-340
    • /
    • 2005
  • 치관경사도 연구는 부정교합 진단과 치료 계획 수립 및 더욱 편리한 교정 장치 개발과 관련한 기초 자료로써 중요시되어 왔다 이에 본 연구는 307명(남자 187명, 여자 120명)의 대표본 성인 정상교합자를 연구대상으로 삼아 자료의 신뢰성 검증이 병행된 치관경사도를 보고함으로써 치과교정학 임상에 도움이 되는 기초자료를 도출해 보고자 시행되었다. 치관경사도 측정을 위하여 정상교합자 표본의 모형 상에서 개개 치아의 근원심 각도 및 협설측 각도를 측정하였으며, 측정 전후 측정자간 및 측정자 내의 신뢰성 검증을 시행하였고. 남녀간의 성차와 기존 연구자료와의 차이를 검증하였다. 연구 결과 본 연구가 대표본을 대상으로 하여 높은 신뢰성 지표를 보였음에도 불구하고 정상교합자의 치관경사도는 변동이 심한 것이 관찰되었고 이에 따라 기존 연구들에 대비하여 임상적으로 유의한 자료상의 차별성은 고찰할 수 없었으며 변동의 양상 또한 선학들이 보고한 자료와 유사하였다 결론적으로 치관경사도 측정시 드러난 정상변동을 해석하여 개별 적합성이 최대로 증진된 효율적인 치과교정장치를 개발하기 위해 좀 더 발전된 수학적·통계학적 모형 구성이 필요할 것으로 생각되었다

Interpretation of Complete Tumor Response on MRI Following Chemoradiotherapy of Rectal Cancer: Inter-Reader Agreement and Associated Factors in Multi-Center Clinical Practice

  • Hae Young Kim;Seung Hyun Cho;Jong Keon Jang;Bohyun Kim;Chul-min Lee;Joon Seok Lim;Sung Kyoung Moon;Soon Nam Oh;Nieun Seo;Seong Ho Park
    • Korean Journal of Radiology
    • /
    • 제25권4호
    • /
    • pp.351-362
    • /
    • 2024
  • Objective: To measure inter-reader agreement and identify associated factors in interpreting complete response (CR) on magnetic resonance imaging (MRI) following chemoradiotherapy (CRT) for rectal cancer. Materials and Methods: This retrospective study involved 10 readers from seven hospitals with experience of 80-10210 cases, and 149 patients who underwent surgery after CRT for rectal cancer. Using MRI-based tumor regression grading (mrTRG) and methods employed in daily practice, the readers independently assessed mrTRG, CR on T2-weighted images (T2WI) denoted as mrCRT2W, and CR on all images including diffusion-weighted images (DWI) denoted as mrCRoverall. The readers described their interpretation patterns and how they utilized DWI. Inter-reader agreement was measured using multi-rater kappa, and associated factors were analyzed using multivariable regression. Correlation between sensitivity and specificity of each reader was analyzed using Spearman coefficient. Results: The mrCRT2W and mrCRoverall rates varied widely among the readers, ranging 18.8%-40.3% and 18.1%-34.9%, respectively. Nine readers used DWI as a supplement sequence, which modified interpretations on T2WI in 2.7% of cases (36/1341 [149 patients × 9 readers]) and mostly (33/36) changed mrCRT2W to non-mrCRoverall. The kappa values for mrTRG, mrCRT2W, and mrCRoverall were 0.56 (95% confidence interval: 0.49, 0.62), 0.55 (0.52, 0.57), and 0.54 (0.51, 0.57), respectively. No use of rectal gel, larger initial tumor size, and higher initial cT stage exhibited significant association with a higher interreader agreement for assessing mrCRoverall (P ≤ 0.042). Strong negative correlations were observed between the sensitivity and specificity of individual readers (coefficient, -0.718 to -0.963; P ≤ 0.019). Conclusion: Inter-reader agreement was moderate for assessing CR on post-CRT MRI. Readers' varying standards on MRI interpretation (i.e., threshold effect), along with the use of rectal gel, initial tumor size, and initial cT stage, were significant factors associated with inter-reader agreement.

주의력결핍 과잉운동장애 아동 평가척도의 교사 평가판에 대한 신뢰도 및 타당도 연구 (The Study of Reliability and Validity of Attention Deficit Disorder Evaluation Scale-School Version(ADDES-SV))

  • 배진우;정성덕;이종범;박형배;김진성;송창진
    • Journal of Yeungnam Medical Science
    • /
    • 제14권2호
    • /
    • pp.415-429
    • /
    • 1997
  • 저자는 1989년 McCarney(1989)에 의해 개발되어 신뢰도와 타당도가 입증된 주의력 결핍 장애 평가척도-교사판(ADDES-SV)의 한국형을 개발하여, 신뢰도와 타당도를 검증하고, 한국실정에서 ADHD 환자를 선별할수 있는 평가용 도구로 적합한지 여부와 ADHD를 연구할 도구로 사용 할수 있는지를 알아보고자 본 연구를 시행하게 되었다. 1996년 10-11월사이에 대상은 대구, 경북에 소재한 4개 초등학교 2학년 아동 263명과 1996년 6-10월사이에 ADHD 환자 28명을 대상으로 하였으며, 진단은 DSM-IV의 기준에 근거 하였다. 문항번역은 2명의 신경정신과 전문의와 1명의 사회 사업가와 1명의 아동 심리학자에 의해 이루어졌다. 검사-재검사 신뢰 검증에서 신뢰도 계수는 주의산만 계수 0.88, 충동성 계수 0.80, 과잉운동 계수 0.83, 전체점수 0.83이었고(p<0.05), 내적 일관성에 대한 신뢰도 검증에서 Cronbach의 ${\alpha}$값은 주의산만, 충동성, 과잉운동 소척도에서 각각, 0.98, 0.87, 0.96 (p<0.05)이었고, 반분신뢰도 계수는 주의산만 소척도에서 part 1: 0.96(p<0.05), part 2: 0.95(p<0.05), 충동성 소척도에서 part 1: 0.95(p<0.05), part 2: 0.93(p<0.05), 과잉 운동 소척도에서 part 1: 0.92(p<0.05), part 2: 0.94(p<0.05)이었다. 각 소척도간의 상관은 주의산만 소척도와 충동성 소척도와의 상관계수는0.87(p<0.05), 충동성 소척도와 과잉운동 소척도와의 상관계수는 0.95(p<0.05), 주의산만 소척도와 과잉운동 소척도와의 상관계수는 0.88(p<0.05)로 각 소척도간의 높은 상관관계를 보여주고, 검사자간 신뢰도는 주의산만 소척도 0.92, 충동성 소척도 0.87, 과잉운동 소척도 0.89, 전체점수 0.89였다. 본 교실에서 한국형을 개발하여 신뢰도와 타당도를 입증한 CAP척도와의 공존 타당도 검사에서는 환자군에서 0.85, 대조군에서 0.79의 상관관계를 얻었다. ADHD 환자군과 정상 대조군간의 감별 타당도 검증에서 모두 유의하게 환자군이 높은 점수를 보였다. 판별력 검증에는 정상대조군은 100%에서 정상으로, 환자군은 89.2%에서 환자군으로 판별되어 전체 판별력이 94.6%로 나타났으며, Cmax공식을 적용했을 때 89.2%의 판별력의 개선율을 보였다. 따라서, ADDES-SV척도는 한국인의 ADHD를 평가하기 위한 도구로서 신뢰도와 타당도가 높은 것으로 나타났으며, 향후 ADHD에 대한 선별검사 및 역학 조사 연구에 유용한 도구인 것으로 판단된다.

  • PDF