• 제목/요약/키워드: rater reliability

검색결과 227건 처리시간 0.022초

The Pilot study of Clock Drawing Test as a screening test for dementia (치매선별검사로서의 시계 그리기 검사(CDT)에 관한 기초연구)

  • Kim Gwang-Ho;Lim Jae-Hwan;Kim Jong-Woo;Whang Wei-Wan;Cho Seung-Hun
    • Journal of Oriental Neuropsychiatry
    • /
    • 제12권2호
    • /
    • pp.185-191
    • /
    • 2001
  • Objectives: This study aimed to evaluate the usefulness as a screening test of Clock Drawing Test(CDT) compared with the standard K-DRS in probably dementia. Methods: The subjects for this study consisted of 19 elderly persons who visited to the outpatient department of Oriental Neuropsychiatry of the Kyunghee Oriental hospital. They received the K-DRS and the Clock Drawing Test. Three observers evaluated them with circle, numbers, hands. Inter-rater reliability of scores from Clock Drawing Test was assessed and Pearson correlation coefficients were used to examined the relationships between scores from Clock Drawing Test and K-DRS. Results: Correlations between individual raters was highly significant (r= .957, .974, and .970, respectively: p<.001). There was stastically significant correlations between K-DRS and CDT scores (r= 0.849, p<.001). Conclusions: The CDT can be rated reliably by observers and correlations between CDT and K-DRS is significantly high. We confirmed the usefulness of CDT as simple, easily administered, low cost, and reliable general screening test for dementia.

  • PDF

Perturbation and Perceptual Analysis of Pathological Sustained Vowels according to Signal Typing

  • Lee, Ji-Yeoun;Choi, Seong-Hee;Jiang, Jack J.;Hahn, Min-Soo;Choi, Hong-Shik
    • Phonetics and Speech Sciences
    • /
    • 제2권2호
    • /
    • pp.109-115
    • /
    • 2010
  • In this paper, we investigate a signal typing on the basis of visual impression of distinctive spectrogram. Pathological voices are classified into signal type 1, 2, 3, or 4 to estimate perturbation parameters and to mark perceptual rating based on Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V). The results suggest that perturbation analysis can be applied to only type 1 and 2 signals and the perceptual ratings of overall grade increase with each signal type, overall. A good inter-rater reliability is showed among three raters. We recommend that pathological voices should be marked the signal typing and CAPE-V, together, to definitely describe the characteristics of pathological voices.

  • PDF

Reliability and Validity of the Appropriateness Evaluation Protocol for Public Hospitals in Korea

  • Lee, Clara;Kim, Stella Jung-Hyun;Lee, Changwoo;Shin, Euichul
    • Journal of Preventive Medicine and Public Health
    • /
    • 제52권5호
    • /
    • pp.316-322
    • /
    • 2019
  • Objectives: This study was conducted to assess the applicability of the Appropriateness Evaluation Protocol (AEP) for public hospitals in Korea. Methods: In May 2016, 1500 admission claims were collected from Korean public district hospitals using stratified random sampling. Of these claims, 560 admissions to 37 hospitals were retrieved for analysis. Medical records administrators determined the appropriateness of admission using the criteria detailed in the AEP, and a physician separately assessed the appropriateness of admission based on her clinical judgment. To examine the applicability of the AEP, the concordance of the decisions made between a pair of AEP reviewers and between an AEP reviewer and a physician reviewer was compared. Results: The results showed an almost perfect inter-rater agreement between the AEP reviewers and a moderate agreement between the AEP reviewers and the physician. The sensitivity and specificity of the AEP were calculated as 0.86 and 0.56, respectively. Conclusions: Our findings suggest that the AEP could potentially be applied to Korean public hospitals as a reliable and valid instrument for assessing the appropriateness of admissions.

Morphological variation of the velum in children and adults using magnetic resonance imaging

  • Kotlarek, Katelyn J.;Haenssler, Abigail E.;Hildebrand, Kori E.;Perry, Jamie L.
    • Imaging Science in Dentistry
    • /
    • 제49권2호
    • /
    • pp.153-158
    • /
    • 2019
  • Purpose: The purpose of this study was to investigate variations in velar shape according to age, sex, and race using magnetic resonance imaging (MRI). Materials and Methods: The study sample consisted of 170 participants (85 children, 85 adults) between 4 and 34 years of age. Velar morphology was visually classified using midsagittal MRI scans for each participant by 2 independent raters. Inter- and intra-rater reliability was assessed. Statistical analyses were performed to identify correlations of velar shape with sex, age, and race. Results: The most frequent velar shape was "butt" for both adults(41%) and children (58%) in this study. The least common shapes for adults were "leaf" and "S." The children did not exhibit any "leaf" or "straight" velar shapes. A statistically significant difference was noted for age with respect to velar shape (P=0.014). Sex and race were found to have no significant impact on velar shape in this study. Conclusion: When using MRI to evaluate velar morphology, the "butt" shape was most common in both children and adults. Velar shape varied significantly with age, while race and sex did not have a significant impact.

Real Time Versus Photographic Assessment of Stool Consistency Using the Brussels Infant and Toddler Stool Scale: Are They Telling Us the Same?

  • Aman, Berthold Albert;Levy, Elvira Ingrid;Hofman, Benjamine;Vandenplas, Yvan;Huysentruyt, Koen
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • 제24권1호
    • /
    • pp.38-44
    • /
    • 2021
  • Purpose: Digital communication is becoming increasingly important in clinical practice and research. The finding that stool consistency can be evaluated similarly using either "in vivo" or photographic material by health care professionals will decrease subjective interpretation by parents. The primary outcome of this study was the reliability of stool consistency scoring using the Brussels Infant and Toddler Stool Scale (BITSS) between fresh stools and their photos; the secondary outcome was the inter-rater reliability based on the fresh stools. Methods: Fresh stool samples from healthy children were collected in a day care center. These stools, and one month later the corresponding photos presented in a random order, were presented to 14 observers. Reliabilities were analyzed using absolute agreements and weighted and unweighted Cohen's κ. Results: In total, 202 samples were rated 576 times. Absolute agreement between photographic and real time assessment ranged between 71.1% and 83.3% among observers. This corresponded with substantial agreement (unweighted κ=0.70 [95% CI, 0.61-0.78]; weighted κ=0.86 [95% CI, 0.78-0.88]). The inter-observer agreement showed similar percentages of absolute agreement (81.4-82.0%) and κ-values corresponding with fair-to-moderate agreement. Conclusion: Our findings suggest that the assessment of fresh stool consistency can also reliably be done on photographic material when using the BITSS. This opens opportunities in scientific surroundings and in our daily life communication with parents and caretakers.

Correlation Between Knee Muscle Strength and Maximal Cycling Speed Measured Using 3D Depth Camera in Virtual Reality Environment

  • Kim, Ye Jin;Jeon, Hye-seon;Park, Joo-hee;Moon, Gyeong-Ah;Wang, Yixin
    • Physical Therapy Korea
    • /
    • 제29권4호
    • /
    • pp.262-268
    • /
    • 2022
  • Background: Virtual reality (VR) programs based on motion capture camera are the most convenient and cost-effective approaches for remote rehabilitation. Assessment of physical function is critical for providing optimal VR rehabilitation training; however, direct muscle strength measurement using camera-based kinematic data is impracticable. Therefore, it is necessary to develop a method to indirectly estimate the muscle strength of users from the value obtained using a motion capture camera. Objects: The purpose of this study was to determine whether the pedaling speed converted using the VR engine from the captured foot position data in the VR environment can be used as an indirect way to evaluate knee muscle strength, and to investigate the validity and reliability of a camera-based VR program. Methods: Thirty healthy adults were included in this study. Each subject performed a 15-second maximum pedaling test in the VR and built-in speedometer modes. In the VR speedometer mode, a motion capture camera was used to detect the position of the ankle joints and automatically calculate the pedaling speed. An isokinetic dynamometer was used to assess the isometric and isokinetic peak torques of knee flexion and extension. Results: The pedaling speeds in VR and built-in speedometer modes revealed a significantly high positive correlation (r = 0.922). In addition, the intra-rater reliability of the pedaling speed in the VR speedometer mode was good (ICC [intraclass correlation coefficient] = 0.685). The results of the Pearson correlation analysis revealed a significant moderate positive correlation between the pedaling speed of the VR speedometer and the peak torque of knee isokinetic flexion (r = 0.639) and extension (r = 0.598). Conclusion: This study suggests the potential benefits of measuring the maximum pedaling speed using 3D depth camera in a VR environment as an indirect assessment of muscle strength. However, technological improvements must be followed to obtain more accurate estimation of muscle strength from the VR cycling test.

Development of An Evaluation Tool for the Quality of Patient Care Chonic Renal Failure (만성 신부전 환자간호의 질평가 도구개발)

  • Yang, Young-Ock;Kim, Moon-Sil
    • Journal of Korean Academy of Nursing Administration
    • /
    • 제2권1호
    • /
    • pp.57-72
    • /
    • 1996
  • Provision of better nursing care to patients is a difficult but important task. The first problem for nursing quality improvement is development of evaluation tool for the quality of nursing care. This study tries to develop a patient care tool for patients with chronic renal failure. This study as a procedural evaluation of patient care, tries to show what, how, at what order to provide care to patients with chronic renal failure. This study is divided into process of development of tool, its reliability and validity. Among process of development of tool is focal group, small expert group and expert evaluation group. To develop approprieteness of tool, nurses working is four major hospitals is Seoul were selected. To evaluate the credibility of subjects, 19 patient who were hospitalized and discharged within 3 months were selected. The period for collecting data for reliability and valiability evaluation was between Sept. 20 to Oct. 18, 1995. The development process of this study is as follows ; 1. Make preliminary list of the tool by focal group consisting of 8 clinical nurses. 2. Modify and add preliminary list by 4 expert nursing panel. 3. Calculate content validity of the tool by 23 nursing expert panel of judge. 4. Verity relability and validity of the tool. 5. Finalize an evaluation tool for the quality of nursing care in chronic renal failure patient. The result of this study were as follows ; 1. Development of evaluation tool for the quality of nursing care in chronic renal failure. 1) The evaluation of this study was developed 5 standards, 28 criteria. and 130 indicators 2) Nursing care evaluation scores for chronic renal failure patients were average 68.8. 2. Verity reliability and validity of the tool. 1) 5 standards were divided into 4 point scale and according to 28 creteria, indicators of standard were 3.72 and of criteria were 3.77 2) Inter - rater reliability (consentaneity score) of the tool by pearson correlation coefficient betwwen rates were r= .72, r= .75 and interreliabilities by single - facet crossed design were r= .96. 3) The alpha coeffecient relating to internal consistency was .7259 over 27 items of 28 criterias of developed tool. Through this study, I'm sure that the developed tool for the quality of patient care in chronic-renal failure patient will show the way of more improvement of the quality of nursing care and effective nursing intervention.

  • PDF

Clinical crown angulation and inclination of normal occlusion in a large Korean sample (정상교합자의 치관경사도에 관한 연구)

  • Lee, Shin-Jae;Ahn, Sug-Joon;Kim, Tae-Woo
    • The korean journal of orthodontics
    • /
    • 제35권5호
    • /
    • pp.331-340
    • /
    • 2005
  • Angulation and inclination of clinical crown is important for diagnosing, treatment planning and developing convenient orthodontic attachments. The aim of the study was to establish normative data with higher reliability on the angulation and inclination of clinical crown of Koreans with normal occlusion This study employed the dental casts of 307 (male. 187: female. 120) adult normal occlusion samples. The angulation and inclination of clinical crown were measured by set-up model checker In order to ensure reliability, intra- and inter-rater error were evaluated 3 times The resultant data obtained had excellent reliability however when compared with the previous data as well as with gender difference, clinically significant interpretation was impossible because the whithin-dataset normal variation was High which was common pattern of angulation and inclination measuring data of previous research The result of this biometric study seemed 4o suggest more substantive design of the multivariate. high-dimensional interpretation methodology of these normal variation is required if more compatible orthodontic appliance could be developed.

Interpretation of Complete Tumor Response on MRI Following Chemoradiotherapy of Rectal Cancer: Inter-Reader Agreement and Associated Factors in Multi-Center Clinical Practice

  • Hae Young Kim;Seung Hyun Cho;Jong Keon Jang;Bohyun Kim;Chul-min Lee;Joon Seok Lim;Sung Kyoung Moon;Soon Nam Oh;Nieun Seo;Seong Ho Park
    • Korean Journal of Radiology
    • /
    • 제25권4호
    • /
    • pp.351-362
    • /
    • 2024
  • Objective: To measure inter-reader agreement and identify associated factors in interpreting complete response (CR) on magnetic resonance imaging (MRI) following chemoradiotherapy (CRT) for rectal cancer. Materials and Methods: This retrospective study involved 10 readers from seven hospitals with experience of 80-10210 cases, and 149 patients who underwent surgery after CRT for rectal cancer. Using MRI-based tumor regression grading (mrTRG) and methods employed in daily practice, the readers independently assessed mrTRG, CR on T2-weighted images (T2WI) denoted as mrCRT2W, and CR on all images including diffusion-weighted images (DWI) denoted as mrCRoverall. The readers described their interpretation patterns and how they utilized DWI. Inter-reader agreement was measured using multi-rater kappa, and associated factors were analyzed using multivariable regression. Correlation between sensitivity and specificity of each reader was analyzed using Spearman coefficient. Results: The mrCRT2W and mrCRoverall rates varied widely among the readers, ranging 18.8%-40.3% and 18.1%-34.9%, respectively. Nine readers used DWI as a supplement sequence, which modified interpretations on T2WI in 2.7% of cases (36/1341 [149 patients × 9 readers]) and mostly (33/36) changed mrCRT2W to non-mrCRoverall. The kappa values for mrTRG, mrCRT2W, and mrCRoverall were 0.56 (95% confidence interval: 0.49, 0.62), 0.55 (0.52, 0.57), and 0.54 (0.51, 0.57), respectively. No use of rectal gel, larger initial tumor size, and higher initial cT stage exhibited significant association with a higher interreader agreement for assessing mrCRoverall (P ≤ 0.042). Strong negative correlations were observed between the sensitivity and specificity of individual readers (coefficient, -0.718 to -0.963; P ≤ 0.019). Conclusion: Inter-reader agreement was moderate for assessing CR on post-CRT MRI. Readers' varying standards on MRI interpretation (i.e., threshold effect), along with the use of rectal gel, initial tumor size, and initial cT stage, were significant factors associated with inter-reader agreement.

The Study of Reliability and Validity of Attention Deficit Disorder Evaluation Scale-School Version(ADDES-SV) (주의력결핍 과잉운동장애 아동 평가척도의 교사 평가판에 대한 신뢰도 및 타당도 연구)

  • Bae, Jin-Woo;Cheung, Seung-Douk;Lee, Jong-Bum;Park, Hyung-Bae;Kim, Jin-Seung;Song, Chang-Jin
    • Journal of Yeungnam Medical Science
    • /
    • 제14권2호
    • /
    • pp.415-429
    • /
    • 1997
  • The purpose of this study was to examine the reliability and validity of attention deficit disorder evaluation scale-school version(ADDES-SV). Between October 1996 and November 1996, ADDES-SV was administered to 263 elementary school students in the second grade and between Jun 1996 and October 1996, 28 attention deficit hyperactivity disorder patients. In the reliability test, the test-retest reliability coefficient was significantly high and that of inattention was 0.88, that of impulsivity was 0.80, that of hyperactivity was 0.83 and total score was 0.83. In the reliability test by internal consistancy, the Cronbach $\alpha$ coefficient was significantly high and that of inattention was 0.98, that of impulsivity was 0.87, that of hyperactivity was 0.87(p<0.05). The half-sprit reliability coefficient by first-second half method showed high correlation and that of inattention was part 1: 0.96, part 2: 0.96 impulsivity was part 1: 0.95, part 2: 0.93, hyperactivity was part 1: 0.92, part 2: 0.94(p<0.05). Inter-rater reliability by pearson correlation coefficient was significantly high and that of inattention was 0.92, that of impulsivity was 0.87, that of hyperactivity was 0.89 and total score was 0.89. The concurrent validity between ADDES-SV and CAP scale was 0.85 in attention deficit hyperactivity disorder patient group and 0.79 in normal control group(p<0.05). In discriminant validity test between attention deficit hyperactivity disorder patient group and normal control group, the patient group showed higher score(p<0.05). The total discriminant capacity of the patient group in ADDES-SV was 94.6%. In this point of view, ADDES-SV scale showed high reliability and validity in applying to Korean subjects and was proved to be the useful screening test tool for attention deficit hyperactivity disorder research.

  • PDF