• Title/Summary/Keyword: Inter-rater Reliability

Search Result 198, Processing Time 0.029 seconds

Development of An Evaluation Tool for the Quality of Patient Care Chonic Renal Failure (만성 신부전 환자간호의 질평가 도구개발)

  • Yang, Young-Ock;Kim, Moon-Sil
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.2 no.1
    • /
    • pp.57-72
    • /
    • 1996
  • Provision of better nursing care to patients is a difficult but important task. The first problem for nursing quality improvement is development of evaluation tool for the quality of nursing care. This study tries to develop a patient care tool for patients with chronic renal failure. This study as a procedural evaluation of patient care, tries to show what, how, at what order to provide care to patients with chronic renal failure. This study is divided into process of development of tool, its reliability and validity. Among process of development of tool is focal group, small expert group and expert evaluation group. To develop approprieteness of tool, nurses working is four major hospitals is Seoul were selected. To evaluate the credibility of subjects, 19 patient who were hospitalized and discharged within 3 months were selected. The period for collecting data for reliability and valiability evaluation was between Sept. 20 to Oct. 18, 1995. The development process of this study is as follows ; 1. Make preliminary list of the tool by focal group consisting of 8 clinical nurses. 2. Modify and add preliminary list by 4 expert nursing panel. 3. Calculate content validity of the tool by 23 nursing expert panel of judge. 4. Verity relability and validity of the tool. 5. Finalize an evaluation tool for the quality of nursing care in chronic renal failure patient. The result of this study were as follows ; 1. Development of evaluation tool for the quality of nursing care in chronic renal failure. 1) The evaluation of this study was developed 5 standards, 28 criteria. and 130 indicators 2) Nursing care evaluation scores for chronic renal failure patients were average 68.8. 2. Verity reliability and validity of the tool. 1) 5 standards were divided into 4 point scale and according to 28 creteria, indicators of standard were 3.72 and of criteria were 3.77 2) Inter - rater reliability (consentaneity score) of the tool by pearson correlation coefficient betwwen rates were r= .72, r= .75 and interreliabilities by single - facet crossed design were r= .96. 3) The alpha coeffecient relating to internal consistency was .7259 over 27 items of 28 criterias of developed tool. Through this study, I'm sure that the developed tool for the quality of patient care in chronic-renal failure patient will show the way of more improvement of the quality of nursing care and effective nursing intervention.

  • PDF

Clinical crown angulation and inclination of normal occlusion in a large Korean sample (정상교합자의 치관경사도에 관한 연구)

  • Lee, Shin-Jae;Ahn, Sug-Joon;Kim, Tae-Woo
    • The korean journal of orthodontics
    • /
    • v.35 no.5 s.112
    • /
    • pp.331-340
    • /
    • 2005
  • Angulation and inclination of clinical crown is important for diagnosing, treatment planning and developing convenient orthodontic attachments. The aim of the study was to establish normative data with higher reliability on the angulation and inclination of clinical crown of Koreans with normal occlusion This study employed the dental casts of 307 (male. 187: female. 120) adult normal occlusion samples. The angulation and inclination of clinical crown were measured by set-up model checker In order to ensure reliability, intra- and inter-rater error were evaluated 3 times The resultant data obtained had excellent reliability however when compared with the previous data as well as with gender difference, clinically significant interpretation was impossible because the whithin-dataset normal variation was High which was common pattern of angulation and inclination measuring data of previous research The result of this biometric study seemed 4o suggest more substantive design of the multivariate. high-dimensional interpretation methodology of these normal variation is required if more compatible orthodontic appliance could be developed.

Evaluation of Moxibustion -related Health Information on Korean Internet News Coverage (한국 인터넷 신문기사에서 뜸 관련 의료정보 평가)

  • Kang, O-Seok;Park, Hi-Joon;Kim, Song-Yi;Lee, Hye-Jung;Chae, Youn-Byoung
    • Journal of Acupuncture Research
    • /
    • v.26 no.2
    • /
    • pp.189-199
    • /
    • 2009
  • Objectives : Despite the substantial amount of newspaper coverage related to complementary and alternative medicine on the internet in recent years, little is know about the quality of the health information. To evaluate health information of the newspaper articles on moxibustion available in Korea through Korean language search engines and Web sites. Methods : We searched 454 news stories about moxibustion between 1 January 2006 and 31 December 2008. Among them, 34 internet news coverage related to health information on moxibustion were selected and rated against eight categories by two individuals. Results : The inter-rater reliability of the two reviewers was assessed as 0.69, indicating a moderately high level of agreement. The overall rating score for 34 articles was 35.7${\pm}$17.2 for the statement criteria and 12.9${\pm}$17.0 for the satisfaction criteria. Overall, although they might be improving recently, the scores remain generally low. There was a statistically significant difference in the score of the newspaper coverage according to the type of evidence sources, including anecdotes. Conclusions : There is substantial variability in news reporting practices about moxibustion. It is urgently needed to enhance the information related to CAM including moxibustion through the news media in Korea.

  • PDF

An Effect of the Valence of Best Reply on the Conformity of General Reply (베스트 댓글의 방향성이 일반댓글의 동조효과에 미치는 영향)

  • Moon, Kwangsu;Kim, Seul;Oah, Shezeen
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.12
    • /
    • pp.201-211
    • /
    • 2013
  • This study examined the effect of valence for best reply on the conformity of general reply in online environment. A total of 194 participants participated in this study, each participant assigned randomly in three experimental groups(positive, negative, and control). Participants were asked to read online news article, best reply and general 6 replies, and then, to write their own opinions in the reply section. In addition, the level of self-expression and issue commitment were measured. The contents of reply participants written was categorized three valence(positive, negative, and neutral) by the four experimenters' judgment. The mean of inter-rater reliability was 84.9%. The results indicated that the level of self-expression and issue commitment were comparable across experimental conditions. However, the result of cross-table analysis showed that there is a significant difference in the valence of general reply across experimental conditions. Specifically, there were significant difference in the valence of general reply between positive and negative experimental group and positive and control group, but there is no significant difference between negative and control group.

An Analysis of Laboratory Instructions in Elementary School Science (초등학교 과학 실험 수업 분석)

  • Yang, Il-Ho;Jeong, Jin-Woo;Hur, Myung;Kim, Young-Shin;Kim, Jin-Soo;Cho, Hyun-Jun;Oh, Chang-Ho
    • Journal of Korean Elementary Science Education
    • /
    • v.25 no.3
    • /
    • pp.281-295
    • /
    • 2006
  • The purpose of this study was to analyze laboratory instructions used in elementary school science lessons by utilizing an analysis instrument for science laboratory instruction(AISLI). This analysis instrument was comprised of 3 elements; the aim of the laboratory activity, the interaction generated, and the inquiry process. There were also a total of 20 sub-categories and its validity was identified at 0.89 by four science educators. For the purposes of this study, 90 laboratory instructions were video-recorded, then transcribed. Laboratory instructions were analyzed by three analyst teams, and the inter-rater reliability within teams was checked through Pearson correlation, with a score of 0.91. The results of this study were as follows: the two principle aims of laboratory activity, namely, to acquire declarative knowledge and to increase attitudes toward science, were observed to be in evidence in 98.9% and 92.2% in laboratory instructions, and the levels of categories of the interaction and inquiry processes were situated at level-1. The implications of these results are that laboratory instructions currently in use do not place sufficient demands upon students' scientific thinking and are not at all conducive to student-centered activities. Therefore in order to remedy this situation, the usefulness of current science laboratory instructions need to be re-evaluated.

  • PDF

Accuracy of Nurses' Assessments of Pressure Ulcers in Hospitalized Patients (간호사의 입원환자 욕창 사정에 대한 정확성)

  • Kwon, Eun Ok;Eom, In Hyang;Chang, Sun Ju;Shim, Mi Young;Lee, Su Hee
    • Journal of Korean Clinical Nursing Research
    • /
    • v.18 no.1
    • /
    • pp.29-38
    • /
    • 2012
  • Purpose: The purpose of this study was to examine the accuracy of general nurses' assessments of pressure ulcers in hospitalized patients. Methods: A total of 129 nursing records of assessments on pressure ulcers were analyzed. Assessment records of pressure ulcers by general nurses were compared to those by Wound, Ostomy, Continence Nurses (WOCN) on the same pressure ulcers. A WOCN of a nursing unit was a nurse certified by the hospital after completion of a formal WOCN course and passing a cyber education course, both offered by the hospital. The formal WOCN course was taught by an internationally certified WOCN. The inter-rater reliability among WOCNs was 98.2%. General nurses in this study did not receive a structured pressure ulcer education. Results: The accuracy for nursing assessment of pressure ulcers by general nurses compared to WOCNs' were evaluated in various ways and resulted in as follows; the existence of pressure ulcer 91.4%, site of pressure ulcer 85.3%, stage of pressure ulcer 85.3%, Braden scale 36.3%, size of pressure ulcer 51.9~64.3%, details of pressure ulcer 0~100%. Conclusion: The structured education about pressure ulcer assessment is important to enhance the accuracy of pressure ulcer assessment of hospitalized patients by general nurses.

Development of an Instrument to Measure Scientific Problem-Finding Ability for Scientifically-Gifted Student (과학 영재 학생들의 과학적 문제발견 능력을 측정하기 위한 도구 개발)

  • Ryu, Si-Gyeong;Park, Jong-Seok
    • Journal of The Korean Association For Science Education
    • /
    • v.28 no.2
    • /
    • pp.139-149
    • /
    • 2008
  • The purpose of this study is to develop a valid and reliable instrument for measuring scientific problem-finding ability for the scientifically-gifted student. On the basis of an operational definition of scientific problem-finding ability, this instrument consists of five sections(appropriateness, flexibility, originality, elaboration, and valuation) which are designed for measuring the ability of the scientifically-gifted. This instrument was checked the validity of content and evaluation criteria by the five experienced specialists in science education, and then was administered to 38 students of science high school. Because the validity of content and evaluation criteria, construct validity, inter-rater reliability, item difficulty, and item discrimination are suitable for the criteria of good test, this developed instrument in this study is considered valid and reliable.

Analysis of the Types of Laboratory Instruction in Elementary and Secondary Schools Science (초 . 중등학교 과학 실험수업의 유형 분석)

  • Yang, Il-Ho;Kim, Seog-Min;Cho, Hyun-Jun
    • Journal of The Korean Association For Science Education
    • /
    • v.27 no.3
    • /
    • pp.235-241
    • /
    • 2007
  • The purpose of this study was to identify the main laboratory instruction types with Classification Scheme of Laboratory Instruction (CSLI) in elementary and secondary schools science. For the purpose, the validity of the instrument CSLI was 4.23 and laboratory instructions were collected in 100 elementary schools and 30 secondary schools. Before analyzing the collected laboratory instructions, the inter-rater reliability about the analysis results was identified as 0.91. The results of this study were found that in elementary school, the main laboratory instruction types were verification type and discovery type and in secondary school were discovery type and verification type. In the category of the procedure, a large part of the procedures of laboratory activity in both elementary and secondary schools was given to students by worksheets or teachers themselves. In the category of approach, inductive approach was the main in elementary and deductive approach in secondary.

A Comparison of Change in Thickness for Lower Trapezius Muscle During Lower Trapezius Muscle Isometric Exercise and Reliability of Ultrasound Imaging (하승모근 등척성 운동방법에 따른 근두께 변화량 비교 및 초음파 영상의 신뢰도 연구)

  • Song, Woo-Ri;Kim, Suhn-Yeop;Jang, Hyun-Jeong
    • Physical Therapy Korea
    • /
    • v.19 no.3
    • /
    • pp.31-39
    • /
    • 2012
  • The lower trapezius muscle is an important stabilizer and primary mover of the scapula. The potential use of ultrasound imaging to evaluate scapular muscle function warrants investigation. The purpose of this study is to use ultrasound imaging for determining the effectiveness of 4 different isometric exercises for maximally activating the lower trapezius muscles in healthy subjects. Twenty-eight (14 men and 14 women) volunteers were recruited for this study. Thickness measurements of the lower trapezius muscles were recorded during 4 exercises: latissimus pulldown (LP), prone V-raise (PV), prone row (PR), and modified prone cobra (MP). Lower trapezius muscle thickness was measured 3 times by 2 investigators at a point 3 cm lateral to the lateral edge of the T8 spinous process. The order of 4 exercise execution was randomized for each participant. To identify statistical significance, one-way ANOVA with repeated measures was used with the significance level of .05. Intraclass correlation coefficient (ICC) for intra-reliability was .86~.98 and inter-rater reliability .83~.96 for the lower trapezius, respectively (p<.01). Thickness changes in the lower trapezius muscles between the relaxed and contracted states in men were as follows: LP ($7.37{\pm}2.68mm$, 182%), MP ($4.69{\pm}1.74mm$, 167%), PV ($4.52{\pm}1.47mm$, 149%), and PR ($3.84{\pm}1.72mm$, 133%). In women the values were as follows: LP ($4.64{\pm}1.24mm$, 163%), MP ($2.79{\pm}.81mm$, 131%), PV ($2.78{\pm}.85mm$, 129%), and PR ($2.21{\pm}1.26$ mm, 100%). Thickness of the lower trapezius muscles significantly differed between exercises in both the gender (p<.01). The LP was the most effective exercise for increasing the activation of the lower trapezius muscle in both the gender. We recommend performing the LP exercise for strengthening the lower trapezius muscles.

The Study of Reliability and Validity of Attention Deficit Disorder Evaluation Scale-School Version(ADDES-SV) (주의력결핍 과잉운동장애 아동 평가척도의 교사 평가판에 대한 신뢰도 및 타당도 연구)

  • Bae, Jin-Woo;Cheung, Seung-Douk;Lee, Jong-Bum;Park, Hyung-Bae;Kim, Jin-Seung;Song, Chang-Jin
    • Journal of Yeungnam Medical Science
    • /
    • v.14 no.2
    • /
    • pp.415-429
    • /
    • 1997
  • The purpose of this study was to examine the reliability and validity of attention deficit disorder evaluation scale-school version(ADDES-SV). Between October 1996 and November 1996, ADDES-SV was administered to 263 elementary school students in the second grade and between Jun 1996 and October 1996, 28 attention deficit hyperactivity disorder patients. In the reliability test, the test-retest reliability coefficient was significantly high and that of inattention was 0.88, that of impulsivity was 0.80, that of hyperactivity was 0.83 and total score was 0.83. In the reliability test by internal consistancy, the Cronbach $\alpha$ coefficient was significantly high and that of inattention was 0.98, that of impulsivity was 0.87, that of hyperactivity was 0.87(p<0.05). The half-sprit reliability coefficient by first-second half method showed high correlation and that of inattention was part 1: 0.96, part 2: 0.96 impulsivity was part 1: 0.95, part 2: 0.93, hyperactivity was part 1: 0.92, part 2: 0.94(p<0.05). Inter-rater reliability by pearson correlation coefficient was significantly high and that of inattention was 0.92, that of impulsivity was 0.87, that of hyperactivity was 0.89 and total score was 0.89. The concurrent validity between ADDES-SV and CAP scale was 0.85 in attention deficit hyperactivity disorder patient group and 0.79 in normal control group(p<0.05). In discriminant validity test between attention deficit hyperactivity disorder patient group and normal control group, the patient group showed higher score(p<0.05). The total discriminant capacity of the patient group in ADDES-SV was 94.6%. In this point of view, ADDES-SV scale showed high reliability and validity in applying to Korean subjects and was proved to be the useful screening test tool for attention deficit hyperactivity disorder research.

  • PDF