• Title/Summary/Keyword: 검사자간 신뢰도

Search Result 60, Processing Time 0.024 seconds

Development of an Instrument to Measure Scientific Problem-Finding Ability for Scientifically-Gifted Student (과학 영재 학생들의 과학적 문제발견 능력을 측정하기 위한 도구 개발)

  • Ryu, Si-Gyeong;Park, Jong-Seok
    • Journal of The Korean Association For Science Education
    • /
    • v.28 no.2
    • /
    • pp.139-149
    • /
    • 2008
  • The purpose of this study is to develop a valid and reliable instrument for measuring scientific problem-finding ability for the scientifically-gifted student. On the basis of an operational definition of scientific problem-finding ability, this instrument consists of five sections(appropriateness, flexibility, originality, elaboration, and valuation) which are designed for measuring the ability of the scientifically-gifted. This instrument was checked the validity of content and evaluation criteria by the five experienced specialists in science education, and then was administered to 38 students of science high school. Because the validity of content and evaluation criteria, construct validity, inter-rater reliability, item difficulty, and item discrimination are suitable for the criteria of good test, this developed instrument in this study is considered valid and reliable.

Evaluation of Nondestructive Evaluation Size Measurement for Integrity Assessment of Axial Outside Diameter Stress Corrosion Cracking in Steam Generator Tubes (증기발생기 전열관 외면 축균열 건전성 평가를 위한 비파괴검사 크기 측정 평가)

  • Joo, Kyung-Mun;Hong, Jun-Hee
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.35 no.1
    • /
    • pp.61-67
    • /
    • 2015
  • Recently, the initiation of outside diameter stress corrosion cracking (ODSCC) at the tube support plate region of domestic steam generators (SG) with Alloy600 HTMA tubes has been increasing. As a result, SGs with Alloy600 HTMA tubes must be replaced early or are scheduled to be replaced prior to their designed lifetime. ODSCC is one of the biggest threats to the integrity of SG tubes. Therefore, the accurate evaluation of tube integrity to determine ODSCC is needed. Eddy current testing (ECT) is conducted periodically, and its results could be input as parameters for evaluating the integrity of SG tubes. The reliability of an ECT inspection system depends on the performance of the inspection technique and abilty of the analyst. The detection probability and ECT sizing error of degradation are considered to be the performance indices of a nondestructive evaluation (NDE) system. This paper introduces an optimized evaluation method for ECT, as well as the sizing error, including the analyst performance. This study was based on the results of a round robin program in which 10 inspection analysts from 5 different companies participated. The analysis of ECT sizing results was performed using a linear regression model relating the true defect size data to the measured ECT size data.

The development and application of the descriptive evaluation questionnaire on the Clothing and Textiles section of the middle school Technology & Home Economics textbook (중학교 기술.가정 의생활영역의 서술형 평가문항 개발 및 적용)

  • Lee, Soo-Kyung;Lee, Hye-Ja
    • Journal of Korean Home Economics Education Association
    • /
    • v.23 no.3
    • /
    • pp.69-90
    • /
    • 2011
  • To develop the descriptive evaluation questionnaire with high validity and reliability on the Clothing and Textiles section of the middle school Technology & Hone Economics textbook, apply it to students and analyze its results. We made out a draft for descriptive evaluation questionnaire that was based upon the concrete establishment of the goal and the range of evaluation. We also made a rubric for scoring as well as sample answer-sheets. Finally, we completed a total of twenty three descriptive evaluation questions and we applied it to sixty five 2nd-grade students in two classes in a middle school. Descriptive evaluation questionnaire exhibited the relative high validity on each question. Moreover, three graders gave the same score on each question of descriptive evaluation, suggesting that descriptive evaluation questionnaire has the high inter-grader reliability and the strong correlation. But, low academic achievement was generally observed in the subjects. They had difficulty in describing their knowledge via their own language and drawing up accurate and detailed answers. They recognized the positive aspects of descriptive evaluation questionnaire, but they felt it uncomfortable due to study-burden and description itself. To overcome these limitations, it is required that students should experience various materials related to subject contents in classes as well as textbooks, concentrate themselves on finding solutions for problems, expand their scope, and practice describe them in advance. Therefore, the additional training for description evaluation questionnaire will be necessary for the more efficient and discriminative questionnaire. Also the questionnaire with high validity and reliability should be developed and the aggressive and voluntary participation of teachers will be needed.

  • PDF

Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE (한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가)

  • Kang, Jaewon;Park, Hae Yean;Kim, Jung-Ran;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.2
    • /
    • pp.109-128
    • /
    • 2021
  • Objective : The purpose of this study was to develop a Korean version of the Activities of Daily Living (ADL)-focused Occupation-Based Neurobehavioral Evaluation (A-ONE) through cross-cultural adaptation and examine its validity and reliability. Methods : This study translated the A-ONE into Korean and performed cross-cultural adaptation for the Korean population. After the development of the Korean version of the A-ONE, cross-cultural and concurrent validities were analyzed. Internal consistency, test-retest reliability, and inter-rater reliability were also evaluated. Results : We adapted three items to the Korean culture. The Korean version of the A-ONE showed high cross-cultural validity with a content validity index (I-CVI) >0.9. It correlated with the Functional Independence Measure (FIM) (r=0.52-0.77, p<0.001), except for communication. Cronbach's α was 0.58-0.93 for the functional independence scale (FI) and 0.42-0.93 for the neurobehavioral specific impairment subscale (NBSIS). Intraclass correlation coefficients (ICCs) indicated high test-retest and inter-rater reliability for FI (ICC=0.79-1.00 and 0.75-1.00, respectively) and NBSIS (ICC=0.74-1.00 and 0.72-1.00, respectively). Conclusion : The Korean version of the A-ONE is well adapted to the Korean culture and has good validity and reliability. It is recommended to evaluate ADL performance skills and neurobehavioral impairments simultaneously in Korea.

SCISSOR BITE CORRECTION IN PATIENTS WITH WILLAMS SYNDROME: A CASE REPORT (Williams Syndrome 환자에서의 scissor bite correction: 증례보고)

  • Ji, Eun-Hye;Choi, Hyung-Jun;Kim, Seong-Oh;Son, Heung-Kyu;Lee, Jae-Ho
    • The Journal of Korea Assosiation for Disability and Oral Health
    • /
    • v.7 no.1
    • /
    • pp.21-24
    • /
    • 2011
  • Williams syndrome(WS) is a congenital disorder caused by a deletion of the Elastin gene and other contiguous genes at chromosome 7. Patients with WS are at a high risk of dental caries, and they also have a higher frequency of dental malocclusion compared to normal children. Malocclusion occurs in 85% of individuals with WS, which results from combined causes, such as tongue thrust, hypotonia, and connective tissue abnormality. An 11 year-old girl with WS presented scissor bite on the lower right second premolar and the first molar, and she complained of difficulty in chewing. Active lingual arch was used instead of removable appliance, considering the patient's cooperation ability. Unilateral posterior scissor bite was corrected in 7 months. Although patients with WS are sociable and friendly, dental treatment can be a fearful experience for them. Efforts to build rapport with the patients with WS resulted in improved relationship between the doctor and patient, and desired outcome of dental treatment was achieved with patient's improved cooperation.

Intrarater and Interrater Reliability of the Lateral Scapular Slide Test in Patients with Chronic Shoulder Pain (만성 견부통 환자를 대상으로 한 측방 견갑골 활주 검사의 측정자내 및 측정자간 신뢰도)

  • Park, Young-Seok;Kim, Suhn-Yeop;Seo, Young-Joo;Kim, Taek-Yean
    • The Journal of Korean Academy of Orthopedic Manual Physical Therapy
    • /
    • v.15 no.1
    • /
    • pp.32-40
    • /
    • 2009
  • Purpose: The purposes of this study were to determine the intertester and intratester reliabilities of the Lateral Scapular Slide Test (LSST) method, and to examine if significant differences existed in scapular positions among the pain groups (right-shoulder pain group, left-shoulder, pain group and both-shoulders pain group). 27 female subjects (mean age = 51.6, mean height = 157.7 cm, mean weight = 57.5 kg) with shoulder pain were recruited for this study. Methods: The bilateral distances between the root of the scapular spine and T3/4 (RSS), and between the inferior scapular angle and T7/8 (IA), were recorded. Subjects were tested at three positions: the with arms with abducted at 0, 45 and 90 degrees in the coronal plane. The LSST measurements were performed by two testers, selected randomly. Results: The results were as follows: Intraclass correlation coefficients (ICCs) for the intertester reliability were excellent (ICC 0.78-0.94). And the ICCs for the intratester reliability were excellent (ICC 0.83-0.99). In the right-shoulder and both-shoulders pain groups, the right-side RSS and IA values of right side were significantly greater than of the left-side RSS values left side for the arms abducted at 0 degrees of right shoulder pain group and both shoulder pain group (p<.05). However, the side-to-side difference was less than 1.5 cm. Conclusion: Our results suggest that the LSST is highly reliable in identifying the abnormal scapular position of patients with shoulder problems. Future research should be continued to clarify the clinical usefulness of this method.

  • PDF

Is it Possible to predict the Characteristics of Calcific Deposition in Calcific Tendinitis of Shoulder Joint? (단순 방사선 검사를 이용하여 석회성 건염에서 발생하는 석회 침착물의 성상에 대한 예측이 가능한가?)

  • Kim, Sung-Jae;Lee, Hee Jae;Lee, Kwang-Hyun;Park, Dong-Hyeok;Lee, Bong Geun
    • The Journal of Korean Orthopaedic Ultrasound Society
    • /
    • v.7 no.2
    • /
    • pp.77-83
    • /
    • 2014
  • Purpose: The purpose of current study was to evaluate the validity of the existing radiological classifications as a diagnostic modality for predicting characteristics of calcific deposition in calcific tendinitis of the shoulder joint. For that purpose, we determined the inter-observer reliability for evaluating diagnostic precisions of the classification and also evaluated diagnostic accuracy of predicting the toothpaste type calcific deposition. Materials and Methods: We performed retrospective study with total 26 patients surgically treated with calcific tendinitis of the shoulder joint from March 2010 to October 2013. Two independent observers reviewed preoperative radiographs of shoulder joints, and classified the characteristics of calcific depositions according to the criteria of Gartner, DePalma and Patte. Cohen's kappa were calculated for each classifications to evaluate inter-observer reliability. Sensitivity, specificity, positive likelihood ratio, negative likelihood ratio and diagnostic odds ratio were determined for type of calcific depositions with Gartner type III, DePalma type I, and Patte type II for predicting toothpaste type calcific deposition. Results: The values of Cohen's kappa were the highest in the classification of Patte, 0.62, and the values for the classifications of DePalma and Gartner were 0.56 and 0.36, respectively. The sensitivities for predicting toothpaste type calcific deposition in Gartner Type III, DePalma type I and Patte type II were 83.3%, 91.7%, and 58.3%, respectively. Specificities were 85.7% 50.0% and 64%, positive likelihood ratios were 5.833, 1.833 and 1.633, negative likelihood ratios were 0.194, 0.167 and 0.648, and diagnostic odds ratios were 30.00, 11.00 and 2.52, respectively. Conclusion: There were no radiologic classifications of calcific tendinitis which has both high precision and accuracy. Further studies with other diagnostic modalities such as ultrasonography are needed for predicting characteristics of calcific deposition in calcific tendinitis of the shoulder joint.

  • PDF

Psychometric Evaluation of a Six Dimension Scale of Nursing Performance and Student Nurse Stress Index Using an Objective Structured Clinical Examination - Modules for Asthma and Type 1 Diabetes (객관구조화 임상시험을 활용한 간호수행능력의 Six Dimension Scale과 간호학생 스트레스 평가지수의 도구 평가-천식 및 1형 당뇨 모듈을 중심으로)

  • Park, Kyong-Ok;Ahn, Young-Mee;Kang, Na-Rae;Lee, Mi-Jin;Sohn, Min
    • Child Health Nursing Research
    • /
    • v.19 no.2
    • /
    • pp.85-93
    • /
    • 2013
  • Purpose: The study purposes were to describe the process of developing the Korean versions of the Six Dimension Scale of Nursing Performance (Six-D) and Student Nurse Stress Index (SNSI) and psychometric evaluation of the two measurements. Methods: This was a methodology study using a descriptive cross-sectional design with 51 nursing students in 4th year of university. Internal consistency reliability was assessed using Cronbach alphas. Construct validity was determined by exploring correlations among Six-D, SNSI, objective structured clinical examination (OSCE), self-efficacy and grade point average (GPA). Results: Internal consistency reliability of Six-D and SNSI was acceptable with Cronbach's ${\alpha}$ of .95 and .82. Correlation analysis to determine construct validity revealed that Six-D presented positive correlations with OSCE (r=.109~.272) and self-efficacy (r=.005~.161) and negative correlation with GPA (r=-.246~-.394), although all were not statistically significant. SNSI presented all negative correlations with OSCE (r= -.007~-.238), self-efficacy (r=-.246~-.394), and GPA (r=-.092~-.426) and were mostly statistically significant except OSCE. Conclusion: Six-D needs more evidence to confirm validity to predict observed clinical competency and theoretical relationships with self-efficacy and GPA. However, SNSI presented trends of expected relationships with relevant variables. Therefore, further research is recommended in testing validity of Six-D with other student populations.

A Study of Inter-observer Agreements of Spiral Chest Computed Tomography in Diagnosing Pulmonary Embolism (폐색전증에서 나선형 컴퓨터 전산화 단층촬영의 관찰자간의 일치도에 관한 연구)

  • Kim, Yang-Ki;Lee, Young Mok;Kim, Ki-up;Uh, Soo-taek;Kim, Yong Hoon;Park, Choon Sik;Hwang, Jung-Hwa;Kim, Dong Hun;Goo, Dong-Erk;Choi, Deuk-Lin
    • Tuberculosis and Respiratory Diseases
    • /
    • v.59 no.5
    • /
    • pp.473-479
    • /
    • 2005
  • Background : A pulmonary embolism often presents with nonspecific symptoms and signs. However, a delayed diagnosis can result in catastrophic outcome. The majority of preventable deaths associated with a pulmonary embolism can be ascribed to a missed diagnosis rather than to the failure of existing treatments. Therefore, accurate and rapid diagnostic methods are essential for the management of a pulmonary embolism. The recent generation of multidetector-row spiral CT scanners appears to outperform other imaging modalities in detecting a central and peripheral pulmonary embolism. However, there are some variations in the interpretations of the findings between observers. This study examined the inter-observer differences of the diagnoses in patients with a pulmonary embolism. Method : 64 patients who were diagnosed with a pulmonary embolism either clinically or with spiral chest CT from 2002 to 2004, were included. Two thoracic radiologists interpreted the multidetector-row spiral CT in terms of the diagnosis of a pulmonary embolism and the location of the thrombus independently. Among 64 patients, 14 patients were excluded because there was no evidence of a pulmonary embolism or there was different interpretation of the pulmonary embolism between radiologists. A clinical diagnosis was based on "Rules for predicting the probability of embolism". Results : The mean score of the patients according to the Wells method was $3.91{\pm}0.30$ (0-9). The accordance of the radiologists was 95% in the main, 85% in the lobar, 91.2% in the segmental, and 96% in the sub-segmental pulmonary arteries. After excluding the negative interpretation from both radiologists, their agreement was 76.2%(${\kappa}.$ 0.83) in the main, 57.6%(${\kappa}.$ 0.63) in the lobar, 51.5%(${\kappa}.$ 0.63) in the segmental, and 34.6%(${\kappa}.$ 0.49) in the sub-segmental pulmonary arteries. Conclusion : Chest CT has been recently applied to patients suspected of having a pulmonary embolism. It was found that spiral CT is a rapid test for diagnosing a thrombus, and there was reliable accordance between the observers from the area of the large pulmonary arteries. However, there was a lack of agreement between the observers in diagnosing thrombi located distal to the sub-segmental arteries.

EVALUATION OF THE THERAPEUTIC EFFECTS OF CARBAMAZEPINE IN AUTISTIC CHILDREN (자폐증 아동에 있어서 Carbamazepine의 치료효과 평가)

  • Hong, Kang-E;Choi, Jin-Sook;Shin, Min-Sup;Hwang, Yong-Seung;Ahn, Yun-Ok
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.2 no.1
    • /
    • pp.87-96
    • /
    • 1991
  • A double bhad, placebo controlled study was performed to evaluate the therapeutic effects of Carbamazepine in autistic children, 23 boys with the diagnosis of Pervasive Developmental Disorders according to the DSM-IIIR were selected for study subjects, from Child and Adolescent Psychiatric Outpatient Department of Seoul National University Children Hospital during Oct. $1989{\sim}Nov.$ 1991. Subjects with histories of medical disease or psychiatric diseases were excluded and all study subjects had drug free periods more than 2 Months. Study subjects were randomly assigned to Cabamazepine treatment group(N=12) and placebo group(N=11). After the baseline observation periods, the double blind drug treatment and observation were performed for 12 weeks. Several scales (Ritvo-Freedman Real Life atring Scale. Behavior Checklist) were employed to evaluate the effects of drug treatment during baseline observation periods and the drug treatment periods by two raters blind to the study. Interrater reliability of each scales were .4875~.6613, the socrodemographic variables and the rating scores during baseline observation periods were not significantly different between two groups. Reduction of total scores in Autsm Behavior Checklist scale, i.e.. improvement of global autistic symptoms were noted significantly in Carbamazepine treatment group. Improvement in significant social maturations according to Vineland Social Mataration scale were observed in both patient groups after drug treetment periods.

  • PDF