• Title/Summary/Keyword: item reliability

Search Result 987, Processing Time 0.028 seconds

A Development of the Test for Mathematical Creative Problem Solving Ability

  • Lee, Kang-Sup;Hwang, Dong jou;Seo, Jong-Jin
    • Research in Mathematical Education
    • /
    • v.7 no.3
    • /
    • pp.163-189
    • /
    • 2003
  • The purpose of this study is to develop a test, which can be used in creative problem solving ability in mathematics of the mathematically gifted and the regular students. This test tool is composed of three categories; fluency (number of responses), flexibility (number of different kinds of responses), and originality (degree of uniqueness of responses) which are the factors of the creativity. After applying to 462 middle school students, this test was analyzed into item analysis. As a results of item analysis, it turned out to be meaningful (reliability: 0.80, validity: item 1(1.05), item 2(1.10), item 3(0.85), item 4(0.90), item 5(1.08), item difficulty: item 1(-0.22), item 2(-0.41), item 3(0.23), item 4(0.40), item 5(-0.01), item discriminating power: item 1(0.73), item 2(0.73), item 3(0.67), item 4(0.51), item 5(0.56), over the level of a standard basis. This means that the test tool was useful in the test process of creative problem solving ability in mathematics

  • PDF

Scale Development of Job Stress for Home Care Nurses (가정전문간호사의 직무스트레스 측정 도구 개발)

  • Hong Jeong-Sook;Lee Ga-Eon
    • Journal of Korean Academy of Nursing
    • /
    • v.34 no.6
    • /
    • pp.1097-1107
    • /
    • 2004
  • Purpose: The purpose of this study was to develop a job stress scale for hospital-based home care nurses in Korea. The process was construction of the conceptual framework, development of the preliminary items, verification of the content validity, item analysis and test of the reliability. The preliminary items were based on literature review and in-depth interviews with home care nurses. As a result, eight categories and sixty items were selected. These were reviewed by seven specialists for content validity and finally fifty one items were chosen. Data was collected from 180 home care nurses who were engaged in 87 hospitals from August to September 2003. The result of item analysis one was excepted, The final item count was 50. Categories were as follows: overload work(8 items), lack of specialized knowledge and technique(5 items), ethical dilemma(4 items), role conflict(5 items), interpersonal relationships(6 items), visiting home environment(9 items), driving conditions(4 items) and lack of administrative support(9 items), The reliability of the scale by Cronbach's alpha was .948 and the domain's reliability ranged from .649 to .841. The result of this study could be used to measure the job stress of home care nurses. However, for further validity and reliability, repeated studies will be necessary.

OVERVIEW OF RELIABILITY AND RELIABILITY CASE STUDIES

  • Murthy, D.N.P.
    • Proceedings of the Korean Reliability Society Conference
    • /
    • 2004.04a
    • /
    • pp.3-11
    • /
    • 2004
  • Failure is the termination of the ability of an item to perform a required function.[IEC 50]. Equipment fails, if it is no longer able to carry out its intended function under the specified operational conditions for which it was designed.(omitted)

  • PDF

A Method for Developing Items to Assess Earth Science Creativity (지구과학 창의력 평가 문항 개발 방법에 관한 연구)

  • Lee, Hang-Ro
    • Journal of the Korean earth science society
    • /
    • v.24 no.3
    • /
    • pp.150-159
    • /
    • 2003
  • This study suggests methods of assessing scientific creativity and developing items, which can be achieved when both earth science knowledge and general creativity are applied at the same time. According to the results of this study, the cognitive ability gaps between creativity and scientific creativity were clearly defined by the terms' operational definition. Four factors in the Subcategory Of Scientific Creativity-fluency, flexibility, elaboration, and originality-were selected, and the possibility of developing items out of these factors was discovered. The operational definitions of the four factors were given and the criteria for assessment and scoring were set. The validity, reliability, discrimination, and difficulty, which were the conditions required for the assessment instruments, were verified through three field trials of inputting the assessment instruments for scientific creativity. The assessment instruments were composed of 8 items with 2items for each factor. The average item fitness index obtained was 0.99, Cronbach , the item inter-consistency was 0.79,the inter-rater reliability of each item was 0.78, the inter-rater reliability of each factor was 0.75, the item discrimination power was 0.19, and the item difficulty was 0.00. Because the results were within the permitted limit of the conditions required for assessment instruments, the assessment instruments developed for scientific creativity in this study can be said to be very favorable.

Item Analysis of the 'Basic course of Information Technology' - Vocational Education Section in the College Scholastic Ability Test- ('정보 기술 기초' 교과의 문항 분석 - 대학수학능력시험 직업탐구영역을 중심으로-)

  • Kim, Jong-Hye;Kim, Ji-Hyun;kim, Yong;Lee, Won-Gyu
    • The Journal of Korean Association of Computer Education
    • /
    • v.10 no.4
    • /
    • pp.39-49
    • /
    • 2007
  • The purpose of this study is to provide analysis resources to develop high standard questions by analyzing item characteristics and item usability of 'Basic course of Information Technology' in the College Scholastic Ability Test, For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty, item discrimination, item reliability, and distracters. As a result of analyzing tests in 2005 and 2006, questions were equally extracted from educational contents. However, the standard of questions were in need of revision. The development of high quality contents in Vocational Education Section was needed in order to meet to the College Scholastic Ability Test standards. Therefore, it is required to develop various difficulties and acceptable distinguishable questions.

  • PDF

Re-validation of the Revised Systems Thinking Measuring Instrument for Vietnamese High School Students and Comparison of Latent Means between Korean and Vietnamese High School Students (베트남 고등학생을 대상으로 한 개정 시스템 사고 검사 도구 재타당화 및 한국과 베트남 고등학생의 잠재 평균 비교)

  • Hyonyong Lee;Nguyen Thi Thuy;Byung-Yeol Park;Jaedon Jeon;Hyundong Lee
    • Journal of the Korean earth science society
    • /
    • v.45 no.2
    • /
    • pp.157-171
    • /
    • 2024
  • The purposes of this study were: (1) to revalidate the revised Systems Thinking Measuring Instrument (Re_STMI) reported by Lee et al. (2024) among Vietnamese high school students and (2) to investigate the differences in systems thinking abilities between Korean and Vietnamese high school students. To achieve this, data from 234 Vietnamese high school students who responded to translated Re_STMI consisting of 20 items and an Scale consisting of 20 items were used. Validity analysis was conducted through item response analysis (Item Reliability, Item Map, Infit and Outfit MNSQ, DIF between male and female) and exploratory factor analysis (principal axis factor analysis using Promax). Furthermore, structural equation modeling was employed with data from 475 Korean high school students to verify the latent mean analysis. The results were as follows: First, in the item response analysis of the 20 translated Re_STMI items in Vietnamese, the Item Reliability was .97, and the Infit MNSQ ranged from .67 to 1.38. The results from the Item Map and DIF analysis align with previous findings. In the exploratory factor analysis, all items were loaded onto intended sub-factors, with sub-factor reliabilities ranging from .662 to .833 and total reliability at .876. Confirmatory factor analysis for latent mean analysis between Korean and Vietnamese students yielded acceptable model fit indices (χ2/df: 2.830, CFI: .931, TLI: .918, SRMR: .043, RMSEA: .051). Lastly, the latent mean analysis between Korean and Vietnamese students revealed a small effect size in systems analysis, mental models, team learning, and shared vision factors, whereas a medium effect size was observed in personal mastery factors, with Vietnamese high school students showing significantly higher results in systems thinking. This study confirmed the reliability and validity of the Re_STMI items. Furthermore, international comparative studies on systems thinking using Re_STMI translated into Vietnamese, English, and other languages are warranted in the context of students' systems thinking analysis.

A Pilot Study of Evaluating the Reliability and Validity of Pattern Identification Tool for Insomnia and Analyzing Correlation with Psychological Tests (불면증 변증도구 신뢰도와 타당도 평가 및 심리검사와의 상관성에 대한 초기연구)

  • Jeong, Jin-Hyung;Lee, Ji-Yoon;Kim, Ju-Yeon;Kim, Si-Yeon;Kang, Wee-Chang;Lim, Jung Hwa;Kim, Bo Kyung;Jung, In Chul
    • Journal of Oriental Neuropsychiatry
    • /
    • v.31 no.1
    • /
    • pp.1-12
    • /
    • 2020
  • Objectives: The purpose of this study was to evaluate the reliability and validity of the instrument on pattern identification for insomnia (PIT-Insomnia) and verify the correlation between PIT-Insomnia and psychological tests. Methods: Two evaluators examined the pattern identification of the participants who met insomnia disorder diagnostic criteria of the Diagnostic and Statistical Manual of Mental Disorder, Fifth Edition (DSM-5) and took the Insomnia Severity Index (ISI) score over 15 once manually and twice using the PIT-Insomnia to measure the inter-rater and test-retest reliability. We also conducted the following surveys: the Pittsburgh Sleep Quality Index (PSQI), the Korean version of Beck's depression inventory (K-BDI), the Korean version of the State-Trait Anxiety Inventory (STAI-K), the Korean Symptom checklist-95 (KSCL-95), and the EuroQol-5 dimension (EQ-5D), to measure concurrent validity and correlation between the PTI-Insomnia and psychological tests. Results: 1. The test-retest reliability analysis of the pattern identification results showed moderate agreement, and test-retest reliability analysis of each pattern identification score showed agreements from poor to moderate. 2. The inter-rater reliability analysis of the pattern identification results via manual showed slight agreement, when analysis was performed with calibration, the inter-rater reliability analysis of the pattern identification results via manual showed fair agreement. 3. The concordance analysis between results via manual and the PIT-Insomnia showed poor agreement, when the analysis was performed with calibration, concordance analysis showed fair agreement. 4. The concordance analysis between the PIT-Insomnia and the PSQI showed positive linear correlation. 5. The concordance analysis between the PIT-Insomnia and the PSQI, K-BDI, STAI-K, KSCL-95, and EQ-5D showed that non-interaction between the heart and kidney have positive linear correlation with the K-BDI, anxiety item of KSCL-95, dual deficiency of the heart-spleen have positive linear correlation with somatization item of KSCL-95, paranoia item of KSCL-95, heart deficiency with timidity have positive linear correlation with stress vulnerability item of KSCL-95, parania item of KSCL-95, phlegm-fire harassing the heart have positive linear correlation with K-BDI, paranoia item of KSCL-95, depressed liver qi transforming into fire have positive linear correlation with the anxiety item of KSCL-95, parania item of KSCL-95, all pattern identification have negative linear correlation with EQ-5D. Conclusions: The PIT-Insomnia has moderate agreement of reliability and reflects the severity of insomnia since it has some concurrent validity with the PSQI. There are some correlations between the PTI-Insomnia with specific psychological tests, so we could suggest it can be used appropriately in the clinical situation.

A Study on the Reliability of the Occupational Job Stress Indices Questionnaire Applied to Koreans (Occupational Job Stress Index의 신뢰성(信賴性) 관(關)한 연구(硏究))

  • Lee, Young-Soo
    • Journal of Preventive Medicine and Public Health
    • /
    • v.13 no.1
    • /
    • pp.19-25
    • /
    • 1980
  • The Occupational Job Stress Indicies Questionnaire is a selfadministered instrument consisting of 48 questions which are designed to collect the perceived Job stress about individual. This questionnaire was translated into Korean and applied to the selected groups of 300 blue collar workers musical manufacture industy for the purpose of assessing the it's reliability from April 1. to July 30, 1980. The results obtained were as follows; 1. The range of reliability coefficients for all indices was. 45-.75 which was lower than .54-.87 of original. 2. The inter-item correlation matrix for all items comprising an index along with the intercorrelation of these items with the items comprising closely related indices. 3. The reliability of JOB SATISFACTION, INTRINSIC REWARDS and IMPORTANCE REWARDS revealed .14-.20 lower than that of original. On the point of view, some items should be adjusted in parallel with acutual situation of Korea through making a cultural comparative study and item factor analysis.

  • PDF

Comparison of Reliability and Validity of Three Korean Versions of the 20-Item Toronto Alexithymia Scale (TAS-20의 한국판 3종간의 신뢰도 및 타당도 비교)

  • Chung, Un-Sun;Rim, Hyo-Deog;Lee, Yang-Hyun;Kim, Sang-Heon
    • Korean Journal of Psychosomatic Medicine
    • /
    • v.11 no.1
    • /
    • pp.77-88
    • /
    • 2003
  • Objectives: The purpose of this study was to compare reliability and validity of three Korean versions of the 20-item Toronto Alexithymia scale and to confirm the most reliable and validated Korean translation of the 20-item Toronto Alexithymia Scale for both clinical and research purpose in Korea. The first one was a Korean version of the 20-Item Toronto Alexithymia Scale developed by Lee YH et al in 1996 which was designated as TAS-20K(1996) in this study. This scale had a problem with one item due to the cultural difference regarding the word 'analyzing' between western culture and Korean culture. The second one was the revised version of TAS-20K(1996) on that point by Lee YH et al in 1996 without validation which was designated as TAS-20K(2003) in this study. The third one was a 23-item Korean version developed by Sin HG and Won HT in 1997, which was somewhat different from the 20-item Toronto Alexithymia Scale(TAS-20) in the number of total item, the content of some items and the scoring method. This scale was designated as S-TAS here. Methods: 408 medical students were tested with one scale composed of all the different items randomly arranged from the three versions. We evaluated goodness-of-fit and Cronbach $\alpha$ coefficients of three scales for reliability. We used confirmatory factor analysis to compare validity. Results: TAS-20K(2003) showed that it had better internal consistency than TAS-20K(1996), which implied that the cultural difference should be considered in the Korean translation. Both TAS-20K(2003) and S-TAS replicated three-factor structures and had adequacy of fit, good internal consistency and acceptable validity. However, S-TAS had one item with poor item-factor correlation and didn't show high correlation between item 2 and factor 1 as before in 1997. Conclusion: Although S-TAS had added 3 items and changed the content of two items, it didn't show better reliability and validity than TAS-20K(2003). Therefore it is proposed to use TAS-20K (2003) as the Korean version of the 20-item Toronto Alexithymia Scale(TAS-20K) for international communication of results of Alexithymia research. It has good internal consistency and validity and maintains original items, the same construct and scoring method as the 20-item Toronto Alexithymia Scale.

  • PDF

A Study on the Reliability Improvement of Guided Missile (유도탄의 신뢰성 향상 방안 고찰)

  • Kim, Bohyeon;Hwang, Kyeonghwan;Hur, Jangwook
    • Journal of Applied Reliability
    • /
    • v.16 no.3
    • /
    • pp.208-215
    • /
    • 2016
  • Purpose: ASRP for the domestic development guided missiles requires not only for the reliability evaluation of the products in storage but also for the life cycle management of the products including development prototypes and initial production items. Methods: For this purpose, it should be performed to build a performance database before and after the accelerated aging test with shelf life items including development prototypes and initial production items, based on which the lifetime prediction should also be carried out. In addition, HILS must be applied for the acceptance test with the initial and follow-up production items, and also for ASRP for the long-term storage products in order to secure systematic quality assurance. Results: The results for the life cycle reliability Improving of domestic development of guided missiles are DB building of prescription Item performance, active application of HILS, Management associated with guided missiles life cycle and to Secure technology data about the introduction of foreign guided missiles. Conclusion: Furthermore, it is demanded that DTaQ, the managing agency of ASRP, actively take part in the process to maintain reliability engagement consistency over the life cycle of guided missiles.