• Title/Summary/Keyword: assessment item analysis

Search Result 352, Processing Time 0.027 seconds

Equating Two Health-related Quality of Life Instruments Applied to Cancer Survivors Who Underwent Palliative Care

  • Bongsam Choi;Heesu Kim;Sunhwi Bang;Byunggwan Kim;Jaekwang Shim
    • Physical Therapy Korea
    • /
    • v.30 no.1
    • /
    • pp.32-40
    • /
    • 2023
  • Background: Equating is a statistical procedure used to create a common measurement scale across two instruments. Item-level information should be taken into consideration so that scores can communicate interchangeably across the instruments. Objects: To investigate a common measurement scale across two health-related quality of life questionnaires (HRQOL) applied to various cancer survivors who underwent palliative care in healthcare institutions. Methods: A total of 139 cancer survivors who underwent palliative care were recruited from two rehabilitation hospitals and an oriental medicine hospital. Participants consisted of various cancer survivors who presented to the sites for palliative care. They were asked to fill out Korean versions of the World Health Organization Quality of Life (WHOQOL-BREF) and EuroQOL-5 dimension (EQ-5D) questionnaires following the palliative care. For the item level comparison, the Rasch rating scale model was used to investigate how participants regarded individual test items of two instruments in relation to item difficulty calibrations. Results: All items except the three items fit the Rasch model. One item (anxiety/depression) of the EQ-5D and two items (dependence on medical aids and negative feelings) of the WHOQOL-BREF are misfit. The WHOQOL-BREF targets the survivors well, while the EQ-5D is able to target the survivors with lower HRQOL levels with some ceiling effects. By inspecting the item difficulty calibrations of the two instruments, five items of the WHOQOL-BREF are selected as common items in relation to the EQ-5D. These five items are considered compatible with each other. Differential item functioning (DIF) analysis reveals that the healthcare item of the WHOQOL-BREF vs the self-care item of the EQ-5D exhibits significant DIF. Conclusion: Findings suggest that one paired item should be taken into consideration when equating the WHOQOL-BREF and the EQ-5D applied to cancer survivors who underwent palliative care.

Basic Design of ECU Hardware for the Functional Safety of In-Vehicle Network Communication (차량 내 네트워크 통신의 기능안전성을 위한 하드웨어 기본 설계)

  • Koag, Hyun Chul;Ahn, Hyun-Sik
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.66 no.9
    • /
    • pp.1373-1378
    • /
    • 2017
  • This paper presents a basic ECU(Electronic Control Unit) hardware development procedure for the functional safety of in-vehicle network systems. We consider complete hardware redundancy as a safety mechanism for in-vehicle communication network under the assumption of the wired network failure such as disconnection of a CAN bus. An ESC (Electronic Stability Control) system is selected as an item and the required ASIL(Automotive Safety Integrity Level) for this item is assigned by performing the HARA(Hazard Analysis and Risk Assessment). The basic hardware architecture of the ESC system is designed with a microcontroller, passive components, and communication transceivers. The required ASIL for ESC system is shown to be satisfied with the designed safety mechanism by calculation of hardware architecture metrics such as the SPFM(Single Point Fault Metric) and the LFM(Latent Fault Metric).

Development and Validation of the Cancer-Specific Posttraumatic Growth Inventory (암환자 특이형 외상후 성장 측정도구 개발 및 타당화)

  • Jung, Young-Mi;Park, Jin-Hee
    • Journal of Korean Academy of Nursing
    • /
    • v.47 no.3
    • /
    • pp.319-331
    • /
    • 2017
  • Purpose: The purpose of this study was to develop a scale to evaluate posttraumatic growth in patients with cancer and to examine the validity and reliability of the scale. Methods: A literature review, semi-structured patient interviews and an expert panel consultation produced a 27 preliminary item questionnaire. Participants were 150 cancer patients recruited to test the reliability and validity of the preliminary scale. Data were analyzed using item analysis, exploratory factor analysis, convergent validity and internal consistency. Results: Item reduction and exploratory factor analysis led to 23 items, grouped into five subscales which were labelled new possibilities (6 items), coping skills (5 items), preciousness of life (5 items), relating to others (4 items), and personal strength (3 items). Convergent validity was evaluated by total correlation with the Functional Assessment of Cancer Therapy-General (r=.45, p<.001). The final scale demonstrated satisfactory internal consistency (Cronbach's ${\alpha}$ =.94). Conclusion: Findings from this study indicate that the Cancer-Specific Posttraumatic Growth Inventory has validity and reliability and is considered to be appropriate for assessing posttraumatic growth in patients with cancer.

Cross-Sectional Item Response Analysis of Geocognition Assessment for the Development of Plate Tectonics Learning Progressions: Rasch Model (판구조론의 학습발달과정 개발을 위한 지구적 인지과정 평가의 횡단적 문항 반응 분석: Rasch 모델)

  • Maeng, Seungho;Lee, Kiyoung
    • Journal of The Korean Association For Science Education
    • /
    • v.35 no.1
    • /
    • pp.37-52
    • /
    • 2015
  • In this study, assessment items to examine geocognition on plate tectonics were developed and applied to middle and high school students and college students. Conceptual constructs on plate tectonics are Earth interior structure, specific geomorphology, and geologic phenomena at each plate boundary. Construct for geocognition included temporal reasoning, spatial reasoning, retrospective reasoning, and system thinking. Pictorial data in each item were all obtained from GeoMapApp. Students' responses to the items were analyzed and measured cross-sectionally by Rasch model, which distinguishes persons' ability levels based on their scores for all items and compared them with item difficulty. By Rasch model analysis, Wright maps for middle and high school students and college students were obtained and compared with each other. Differential Item Functioning analysis was also implemented to compare students' item responses across school grades. The results showed: 1) Geocognition on plate tectonics was an assessable construct for middle and high school students in current science curriculum, 2) The most distinguished geocognition factor was spatial reasoning based on cross sectional analysis across school grades, 3) Geocognition on plate tectonics could be developed towards more sophisticated level through scaffolding of relevant instruction and earth science content knowledge, and 4) Geocognition was not a general reasoning separated from a task content but a content-specific reasoning related to the content of an assessment item. We proposed several suggestions for learning progressions for plate tectonics and national curriculum development based on the results of the study.

Item Response Analysis of Energy as a Cross-Cutting Concept for Grades 3 to 9 (기초공통개념으로서 에너지에 대한 3~9학년 학생들의 문항 반응 분석)

  • Kim, Youngmin;Kang, Nam-Hwa;Kang, Hunsik;Maeng, Seungho;Lee, Jun-Ki
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.6
    • /
    • pp.815-833
    • /
    • 2016
  • This study investigated children's (grade 3 to 9) responses to assessment items on energy as a cross-cutting concept in order to get basic information for a learning progression. The assessment consisted of 8 ordered multiple-choice items at the contexts of electric circuit, mechanical energy of falling objects, phase change of matter, dissolution, biological phenomena of a lizard, food chain, radiative equilibrium between Sun and Earth, and the system of water cycling. Children's responses to each item were analyzed with using cross-tabulations in terms of grades and item option levels and Wright map and Differential item functioning based on Rasch modeled item response analysis. The results offered empirical evidence of children's development of understanding energy from relation between energy and its phenomena, types of energy, transfer and conversion of energy, towards conservation and equilibrium of energy for all of eight contexts. Children of each grade did not fully understand energy conservation. As grade goes up, their understandings of energy transfer and conversion were differentiated across the contexts and topics of energy. According to Rasch analysis, children had easier understanding of energy on dissolution and poorer understanding of energy on water cycling than that on other contexts. It was discussed and suggested that the results of this study help us organize science topics with regard to energy when developing new national science curriculum.

A Study on the Quantitative Evaluation Method of Small-Scale Environmental Impact Assessment

  • Dong-Myung CHO;Ju-Yeon LEE;Woo-Taeg KWON
    • Journal of Wellbeing Management and Applied Psychology
    • /
    • v.6 no.2
    • /
    • pp.39-46
    • /
    • 2023
  • Purpose: The small-scale environmental impact assessment system in Korea was introduced and implemented in August 2000, but it has a problem that it cannot guarantee implementation due to the large proportion of qualitative reduction measures for each evaluation item. Therefore, when preparing a small-scale environmental impact assessment, research was conducted on how to improve the existing simple listing-type reduction measures and qualitative evaluation standards to quantitative reduction measures and evaluation standards reflecting regional characteristics. Research design, data and methodology: The small-scale environmental impact assessment system in Korea was introduced and implemented in August 2000, but it has a problem that it cannot guarantee implementation due to the large proportion of qualitative reduction measures for each evaluation item. Therefore, when preparing a small-scale environmental impact assessment, research was conducted on how to improve the existing simple listing-type reduction measures and qualitative evaluation standards to quantitative reduction measures and evaluation standards reflecting regional characteristics. Results: As a result of the analysis of qualitative and quantitative factors, the arithmetic sum of the qualitative factors of the total six projects is 160, accounting for 80% of the total number of reduction measures, and the quantitative factors are 40, accounting for 20%. Among them, the number of qualitative reduction measures reached 97.4% for animal and plant items, and more than 90% for air quality, noise and vibration, and eco-friendly resource circulation items. Conclusions: Therefore, it is necessary to avoid establishing qualitative reduction measures and set quantitative measures as the basis, but to specify the specifications, size, and installation location related to the reduction measures, and to calculate the numerical reduction efficiency.

Comparative Analysis of the National Level Academic Achievement Assessment Items between Korea and Japan (한국과 일본의 국가수준 학업성취도 평가 문항 비교 분석)

  • Kim, Bumi;Cho, Hyungmi
    • Journal of the Korean School Mathematics Society
    • /
    • v.24 no.4
    • /
    • pp.407-428
    • /
    • 2021
  • This study compares and analyzes the mathematics assessment items of the middle school's national-level academic achievement tests in Korea and Japan, recently revised as a competency-focused curriculum. By comparing and analyzing the assessment items in each country, the analytic framework is integrated into content areas, contexts, and competencies. The characteristics of each country's assessment items developed for each content area were analyzed using the framework. We suggested some implications on developing and improving national-level academic assessment items.

Translation Study of Miller Assessment of Preschoolers (MAP) for Using in Korea (Miller Assessment for Preschoolers(MAP)의 국내 적용을 위한 번역 연구)

  • Hong, Eunkyoung;Kim, Kyeong-Mi
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.16 no.1
    • /
    • pp.35-44
    • /
    • 2018
  • Objective : This study aimed to perform a translation, backward translation, item modification, and test of content validity for Korean version of Miller Assessment for Preschoolers (MAP). Methods : Professors in department of occupational therapy, translators, or occupational therapists participated in the processes of translation, comparison and synthesis I, backward translation, comparison and synthesis II, test of understanding, and modify of items. Content Validity Indices (CVI) was calculated for data analysis by using Microsoft Office Excel. Results : Results of comparison between the original MAP and Korean MAP in professor panels were mean $3.66{\pm}0.40$, item-level CVI (I-CVI) 0.94, and overal scale CVI (S-CVI) 0.83. In agreement, result of comparison between of the original MAP and backward translated MAP (version English) was mean 3.14. The erroneous content was omission 13 times, the addition 3 times, the substitution 6 times, erroneous terms 11 times, and reordering 6 times. Average of understanding test in the therapist panels was $3.66{\pm}0.27$. The agreements were I-CVI 0.93 and S-CVI 0.58. Conclusion : Using assessment tools that developed in another country is important to do test of content validity and systematic translation process in Korea. For developing Korean version of MAP, validity and reliability studies need to be followed in near future.

The effects of scanning position on evaluation of cerebral atrophy level: assessed by item response theory

  • Mahsin, Md;Zhao, Yinshan
    • Communications for Statistical Applications and Methods
    • /
    • v.23 no.6
    • /
    • pp.531-541
    • /
    • 2016
  • Cerebral atrophy affects the brain and is a common feature of patients with mild cognitive impairment or Alzheimer's diseases. It is evaluated by the radiologist or reader based on patient's history, age and the space between the brain and the skull as indicated by magnetic resonance (MR) images. A total of 70 patients were scanned in the supine and prone positions before three radiologist assessed their atrophy level. This study examined the radiologist's assessment of the cerebral atrophy level using a graded response model of item response theory (IRT). A graded response model (GRM) is fitted to our data and then item-fit and person-fit statistics are evaluated to assess the fitted model. Our analysis found that the cerebral atrophy level is better discriminated by readers in the prone position because all item slopes were greater than 2 at this position, versus the supine position where all the slope parameters were less than 1. However, the thresholds are very similar for the first reader and are quite different for the second and third readers because the scanning position affects readers differently as the category threshold estimates vary considerably between the readers..

Development of Program Outcome Self-Assessment Tool in Korean Nursing Baccalaureate Education (간호학 프로그램 학습성과 간접측정 도구개발)

  • Kim, Hyun-Kyoung
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.21 no.2
    • /
    • pp.215-226
    • /
    • 2015
  • Purpose: This study aimed to develop a self-assessment tool to evaluate program outcomes of nursing students in Korean nursing undergraduate education. Methods: The instrument development process consisted of literature review, focus group interviews, and item validation. A total of 117 items were analyzed through content validity testing. Data was gathered from 302 nursing students in Korea and analyzed using SPSS 21.0. Results: To construct validity, principal component analysis and Varimax rotation were used, and 12 factors, with a cumulative explanatory variance of 69.16%, were determined from 79 items. For internal consistency and reliability, Cronbach's ${\alpha}$ was .91. The half-split reliability results were .84 and .85, and the ROC curve showed an optimal cutpoint at 227. A five-point Likert scale was used for scoring. Conclusion: This instrument was found to have fair validity and reliability as a self-assessment tool for nursing student learning outcomes. Therefore, it can be used to evaluate program outcomes indirectly in nursing schools.