• Title/Summary/Keyword: item difficulty

Search Result 288, Processing Time 0.024 seconds

Operating conditions and satisfaction in a clinical training program for 119 emergency medical technicians (119구급대원의 병원 임상수련 운영 실태 및 만족도)

  • Oh, Hyeon-Hwan;Choi, Eun-Sook
    • The Korean Journal of Emergency Medical Services
    • /
    • v.19 no.2
    • /
    • pp.99-115
    • /
    • 2015
  • Purpose: This study aimed to provide basic data for clinical training program development by analyzing the operating conditions and satisfaction in a clinical training program for 119 emergency medical technicians (EMTs) in South Korea. Methods: Data from 84 EMTs were collected on June 19, 2014. We administered a 64-item questionnaire about operating conditions and satisfaction in the clinical training program, and analyzed data (SPSS v 21.0). Results: The degree of performance in the field, importance of the item in the field, and level of difficulty were 3.36, 4.23, and 3.21, respectively. In the number of times that an item was directly performed according to the subjects' general characteristics a statistically difference in sex (p = .000), duty (p =.021), and total working time of trainees (p = .002). The subjects' total satisfaction score was 3.77. The difference in satisfaction according to the subjects' characteristics was a statistically significant in terms of sex (p = .016) and clinical training area (p = .005). Conclusion: A more efficient training system for hospital clinical training courses should be developed. The operation condition analyzed in this research may contribute to the improvement of the performance of EMTs.

The Development and Validation of a Musicality Rating Scale for Young Children (유아 음악성 평가척도 개발 및 타당화 연구)

  • Yun, Hyun Jeong;Shin, Nary
    • Korean Journal of Childcare and Education
    • /
    • v.15 no.3
    • /
    • pp.175-201
    • /
    • 2019
  • Objective: This study aims to develop and validate the musicality level of an individual child, based on the on performance tasks rubrics. Methods: The survey was conducted on 284 children(ages 3-5years old from kindergartens and day care centers), their parents, and their 51 teachers. The collected data were calculated and analyzed using SPSS 22.0 and AMOS 22.0. Results: Consisted of two components, two task types, 17 performance tasks, and 41 items in three dimensions. Rubrics were determined and based on the child's best performance, and categorized into five levels. Lastly, the item difficulty and item discriminating power were defined in order to comprehend the item quality analysis, which showed that average scores varied depending on the performance. Conclusion/Implications: The musicality rating scale for young children is significant in order to comprehend musicality levels through the performances of children aged three to five. This study has educational implications in that teachers can connect the results of the ratings to curriculum and promote the development of teaching and learning methodologies based on the musicality levels of individual children.

A Comparison of Item Characteristics and Test Information Between the K-MMSE~2:SV and K-MMSE

  • Jihyang Kim;Seungmin Jahng;SangYun Kim;Yeonwook Kang
    • Dementia and Neurocognitive Disorders
    • /
    • v.23 no.3
    • /
    • pp.117-126
    • /
    • 2024
  • Background and Purpose: The Korean-Mini Mental State Examination, 2nd edition (K-MMSE~2) was recently released. This study aimed to determine whether the K-MMSE~2: Standard Version (K-MMSE~2:SV) had the same test characteristics as the K-MMSE. Methods: A total of 1,514 healthy community-based participants aged 19 to 90 years were administered the K-MMSE~2:SV Blue Form along with the language items from the K-MMSE. The item and test characteristics and test information for the K-MMSE~2:SV and K-MMSE were compared using Item Response Theory analysis. Results: Item discriminations for the K-MMSE~2:SV and K-MMSE were above the moderate range for all items except Recall. Most of the items on the K-MMSE~2:SV and K-MMSE had item category difficulty in the very easy or easy range. The test information curve (TIC) showed that the K-MMSE~2:SV and K-MMSE provide almost the same amount of information (27.86 vs. 28.44), with both tests providing the most information at an ability level of -1.57. The generalizability (G) coefficient for the K-MMSE~2:SV and K-MMSE was 0.99. Conclusions: These results indicate that the K-MMSE~2:SV and K-MMSE are equally optimal tests for screening for mild cognitive impairment and early dementia. Given that the amount of test information provided by the two tests was almost identical, the shapes of the TICs were very similar, and the G coefficient was close to 1, we can conclude that the K-MMSE and K-MMSE~2:SV are equivalent tests.

Analysis of Korea Earth Science Olympiad Items for the Enhancement of Item Quality (한국 지구과학 올림피아드 문항 분석을 통한 문항의 질 향상 방안)

  • Lee Ki-Young;Kim Chan-Jong
    • Journal of the Korean earth science society
    • /
    • v.26 no.6
    • /
    • pp.511-523
    • /
    • 2005
  • The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

Examination Questions Selection Algorithm in Web-based Engineer Test Education System (웹 기반 기사시험 학습 시스템에서의 문제 출제 알고리즘)

  • Kim Eun-Jung
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.9 no.3
    • /
    • pp.11-18
    • /
    • 2004
  • It is making researches in questions selection method for examination in web-based education system. Most questions made for these remote examinations use methods of making questions using fixed questions or randomly using item pools or automatically using degree of difficulty. This paper proposes a new examination questions selection algorithm in web-based education system for engineer test. Generally, Engineer test is characterized by adequate examination questions selection for degree of difficulty and equally between all units. Therefore this algorithm selected examination questions equally well as regards degree of difficulty and distribution between all units. This algorithm providers more effective education examination method as compared with previous algorithm.

  • PDF

Analysis of Mathematical Problem Based on Mathematical Problem Solving Competency (수학적 문제해결역량을 위한 평가 문항의 조건과 그 실제)

  • Lee, Seon Yeong;Lee, Ji Soo;Han, Sunyoung
    • The Mathematical Education
    • /
    • v.57 no.2
    • /
    • pp.111-136
    • /
    • 2018
  • This study suggests a framework for analyzing items based on the characteristics, and shows the relationship among the characteristics, difficulty, percentage of correct answers, academic achievement and the actual mathematical problem solving competency. Three mathematics educators' classification of 30 items of Mathematics 'Ga' type, on 2017 College Scholastic Ability Test, and the responses given by 148 high school students on the survey examining mathematical problem solving competency were statistically analyzed. The results show that there are only few items satisfying the characteristics for mathematical problem solving competency, and students feel ill-defined and non-routine items difficult, but in actual percentage of correct answers, routineness alone has an effect. For the items satisfying the characteristics, low-achieving group has difficulty in understanding problem, and low and intermediate-achieving group have difficulty in mathematical modelling. The findings can suggest criteria for mathematics teachers to use when developing mathematics questions evaluating problem solving competency.

Analysis of Science Items of the Japanese National Center Test for University Admissions (일본 대학입시센터시험 이과 문항 분석)

  • Kim, Hyun-Kyung;Kim, Dong-Young;Choi, Hyuk-Joon;Ku, Ja-Ok;Dong, Hyo-Kwan;Shin, Il-Yong;Lee, Yang-Rak
    • Journal of The Korean Association For Science Education
    • /
    • v.30 no.4
    • /
    • pp.452-471
    • /
    • 2010
  • As the Korean College scholastic Ability Test (CSAT) has been implemented for 17 years since 1994, it is becoming more and more difficult to make new items that haven't been previously used to measure students' thinking ability. Therefore, it is necessary to keep conducting research on making new test items that can measure students' scholastic ability reliably. For this reason, multiple choice items on the Japanese university entrance exam, which is a Japanese National Center Test for University Admissions (NCTUA) equivalent of CSAT, were analyzed in order to draw implications for CSAT item development. In this study, we analyzed the Japanese NCTUA administered in January 2009 to investigate the structure of its science test. We also analyzed the NCTUA items by the domains of contents and behaviors, and tried to predict item difficulty from the perspective of Korean applicants. Major findings are as follows: Most NCTUA items measure understanding knowledge or low level thinking ability. Also the alloted time for each item is longer than CSAT. The number of test items, and the number of choice and alloted points for each item are diverse, unlike CSAT. The number of items using real-life materials are much more, but the items are not rigorous in sentence expression compared to CSAT. And the difference of difficulty level among science tests were larger with reference to CSAT. Also science score is required for most applicants regardless whether they are taking liberal arts or going onto the science track.

Domestic Occupational Therapist Awareness Survey for the Need to Apply Artificial Intelligence Measurement Technology for Clinical Observation Evaluation Based on Sensory Integration (감각통합에 기초한 임상 관찰 평가의 AI 측정 기술 적용 필요성을 위한 국내 작업치료사 인식 조사)

  • Cho, Sun-Young;Jung, Young-Jin;Kim, Jung-Ran
    • Therapeutic Science for Rehabilitation
    • /
    • v.12 no.1
    • /
    • pp.23-35
    • /
    • 2023
  • Objective : This study is to examine the practical use of clinical observational evaluation of sensory integration therapy and the difficulty and importance of measuring results for each sub-item, and through this, to confirm the usefulness of the application of Artificial Intelligence measurement technology in clinical observational measurement and the need for application. Methods : The questionnaire consisted of the actual use of the sensory integration evaluation tool, the difficulty of measurement for each detailed item of clinical observation, the usefulness of AI measurement technology, the importance of evaluation for each detailed item, and the need for developing AI measurement technology. Results : The detailed items that were difficult to measure during clinical observation were the Finger-to-Nose Test and Postural control (71.0%), followed by Eye movement and Protective Extension Test (67.7%). 83.9% of the study subjects answered that it would be useful to apply AI measurement technology when observing images. Postural control (on the ball) (90.3%) was the highest item that answered that AI measurement technology was needed, followed by Eye movement (83.9%), and Prone Extension and Protective Extension Test (77.4%). Conclusion : The results confirmed the desire of therapists that clinical observation is an important evaluation tool in the field of child occupational therapy in Korea.

Industrial Fatigue due to Banking Operations with VDT (은행원의 VDT작업에 따른 피로자각증상)

  • Koo, Jung-Wan;Lee, Seung-Han
    • Journal of Preventive Medicine and Public Health
    • /
    • v.24 no.3 s.35
    • /
    • pp.305-313
    • /
    • 1991
  • In order to investigate industrial fatigue due to visual display terminal (VDT) work of banking operations the questionnaire survey for subjective symptoms of fatigue was carried out on 470 bank clerks who had been engaged in VDT work for various length of work hours. The questionnaires comprised three groups of 10 items each, representing dullness and sleepiness (level of cerebral activation), difficulty in concentration (level of motivation) and bodily projection of fatigue. The results were as follows : 1. Of the 30 items of questionnaires, the highest percentage was accounted for by 'eye strain' (51.5% ), followed by 'feel stiffness in the neck or the shoulders'(33.4%), 'feel a pain in the low back'(26.8%), 'whole body feels tired'(19.6%) and 'feel headache'(17.9%) in the order of sequence. 2. The average weighted score for the first group of questionnaire items (dullness and sleepiness) was the largest among three groups and was followed by 'the third cup (bodily projection of fatigue) and the second item group (difficulty in concentration) in the order of sequence, suggesting the heavier mental stress of VDT work in banking operations rather than physical burden. 3. In terms of the age and sex of workers, work duration and VDT work percentage, the difference in average weighted score was noted only between sex, the score of female being larger than that of male. 4. The complaint rates of subjective symptoms showed close associations with the subjective optimums of room temperature, ventilation, illumination and noise level. 5. The significant correlation was showed between age, work duration and item of 'whole body feels tired', between VDT work percentage and items of 'eye strain' and 'feel stiffness in the neck or shoulders' and between all items of subjective symptoms.

  • PDF

A Study on Students' Thinking Processes in Solving Physics Problems (물리 문제 해결 과정에서의 학생들의 사고 과정에 관한 연구)

  • Park, Hac-Kyoo;Kwon, Jae-Sool
    • Journal of The Korean Association For Science Education
    • /
    • v.14 no.1
    • /
    • pp.85-102
    • /
    • 1994
  • The purpose of this study was to analyze students' physics problem solving processes and to find the patterns of their problem spaces when high school and university students solved the physics problems. A total of 51 students in a high school and in two universities participated in this study. Their thinking processes in solving 5 physics problems on electric circuit were recorded by using 'thinking aloud' method and were transferal into protocols. 'The protocols were analyzed by the coding system of problem solving process. One of the major theoretical contributions of the computer simulation approach to problem solving is the idea of problem space. Such a concept of problem space was applied to physics problems on electric circuit in this study, and students' protocols were analyzed by the basic problem spaces which were made up from the item analysis by the researcher. The results are as follows: 1) On the average 4.0 test items among 5 ones were solved successfully by all subjects, and all of the items were solved correctly by only 19 persons among all of them. 2) In regard to the general steps of problem solving process, there was little difference for each item between the good solvers and the poor ones. But according to the degree of difficulty of task there was a good deal of difference. For a complex problem all of 4 steps were used by most of students, but for a simple one only 3 steps except evaluating step were used by most of them. 3) It was found in this study that most of students used mainly the microscopic approach, that is, a method of applying Ohm's law on electric circuit simply and immediately, not using the properties of electric circuits. And also it was observed that most of students used the soloing tom below, that is, a solving path in which they were the first to calculate physical Quantities of circuit elements, before they caught hold of the meaning of the given problem regardless of the degree of difficulty.

  • PDF