• Title/Summary/Keyword: item difficulty

Search Result 286, Processing Time 0.027 seconds

The effect of anchor extremity and question difficulty on anchoring effect (기준점의 극단성과 문항 난이도가 기준점 효과에 미치는 영향)

  • Lee, Myoungjin;Lee, Yoonhyoung;Kim, Kyungil
    • Korean Journal of Cognitive Science
    • /
    • v.33 no.1
    • /
    • pp.77-93
    • /
    • 2022
  • Previous studies have reported that a plausible reference point has a greater anchoring effect than an extreme reference point. It is also known that the anchoring effect decreases when the individual's level of knowledge related to a given item is high. However, there has been no study examining the interaction of the plausibility of the reference point and the difficulty of the given question. Therefore, in this study, the effect of the reference plausibility and the difficulty of the questions on the anchoring effect were examined. The relationship between the response confidence and the anchoring effect was also examined. To do so, easy and difficult questions, plausible and extreme reference points were selected through preliminary research. The experiment was conducted following the 'standard anchoring task procedure'. As results, the extremity of the reference point and the difficulty of the question affected the size of the anchoring effect respectively. The difficulty of the question also affected the confidence of the response. Specifically, when a plausible reference point was presented and when a difficult question was presented, the anchoring effects were increased. In addition, the lower the confidence in one's performances, the greater the influence of the reference point when an extreme reference point was presented. These results show that the plausibility of the given reference point and the difficulty of the item have different effects on the magnitude of the anchoring effect and the degree of confidence. The results of this study support the attitude change perspective regarding the anchoring effect, which suggests that the anchoring effect varies depending on the characteristics of the reference point and the individual's knowledge.

A Comparative Analysis of Demotivation in Secondary English Classes

  • Kim, Kyung-Ja
    • English Language & Literature Teaching
    • /
    • v.15 no.4
    • /
    • pp.75-94
    • /
    • 2009
  • This study was designed to assess demotivation factors and compare the factor between two secondary school student groups. It furthermore examined how the factors related to students' L2 proficiency. A 31-item questionnaire was completed by 407 junior (JH) and senior high school (SH) students. Five factors were extracted through the principal axis factoring: Teachers' competence and teaching styles, Dissatisfaction with English classes and grading system, Difficulty of learning English, Lack of motivation and interest in learning English, and Inadequate learning contents. Although both JH and SH students did not perceive their English teacher as a strong attribution of demotivation, Difficulty of learning English and Dissatisfaction with English classes and grading system were the two strongest demotivating factors. When compared the overall mean scores of each factor between JH and SH groups, significant differences were found in all factors except Factor 4, with SH students reporting stronger demotivation. JH students attributed their demotivation to Difficulty of learning English, while SH students attributed that to Dissatisfaction with English classes and grading system. Both groups tended to attribute their demotivation to external forces. The study also showed that several demotivation factors related negatively to L2 proficiency.

  • PDF

Computer Adaptive Testing Method for Measuring Disability in Patients With Back Pain

  • Choi, Bongsam
    • Physical Therapy Korea
    • /
    • v.19 no.3
    • /
    • pp.124-131
    • /
    • 2012
  • Most conventional instruments measuring disability rely on total score by simply adding individual item responses, which is dependent on the items chosen to represent the underlying construct (test-dependent) and a test statistic, such as coefficient alpha for the estimate of reliability, varying from sample to sample (sample-dependent). By contrast, item response theory (IRT) method focuses on the psychometric properties of the test items instead of the instrument as a whole. By estimating probability that a respondent will select a particular rating for an item, item difficulty and person ability (or disability) can be placed on same linear continuum. These estimates are invariant regardless of the item used (test-free measurement) and the ability of sample applied (sample-free measurement). These advantages of IRT allow the creation of invariantly calibrated large item banks that precisely discriminate the disability levels of individuals. Computer adaptive testing (CAT) method often requiring a testing algorithm promise a means for administering items in a way that is both efficient and precise. This method permits selectively administering items that are closely matched to the ability level of individuals (measurement precision) and measuring the ability without the loss of precision provided by the full item bank (measurement efficiency). These measurement properties can reasonably be achieved using IRT and CAT method. This article aims to investigate comprehensive overview of the existing disability instrument for back pain and to inform physical therapists of an alternative innovative way overcoming the shortcomings of conventional disability instruments. An understanding of IRT and CAT method will equip physical therapist with skills in interpreting the measurement properties of disability instruments developed using the methods.

A Study on Selection Method and Mediateness Degree of Difficulty of Examination Questions in Web-based Education System (웹기반 학습 시스템의 평가 문제에 대한 출제 방법 및 난이도 재조정에 대한 연구)

  • Kim Eun-Jung
    • The KIPS Transactions:PartD
    • /
    • v.12D no.3 s.99
    • /
    • pp.471-480
    • /
    • 2005
  • Most questions made for remote examinations on web-based education system use methods of making questions using fixed questions or randomly using item pools or automatically using degree of difficulty. Particularly, automatically selection methods using degree of difficulty is the kernel of a question that objectivity of the first degree of difficulty for questions and an effective questions selection using degree of difficulty and mediateness degree of difficulty based result of examination. This paper is use automatically selection methods for examination on web-based education system. Firstly, we present new question selection algorithms as regards degree of difficulty and distribution between all units. Secondly, we present new algorithms of mediateness degree of difficulty as regards education ability of students for adjust the degree of difficulty. We identified this algorithms is more effective as compared with previously algorithms on web-based education system.

Feeding Difficulty and its influencing factors of Elders with Dementia in Long-term Care Facilities (요양시설 치매노인의 식사행동장애와 관련요인)

  • Hong, Hyun-Hwa;Gu, Mee-Ock
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.2
    • /
    • pp.1240-1252
    • /
    • 2015
  • The purpose of this study was to investigate feeding difficulty and its influencing factors of elders with dementia in long-term care facilities. Participants were 158 elders with dementia residing in three nursing facilities. Data were collected from Aug. 18 to Sep. 12 in 2014. The feeding difficulty in dementia scale, Korean version-Activities of Daily Living and Mini-Mental State Exam-Korean version were used as instruments. Data were analyzed using descriptive statistics, t-test, ANOVA, Pearson correlation and stepwise multiple regression by SPSS 17.0. Mean feeding difficulty score was $0.62{\pm}0.43$(range of 0-2). The highest feeding difficulty item was "patient require close supervision while feeding". The variables influencing the feeding difficulty was ADL(${\beta}=.312$), cognitive function(${\beta}=-.172$) which explained about 20.0% of total variance. The results suggest the need of developing feeding difficulty coping strategy according to dietary behavior phase, In addition, the development and testing the educational program for caregivers to help feeding difficulty of the elders with dementia in long-term facility are recommended.

Design and Implementation of a Learner Testing System with Item Response Theory (문항 반응 이론에 의한 학습자 평가 시스템 설계 및 구현)

  • Song, Eun-Ha;Park, Bock-Ja;Ha, Tae-Ryoung;Jeong, Young-Sik
    • The Journal of Korean Association of Computer Education
    • /
    • v.6 no.2
    • /
    • pp.1-8
    • /
    • 2003
  • In existing the learner testing system, it has a weak point to determine differently the difficulty of each question which has been estimated by teacher's view and the subjective stand point. In this paper, we develops the learner testing system which supports the estimation of the individual ability of learner, provides the questions for suitable to the individual learner level, and able to estimate the question of individual that used by three parameters such as the difficulty parameter, discrimination parameter, and guessing parameter. Also, it is applied to three-parameters logistic model of IRT(Item Response Theory) for using CAT(Computer Adaptive Testing) technique.

  • PDF

Paper Title of Validation of the Professional Identity for Occupational Therapist (국내 작업치료사의 전문직 정체성에 대한 타당성 연구)

  • Mun, Young-Ju;Jang, Jong-Sik
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.22 no.2
    • /
    • pp.240-247
    • /
    • 2021
  • The purpose of this study was to identify the professional identity levels and characteristics of occupational therapists through Rasch analysis and to use this as the basis for further assessment and research on the same subject. An online survey was conducted, and the response of 88 people working as occupational therapists between May and June 2020 was analyzed. The collected data included the frequency, analyzed by SPSS 22.0 and technical statistics, Winsteps 3.8.0 target and item suitability, item difficulty, level scale, and separation reliability. According to the analysis, 17 (16.3%) of the subjects and 5 (20%) out of 25 items were unsuitable. Item difficulty was the highest in the category "I systematically read professional publications on occupational therapy", and the lowest level of difficulty in "I make my own decisions about what to do." The three-point scale was suitable for the equilibrium scale, and the separation reliability was between .86 and .95. Thus, identity levels and characteristics of occupational therapists, the suitability of items and subjects, and difficulty levels can be identified through Rasch analysis. In the future, research should be conducted on various sample groups, to develop identity measurement tools specifically for occupational therapists, and to present items appropriate to the characteristics of their work.

Qualitative and Quantitative Analysis of Paper-Pencil Test Items for Exploring its Appropriateness as a Selection Tool of the Gifted in Science (과학 영재 선발 도구로서 지필 검사의 적합성 탐색을 위한 질적 및 양적 문항 분석)

  • Lee, Ki-Young;Dong, Hyo-Kwan;Hong, Jun-Eui;Kim, Hyun-Kyung;Jo, Bong-Jae
    • Journal of The Korean Association For Science Education
    • /
    • v.28 no.1
    • /
    • pp.32-46
    • /
    • 2008
  • The purpose of this study was to analyse the qualitative and quantitative characteristics of paper-pencil tests for exploring its appropriateness as a selection tool of the gifted in science. For this purpose, we developed two (internal and external) item analysis frameworks, and applied these frameworks to analyse qualitative characteristics. Also, we analysed the relationship between two characteristics. The results of analysing qualitative characteristics revealed that the portion of items with acceleration context exceeding middle school curriculum level was relatively large, which caused low content validity. Furthermore, there was considerable deviation in content and context by subject matter and year, which caused test unstability. Items measuring knowledge domain was the most prevalent, and too much weight on data interpretation & analysis domain in inquiry process skills. In case of creativity test, the portion of items measuring convergent thinking was much larger than that of divergent or associative thinking. Most of these items were represented by using pictures and tables rather than using graphs. Item types of multiple-choice and short answers were superior to essay types. Discrimination index, on the whole, was appropriate (above 0.3), but item difficulty showed a vast deviation ($0.01{\sim}0.90$). Correlation coefficients among subject matters and test tools were very low, and test reliabilities were also low. Low item difficulty & high discrimination index item types were distinguishable. Items with acceleration context were more discriminating than enrichment context. Implications of developing quality paper-pencil test items in the selection of gifted students are discussed.

Rasch Analysis of FIM Physical Items in Patients With Stroke in Korea (뇌졸중 환자의 기능수준에 따른 FIM 신체적 기능 항목의 라쉬분석)

  • Park, So-Yeon;Won, Jong-Im;Lee, Mi-Young
    • Physical Therapy Korea
    • /
    • v.17 no.2
    • /
    • pp.51-59
    • /
    • 2010
  • The Functional Independence Measure (FIM) is widely used to determine the dependency of activity of daily living in rehabilitation patients. The purposes of this study were to evaluate the unidimentionality of the FIM physical items and to analyze the validity of cross-functional levels in stroke survivors in Korea. Thirteen physical items of FIM were rated according to an ordinal scale of a 7-level classification. Two hundred and seventy-nine patients participated in the study (age range 18~92 years and 57% male). Six items-eating, bladder control, bowel control, transfer to and from the bed/wheelchair, transfer to and from the toilet, and bathing-showed misfits with the Rasch model. The most difficult item was 'bathing', the easiest item was 'bowel control'. Although there were several differences within functional levels, the hierarchical order of item measures was rather similar. 'Bathing' was the most difficult in high level patients (above 60), however 'stairs' was most difficult in the middle level (41~60) group. In the low level group (below 40), 'toileting' was the most difficult. In conclusion, the present study has shown several differences of item difficulty among functional levels. This result will be useful in planning interventions, and developing rehabilitation programs for stroke survivors.

Rasch Analysis of the Korean Western Ontario McMaster (KWOMAC): In the Out-Patients Over 65 Years With Osteoarthritis of the Knee (한국판 Western Ontario MacMaster(WOMAC)의 Rasch분석)

  • Koh, Eun-Kyung;Yi, Chung-Hwi
    • Physical Therapy Korea
    • /
    • v.14 no.1
    • /
    • pp.82-89
    • /
    • 2007
  • The Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) is a valid and widely used instrument for the assessment of osteoarthritis patients. In this study, data was obtained from the out-patients with painful osteoarthritis of the knee. One hundred-three out-patients were interviewed by physical therapists. In an exploratory way, a Korean version of the KWOMAC was analyzed for unidimensionality, item separation, and item difficulty using the Winsteps programs. Ninety-five patients with osteoarthritis of the knee over 65 years were analyzed for Rash analysis. In the analysis several functional items poorly fit to the model. These items included "heavy domestic duties" and "standing". In the pain domain, one item ("at night while in bed") did not fit the model. In the stiffness domain one item ("after sitting, lying, or resting later in the day") did not fit the model. Although 4 items from the 3 domains (pain, stiffness, function domain) do not fit well, the KWOMAC domains were confirmed by Rasch analysis. Thus the KWOMAC needs to be further examined before it can be used to properly determine the health status of the elderly with OA.

  • PDF