• Title/Summary/Keyword: computer-adaptive testing (CAT)

Search Result 14, Processing Time 0.026 seconds

Design and Implementation of Web-based Learning System by Applying Computer Adaptive Testing (CAT) (CAT 이론을 응용한 Web-based 교수학습 시스템 개발)

  • Park, Jin-Hui;Ha, Tae-Hyeon
    • Journal of Digital Convergence
    • /
    • v.4 no.1
    • /
    • pp.43-54
    • /
    • 2006
  • New technologies have turned theories of education engineering into practice and also made education more efficient. One of them is the theory of 'Computer Adaptive Testing(CAT)'. This study is aimed to design and develop a web-based teaming system by making up for the weak points in the existing computer adaptive testing(CAT). The characteristics of the system are as follows: Firstly, tests can be controlled to fit the teachers' purposes by putting in different levels of both questions and samples. Secondly, this system does not test the same number of questions as students with different levels of ability do on a paper test, but a test can be taken according to their level. Thus this system is able to correctly judge learners' ability in a short time.

  • PDF

A Comparative Study of Oswestry Back Pain Disability Questionnaire Versus Computer Adaptive Testing for Measuring Back Pain

  • Choi, Bong-Sam
    • Physical Therapy Korea
    • /
    • v.20 no.4
    • /
    • pp.22-31
    • /
    • 2013
  • The aim of the present study was to compare measurement precisions of the Oswestry Back Pain Disability Questionnaire (ODQ) and a computer adaptive testing (CAT) method. The ODQ has been regarded as one of the most reliable condition-specific measure for back pain for decades. Cross-sectional study was carried out with two independent convenient samples from two out-patient rehabilitation clinics for back pain ($n_1=42$) and non-back pain group ($n_2=42$). Participants were asked to fill out the ODQ and CAT of International Classification of Functioning, Disability and Health-Activity Measure (ICF-AM). A series of Rasch analyses were performed to calculate person ability measures. The CAT measures had greater relative precision in discriminating the groups than did the ODQ measure in comparisons of the relative precision. The CAT measure appears to be more effective than did the ODQ measure in terms of measurement precision. By administering test items calibrated in a way, CAT measures using item response theory may promise a means with measurement precision as well as efficiency.

Design and Implementation of Multimedia Supported SPRT System (멀티미디어가 지원되는 SPRT 시스템 설계 및 구현)

  • 범수균;오암석
    • Journal of Korea Multimedia Society
    • /
    • v.5 no.6
    • /
    • pp.638-645
    • /
    • 2002
  • One of the potential advantages of computer-based instruction is individualization of instruction. However, this goal has not been fully realized in practice, due largely to limitations of natural language understanding and to combinatorial explosion. It is nonetheless possible to develop CAT(Computer- based Adaptive Testing) Programs which can adapt to students, depending on their performance, by adjusting the length of computer-based tests. The number of questions can be significantly reduced for many individuals, while mastery and nonmastery decisions remain highly accurate. In this paper, We design and implement a Diagnosis System using SPRT(Sequential Probability Ratio Testing). This system supports multimedia object, client/server environment, indvidual feedback, multi-SPRT and maintain student model for individualization of instruction. besides, this system measures coefficient alpha of each problem.

  • PDF

A Status Quo Study of Using Computer Technology for Language Testing (언어평가에 대한 컴퓨터 기술의 활용방안)

  • 이영식
    • Korean Journal of English Language and Linguistics
    • /
    • v.3 no.4
    • /
    • pp.571-588
    • /
    • 2003
  • The purpose of this study is to investigate into the various ways that the computer technology is used for language testing. Three uses of computer technology are mentioned: 1) computer-adaptive language testing and computer-based language testing, 2) the scoring of performance-based language assessment, and 3) the development and use of psychometric tools for analyzing the scoring results. Although the various uses of computer technology could provide expanded possibilities for language testing development, the developers should be reminded that they are currently subject to indepth research which could support their validity. In this regard, the advantages and limitations of some uses of computer technology for language testing are discussed.

  • PDF

Design and Implementation of the Web-based Individual Computerized Adaptive Testing System (웹 기반 학습자 개별적응 평가시스템의 개발)

  • Lee, Dong-Chun;Kwon, Ki-Tae
    • The Journal of Korean Association of Computer Education
    • /
    • v.4 no.2
    • /
    • pp.21-29
    • /
    • 2001
  • The purpose of this study is to design and implementation of the Web-based Individual Computerized Adaptive Testing(CAT) system. The Web-based Individual CAT is a kind of test system to present a set of the problems divided into basic level, intermediate level and advanced level according to the saved results after doing a diagnostic test related to each unit. The diagnostic test is done to pull out the necessary items which learners have to study. The strong points of the web-based computerized adaptive testing system are to reduce the problems of distributed teachers and to have the effect of individual learning by using this system.

  • PDF

A CSP based Learner Tailoring Question Recommendation Process using Item Response Theory (문항반응이론을 이용한 CSP 기반의 학습자 중심 문제추천 프로세스)

  • Jeong, Hwa-Young
    • Journal of Internet Computing and Services
    • /
    • v.10 no.5
    • /
    • pp.145-152
    • /
    • 2009
  • Applications such as study guides and adaptive tutoring must rely on a fine grained student model to tailor their interaction with the user. They are useful for Computer Adaptive Testing (CAT), for example, where the test items can be administered in order to maximize the information. I study how to design learner tailoring question process for recommendation. And this process can be applied the CAT and I use the formal language such as CSP in each process development for efficient process design. I use the item difficulty of item response theory for question recommendation process and learner can choice the difficulty step for learning change to control the difficulty of question in next learning. Finally, this method displayed the structural difference to compare between existent and this process.

  • PDF

Introducing an Online Measurement System Using Item Response Theory and Computer Adaptive Testing Methods for Measuring the Physical Activity of Community-Dwelling Frail Older Adults

  • Choi, Bong-sam
    • Physical Therapy Korea
    • /
    • v.26 no.3
    • /
    • pp.106-114
    • /
    • 2019
  • Background: It is difficult to assess whether community-dwelling frail older adults may remain pre-frail status or improve into a robust state without being directly checked by health care professionals. The health information perceived by older adults is considered to be one of best sources of potential concerns in older adult population. An online measurement system combined with item response theory (IRT) and computer adaptive testing (CAT) methods is likely to become a realistic approach to remotely monitor physical activity status of frail older adults. Objects: This article suggests an approach to provide a precise and efficient means of measuring physical activity levels of community-dwelling frail older adults. Methods: Article reviews were reviewed and summarized. Results: In comparison to the classical test theory (CTT), the IRT method is empirically aimed to focus on the psychometric properties of individual test items in lieu of the test as a whole. These properties allow creating a large item pool that can capture the broad range of physical activity levels. The CAT method administers test items by an algorithm that select items matched to the physical activity levels of the older adults. Conclusion: An online measurement system combined with these two methods would allow adequate physical activity measurement that may be useful to remotely monitor the activity level of community-dwelling frail older adults.

Computer Adaptive Testing Method for Measuring Disability in Patients With Back Pain

  • Choi, Bongsam
    • Physical Therapy Korea
    • /
    • v.19 no.3
    • /
    • pp.124-131
    • /
    • 2012
  • Most conventional instruments measuring disability rely on total score by simply adding individual item responses, which is dependent on the items chosen to represent the underlying construct (test-dependent) and a test statistic, such as coefficient alpha for the estimate of reliability, varying from sample to sample (sample-dependent). By contrast, item response theory (IRT) method focuses on the psychometric properties of the test items instead of the instrument as a whole. By estimating probability that a respondent will select a particular rating for an item, item difficulty and person ability (or disability) can be placed on same linear continuum. These estimates are invariant regardless of the item used (test-free measurement) and the ability of sample applied (sample-free measurement). These advantages of IRT allow the creation of invariantly calibrated large item banks that precisely discriminate the disability levels of individuals. Computer adaptive testing (CAT) method often requiring a testing algorithm promise a means for administering items in a way that is both efficient and precise. This method permits selectively administering items that are closely matched to the ability level of individuals (measurement precision) and measuring the ability without the loss of precision provided by the full item bank (measurement efficiency). These measurement properties can reasonably be achieved using IRT and CAT method. This article aims to investigate comprehensive overview of the existing disability instrument for back pain and to inform physical therapists of an alternative innovative way overcoming the shortcomings of conventional disability instruments. An understanding of IRT and CAT method will equip physical therapist with skills in interpreting the measurement properties of disability instruments developed using the methods.

A Study on the Implementation of CAT System Based on Mobile Environment (모바일 환경에서의 컴퓨터 기반 적응적 검사(CAT) 시스템 구현에 대한 연구)

  • Kim, Myung-Gwan;Kwon, Hyung-Joon;Lee, Si-Hwa
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2005.05a
    • /
    • pp.985-988
    • /
    • 2005
  • CAT(Computerized Adaptive Testing)는 일반적인 지필 검사와는 다르게 짧은 시간에 최소한의 문항으로 수험자의 학습 성취도를 판단하는 방법이다. 기존에 제안된 PC기반 CAT 시스템을 활용하기 위해서는 시간과 장소의 제약이 존재했다. 최근에 모바일 기기의 수요가 증가하고 무선인터넷의 발전이 이루어지며 모바일 교육에 대한 활발한 연구가 진행되고 있는 추세에 맞추어 본 연구에서는 모바일 기기의 하나인 PDA를 기반으로 한 CAT 시스템을 구현하고 실행해 보았다. 그 결과, 언제 어디서나 효율적으로 수험자의 학습 성취도 측정이 가능하게 되었다.

  • PDF

A Study of SPRT and EXSPRT-R Appling Foreign Language Test (SPRT와 EXSPRT-R 검증법의 언어능력 시험적용에 대한 연구)

  • Kim, Myung-Gwan;Kim, Ji-Han
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2005.05a
    • /
    • pp.989-992
    • /
    • 2005
  • CAT(Computer Adaptive Testing : 컴퓨터 기반 적응적 검사)는 기존의 종이 시험지에서 이루어지던 시험과 달리 수험자에게 적절한 맞춤식 출제로 보다 정확한 수험자의 능력 판단 및 빠른 수험진행을 가능케 하였다. 기존의 CAT는 많은 인원과 문제가 있어야만 그 결과에 신뢰성이 있다고 알려져 있다. CAT의 대표적인 알고리즘인 SPRT와 EXSPRT-R을 이용하여 10명의 적은 인원으로 JLPT 4급 기출문제를 적용한 실험을 하였다. SPRT 에서는 인원수와, 문제 난이도를 무시한 결과로 인하여 만족 할만한 결과를 얻지 못하였으나, EXSPRT-R의 경우에는 적은 인원에서도 충분히 CAT를 이용할 수 있음을 발견할 수 있었다.

  • PDF