Browse > Article
http://dx.doi.org/10.7469/JKSQM.2022.50.2.199

A Study on the Quality Improvement of College Scholastic Ability Test Scoring System  

Park, Youngsun (Division of Business Administration, Seokyeong University)
Publication Information
Journal of Korean Society for Quality Management / v.50, no.2, 2022 , pp. 199-220 More about this Journal
Abstract
Purpose: The purpose of this study is to analyze the score data released by the Korea Institute of Curriculum and Evaluation to find out the problems with the current scoring system provided by the College Scholastic Ability Test and to suggest improvement measures to solve these problems. Methods: We calculated the descriptive statistics of the standard scores using the frequency distribution table of the standard scores and identified the characteristics of the standard scores by expressing the distribution as a graph. Also, we developed an index to evaluate whether each stanine level was stably assigned and calculated the indexes for each area/subject by using the data on the number of examinees for each level. Results: We found that the relationship of conversion from raw scores to integerized standard scores is different depending on the size of the standard deviation of the raw scores, and identified the problem that the raw score information is not fairly reflected in the calculation of the percentile and level as the two raw scores are converted to one standard score. This problem can be solved by calculating the standard score to a decimal point. Conclusion: In this study, as a way to improve the quality of the scores of the current CSAT, the standard score and percentile decimal notation, the specific regulations of the standard score and stanine level calculation method, and the expansion of the open range of the scores were suggested.
Keywords
CSAT; Quality Improvement; Raw Score; Standard Score; Percentile; Stanine Level;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Jongro Academy. 2021. http://b.jongro.co.kr/exam/ex211118/go3_cut.asp.
2 KICE. 2014. The Absolute Evaluation Test System and Scoring System for the Korean History Section of the 2017 CSAT. KICE Position Paper 6(5):1-22.
3 KICE. 2015. The Absolute Evaluation Test System and Scoring System for the English Section of the 2018 CSAT. KICE Position Paper 7(4):1-18.
4 KICE. 2021. https://www.suneung.re.kr/boardCnts/view.do?boardID=1500230&boardSeq=5074372&lev=0&m=0302&searchType=S&statusYN=W&page=1&s=suneung.
5 Kim, S. H. 1998. The Scoring System of Optional Subtests of the College Scholastic Ability Test. Journal of Educational Evaluation 11(2):149-166.
6 Kim, S. -Y., Koo, C. -H, Im, H., and Park, C. 1998. A Study on Reporting and Analyzing Scores of CSAT. KICE.
7 KLD. 2022. https://www.ikld.kr/news/articleView.html?idxno=254832.
8 Megastudy. 2021. https://www.megastudy.net/Entinfo/total_rankCut/main.asp.
9 Nam, B. -W. 2002. 2005 Case Study for An Equating the Normalized Score in the National Entrance Examination. 2002 Proceedings of the Korean Operations and Management Science Society Conference 85-89.
10 Nam, H. -W. 2003. Applicability of Synthetic Group Methods to the Elective Subject Test Scores Linking in 2005 CSAT Inquiry Sections. Journal of Educational Evaluation 16(1):163-182.
11 Nam, H. -W. 2004. Applicability of Modified Chained Equipercentile Linking Method to CSAT Elective Subject Tests. Journal of Educational Evaluation 17(2):93-105.
12 Park, H. J., Kang, P., Jang, K. Y., Lee, Y., and Kim, W. J. 2015. Prediction of Correct Answer Rate and Identification of Significant Factors for CSAT English Test Based on Data Mining Techniques. KIPS Transactions on Software and Data Engineering 4(11):509-520.   DOI
13 Seo, H., Byun, J. -H., and Kim, D. 2021. Quality 4.0: Concept, Elements, Level Evaluation and Deployment Direction. Journal of Korean Society for Quality Management 49(4):447-466.   DOI
14 Seong, Y., Lee, D., and Jang, U. 2022. Group-wise Keyword Extraction of the External Audit using Text Mining and Association Rules. Journal of Korean Society for Quality Management 50(1):77-89.   DOI
15 Yi, J. H. 2020. Two Different Views Towards University Entrance Examination: Selection or Evaluation of Educational Attainment? Journal of Korean Social Trend and Perspective 108:46-79.
16 KOSTAT. 2021. https://kostat.go.kr/portal/korea/kor_nw/1/1/index.board?bmode=read&aSeq=391575.
17 KICE. 2019. CSAT Score Calculation Method According to the Introduction of Common + Elective Subjects. KICE Position Paper 11(5):1-20.
18 Ban, J. -C. 2008. Issues in Reported Standard Score and Stanine Score of Collage Scholastic Ability Test in Korea. Journal of Educational Evaluation 21(1):127-147.
19 Hwang, H. 2005. A Study on an Alternative to the Standardized Scoring Systems in CSAT. The Korean Journal of Applied Statistics 18(5):521-532.   DOI
20 KICE. 2004. A 20-Year History of College Scholastic Ability Test. Korea Institute for Curriculum and Evaluation.
21 Kim, S. -Y. 1999. A Empirical Investigation on the Contribution of the Subscores of CSAT to the Total Test Scores. The Journal of Curriculum Studies 2(1):289-299.
22 Nam, B. -W. 2011. A Linear Programming Model to the Score Adjustment among the CSAT Optional Subjects. Korean Management Science Review 28(1):141-158.
23 Park, C. 2005. Assessing Item Response Theory Methods for Moderation of Elective Subject Test Scores in 2005 Korean CSAT Inquiry Sections. Korean Journal of Educational Research 43(2):135-154.
24 Park, S. H., Kim, C. W., and Park, J. O. 2000. A Study on a Standardized Scoring System of Selected Subjects for College Entrance Examination. Journal of Korean Society for Quality Management 28(3):124-132.
25 Jin, K. A., Song, M. Y., and Ban, J. C. 2010. Research on the Assessment System for Math and English Ability-Grouping Classes. The Journal of Curriculum & Evaluation 13(2):335-358.   DOI
26 Yang, J. H. 2012. Examining the Perceptions of Students, Parents, and Teachers about New 2014 College Scholastic Ability Test. Journal of Educational Evaluation 25(2):167-191.
27 Park, S. H. and Kim, C. W. 1998. A Study on Standardization of Selected Subjects for College Entrance Examination. The 12th Asia Quality Management Symposium: Total Quality Management for Restoring Competitiveness 113-122.
28 Chang, S. 2021. Philosophical Justification and Direction of Essay Evaluation in College Scholastic Ability Test. Writing Research 51:117-151.
29 Cho, J. and Pyun, J. 2022. A Study on the Implementation Plan for Public Service Quality Management Applying the ISO 18091 Framework. Journal of Korean Society for Quality Management 50(1):1-19.   DOI