Browse > Article
http://dx.doi.org/10.14697/jkase.2020.40.3.253

A Study on Developing and Validating the Modern Physics Conceptual Diagnostic Survey for Pre-Service Physics Teachers based on the 2015 Revised National Science Curriculum  

Kim, Wanseon (Research Institute of Basic Sciences, Incheon National University)
Kim, Sung-Won (Ewha Womans University)
Publication Information
Journal of The Korean Association For Science Education / v.40, no.3, 2020 , pp. 253-269 More about this Journal
Abstract
This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.
Keywords
modern physics conceptual diagnostic survey; pre-service physics teachers;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Aslanides, J. S., & Savage, C. M. (2013). Relativity concept inventory: development, analysis, and results. Physical Review Special Topics-Physics Education Research, 9(1), 010118-1-010118-10.   DOI
2 Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human science. New York, NY: Springer.
3 Cataloglu, E., & Robinett, R. W. (2002). Testing the development of student conceptual and visualization understanding in quantum mechanics through the undergraduate career. American Journal of Physics, 70(3), 238-251.   DOI
4 Chung, K. (2006). Web application in university physics education -focused on modern physics subjects-. Physics and High Technology, 15(12), 48-52.
5 Ding, L., Chabay, R., Sherwood, B., & Beichner, R. (2006). Evaluating an electricity and magnetism assessment tool: brief electricity and magnetism assessment. Physical Review Special Topics-Physics Education Research, 2(1), 010105-1-010105-7.   DOI
6 Ding, L., & Beichner, R. (2009). Approaches to data analysis of multiple-choice questions. Physical Review Special Topics-Physics Education Research, 5(2), 020103-1-020103-17.   DOI
7 Falk, J. (2004). Developing a quantum mechanics concept inventory (Master's thesis). Uppsala University, Sweden.
8 Ha, M., Park, H., Kim, Y., Kang, N., Oh, P., Kim, M., Min, J., Lee, Y., Han, H., Kim, M., Ko, S., Son, M. (2018). Developing and applying the questionnaire to measure science core competencies based on the 2015 revised national science curriculum. Journal of the Korean Association for Science Education, 38(4), 495-504.   DOI
9 Hewitt, P. G. (2009). Conceptual physics. Upper Saddle River, NJ: Pearson.
10 Jho, H., Ji, Y., Choi, W., & Song, J. (2016). Analysis of undergraduate students' understanding of the relativity of simultaneity. New Physics: Sae Mulli, 66(5), 571-579.   DOI
11 Kim, C. (2006). Modern physics lecture as liberal arts. Physics and High Technology, 15(11), 25-28.
12 Kim, S. (2012). Education for relativity in the new national curriculum. Physics and High Technology, 21(3), 5-7.   DOI
13 Ko, Y., Lee, H., & Kim, S. (2015). Gender differences of physics major college students' conceptual understanding and its degree of certainty in the subject of quantum mechanics, New Physics: Sae Mulli, 65(8), 812-824.   DOI
14 Korea Institute for Curriculum and Education (2008). A study on the developing of physics teachers' qualification criteria, detailing the evaluation areas, and evaluating of instructional ability-for 2009 secondary teachers' candidate selection test. Research report CRE 2008-6-4.
15 McKagan, S. B., Perkins, K. K., & Wieman, C. E. (2010). Design and validation of the quantum mechanics conceptual survey. Physical Review Special Topics-Physics Education Research, 6(2), 020121-1-020121-17.   DOI
16 Messick, S. (1995). Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice, 14(4), 5-8.   DOI
17 Im, S., & Kim, J. (2014). Comparison of pre-service physics teachers' conceptual understanding of classical and quantum mechanics. New Physics: Sae Mulli, 64(1), 56-65.   DOI
18 Ministry of Education (2015). 2015 revised national science curriculum. Sejong: Ministry of Education
19 Ministry of Education & Human Resources Development (2007). 2009 revised national science curriculum. Seoul: Ministry of Education & Human Resources Development
20 Ministry of Education & Human Resources Development (2006). Ways to improve the teacher training system to enhance school education. Seoul: Ministry of Education & Human Resources Development
21 Park, J. & Kim, Y. (2018). New general introduction of physics education. Seoul: Bookshill.
22 Seol, H. (2007). Validation on developing a university lecture evaluation tool through the application of Rasch measurement model from the perspective of Messick's validity. Journal of Educational Evaluation, 20(4), 31-51.
23 Seong, T. (2014). Theory and practice of item production and analysis. Seoul: Hakjisa.
24 Seong, T. (2016). Understanding and Application of the Item Response Theory (2nd ed.). Paju: Kyoyookbook.
25 Song, J., Kim, I., Kim, Y., Kwon, S. Oh, W., & Park, J. (2004). Student' physics misconception map. Seoul: Bookshill.
26 Wuttiprom, S., Sharma, M. D., Johnston, I. D., Chitaree, R., & Soankwan, C. (2009). Development and use of a conceptual survey in introductory Quantum Physics. International Journal of Science Education, 31(5), 631-654.   DOI
27 Im, S., & Kim, J. (2012). An investigation on university students' conceptual understanding of introductory quantum physics. New Physics: Sae Mulli, 62(2), 135-141.   DOI