Browse > Article
http://dx.doi.org/10.14697/jkase.2017.37.2.0225

An Analysis of the Characteristics of the Processes of Pre-Service Chemistry Teachers in Making Written Test Items Using Think-Aloud Method  

Noh, Taehee (Seoul National University)
Kim, Hyeree (Seoul National University)
Han, JaeYoung (Chungbuk National University)
Kang, Hunsik (Seoul National University of Education)
Publication Information
Journal of The Korean Association For Science Education / v.37, no.2, 2017 , pp. 225-237 More about this Journal
Abstract
In this study, we investigated the characteristics of the individual processes of pre-service chemistry teachers in making written test items. For this, we analyzed the think-aloud processes of eight pre-service chemistry teachers while making six written test items about gas laws and their in-depth interview scripts. The characteristics of the processes were found to be divided into six categories; the lack of systemicity in planning stage for making written test items, the lack of awareness and consideration for the interrelationship between instruction and assessment, the diverse criteria in determining test item types, the difficulties in judging behavioral domains and difficulties of items in the table of specification, the limitation in using teacher's guides and misunderstanding of teacher's guides, and the limitation in point and/or content of review and differences depending on the time of review. These can provide some significant guidelines and implications in finding ways to improve pre-service chemistry teachers' ability to make written test items.
Keywords
processes of making written test item; think-aloud method; preservice chemistry teacher;
Citations & Related Records
Times Cited By KSCI : 11  (Citation Analysis)
연도 인용수 순위
1 Grossman, P., & Thompson, C. (2004). Curriculum materials: Scaffolds for new teacher learning? (A Research Report No. R-04-1). Seattle, WA: Center for the Study of Teaching and Policy.
2 Han, K.-A., & Noh, S.-G. (2003). An analysis on the utilization of teacher's guides for science in elementary school. Journal of Korean Elementary Science Education, 22(1), 51-64.
3 Hashweh, M. Z. (2005). Teacher pedagogical constructions: A reconfiguration of pedagogical content knowledge. Teachers and Teaching, 11(3), 273-292.   DOI
4 Jang, S.-M., & Kim, J.-Y. (2002). Analysis on the status of performance assessment in science based on the elementary teachers' concerns. Journal of Korean Elementary Science Education, 21(2), 227-240.
5 Jeong, E., & Choi, W. (2014). A survey on evaluation in science education at primary and secondary school in Korea. Journal of Science Education, 38(1), 168-181.   DOI
6 Jonassen, D. H. (1991), Evaluating constructivistic learning. Educational Technology, 31(9), 28-33.
7 Kang, H., & Kang, S. (2015). Analysis of elementary school teachers' self-diagnosis on their competency for assessment in science. Journal of Korean Elementary Science Education, 34(2), 153-163.   DOI
8 Noh, T., Yoon, J., & Kang, S. (2009). The investigation of elementary school teachers' perceptions toward constructivist science assessment and their relationship with related variables. Journal of Korean Elementary Science Education, 28(3), 352-360.
9 Park, C. (2003). The relationship between item types and student's achievement. Korean Journal of Educational Research, 41(4), 71-86.
10 Park, D. (2012). Educational evaluation: Understanding and application. Seoul: Kyoyookkwahaksa.
11 Park, H. (2016). A survey on the conditions of middle school science evaluation. Teacher Education Research, 55(3), 389-398.   DOI
12 Park, H. J., Jeong, D. H., & Choi, W. H. (2011). Science teachers' perceptions of science practices. Journal of the Korean Association for Science Education, 31(1), 61-77.
13 Park, K. (2008). A case study on instructional planning process of teachers. The Journal of Korean Teacher Education, 25(3), 379-405.   DOI
14 Park, S., & Oliver, J. S. (2008). Revisiting the conceptualization of pedagogical content knowledge (PCK): PCK as a conceptual tool to understand teachers as professionals. Research in Science Education, 38(3), 261-284.   DOI
15 Park, S., Kang, C., Kim, K., Lee, G., Lee, M., Shon, M., Lee, H. (2003). An Evaluative Study on the 7th Primary Curriculum(III) [제7차 초.중등학교 교육과정 평가연구(III)]. Seoul: Korea Institute for Curriculum and Evaluation (RRC 2003-2).
16 Sato, M., Coffey, J., & Moorthy, S. (2005). Two teachers making assessment for learning their own. Curriculum Journal, 16(2), 177-191.   DOI
17 Kim, K., Park, E., Song, M., Sang, K., Kim, S., Kim, H., Shin, J., Seo, J., Lee, C., Kim, J., Kim, K. & Choi, S. (2012). A study on management of standards-based assessment in secondary schools [중등학교의 성취평가제 운영 방안 연구]. Seoul: Korea Institute for Curriculum and Evaluation (CRE 2012-8).
18 Kim, H. J., & Yoo, J. (2012). An analysis on rater error in holistic scoring for performance assessments of middle school students' science investigation activities. Journal of the Korean Association for Research in Science Education, 32(1), 160-181.   DOI
19 Kim, H.-J., Kwack, D.-O., & Sung, M.-W. (2000). An investigation on science teachers' evaluation practices in the secondary schools. Journal of the Korean Association for Science Education, 20(1), 101-111.
20 Schellings, G. L. M., & Broekkamp, H. (2011). Signaling task awareness in think-aloud protocols from students selecting relevant information from text. Metacognition and Learning, 6(1), 65-82.   DOI
21 Kim, K.-M. & Kim, S.-W. (2002). A study on the weight of assessment domains in science education focused on the teacher's view points. Journal of the Korean Association for Science Education, 22(3), 540-549.
22 Kim, S. (2002). A study on the teacher's competence for classroom assessment. Journal of Educational Evaluation, 15(1), 51-171.
23 Kim, S.-W., & Hyun, M.-S. (2005). The study on the recognition of science teachers about the general matters of performance assessment and the appropriate performance assessment methods in middle school science curriculum. Journal of Research in Curriculum Instruction, 9(2),
24 Kim, Y., Park, J., Park, J., Lee, H., & Kim, Y. (2010). Science teachers' perceptions and needs for courses in science education subjects for science teacher preparation program in Korea. Journal of the Korean Association for Research in Science Education, 30(6), 785-798.
25 Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory. Thousand Oaks, CA: Sage.
26 Ko, M.-S., Kim, E.-A., Heo, J.-M., & Y. I.-H. (2013). Elementary school teachers' beliefs of inquiry and practice of science performance assessment. Journal of the Korean Society of Earth Science Education, 6(2), 124-135.
27 Kwon, J.-S., Kim, B. K., Choi, B.-S., Kim, H.-N., Paik, S.-H., Yang, I.-H., Kwon, Y.-J., Cha, H., Woo, J.-O., & Jeong, J.-W. (2012). Theories in science education [과학교육론]. Seoul: Kyoyookbook Publication Co.
28 Lee, I., Lee, B., Kim, S., Park, J., Jin, J., Kim, O., & Seo, S. (2004). Analyzing realities of teacher's student assessment and educational needs for their professional development [교사의 학생 평가 실태 조사 및 전문성 신장에 대한 요구분석]. Seoul: Korea Institute for Curriculum and Evaluation (RRE 2004-5-1).
29 Shin, J., Ryu, S., & Yang, I. (2016). Teachers' needs and utilization of science performance assessment in the elementary schools. KNUE Journal of Research in Science Education, 22(2), 18-29.
30 Song, S.-C., Lee, C.-H., & Shim, K.-C. (2014). A study on science teachers' perception about science teacher training curriculum. Teacher Education Research, 53(1), 15-27.   DOI
31 Wiggins, G., & McTighe, J. (2005). Understanding by design. (2nd ed.). Alexandria, Virginia: Association for Supervision and Curriculum Development.
32 Yang, I.-H., Na, J.-C., Lim, S.-M., Lim, J.-K., & Choi, H.-D. (2008). An analysis of elementary schools' science test items by Klopfer's taxonomy of educational objectives: Focusing on the first term of the 5th grade. Journal of Korean Elementary Science Education, 27(3), 221-232.
33 Bismack, A. S., Arias, A. M., Davis, E. A., & Palincsar, A. S. (2014). Connecting curriculum materials and teachers: Elementary science teachers' enactment of a reform-based curricular unit. Journal of Science Teacher Education, 25(4), 489-512.   DOI
34 Abell, S. K., & Siegel, M. A. (2011). Assessment literacy: What science teachers need to know and be able to do. In D. Corrigan, J. Dillon, & R. Gunstone (Eds.), The professional knowledge base of science teaching (pp. 205-221). London, UK: Springer.
35 Atjonen, P. (2014). Teachers' views of their assessment practice. The Curriculum Journal, 25(2), 238-259.   DOI
36 Baek, S.-G. (2000). Principles of performance assessment [수행평가의 원리]. Seoul: Kyoyookbook Publication Co.
37 Black, P., Harrison, C., Lee, C., Marshall, B., & Wiliam, D. (2004). Working inside the black box: Assessment for learning in the classroom. Phi Delta Kappan, 86(1), 8-21.   DOI
38 Brookhart, S. M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practice, 30(1), 3–12.   DOI
39 Cho, K.-W. (2004). A critical examination of secondary teacher education for secondary school teachers. Journal of Educational Studies, 35(1), 1-19.   DOI
40 Cho, H., & Ko, Y. (2008). Re-conceptualization of secondary science teacher's pedagogical content knowledge (PCK) and its application. Journal of the Korean Association for Research in Science Education, 28(6), 618-632.
41 Choi, H. S., & Kim, J. B. (2013). A study on performance level of pre-service physics teachers in constructing questions for classroom assessment - Focused on analysis of multiple choice question about physics conceptest for formative assessment. Journal of Science Education, 37(3), 458-475.   DOI
42 Falk, A. (2012). Teachers learning from professional development in elementary science: Reciprocal relations between formative assessment and pedagogical content knowledge. Science Education, 96(2), 265-290.   DOI
43 Choi, J.-I., & Paik, S.-H. (2016). An analysis of content validity of behavioral domain of descriptive tests and factors that affect content validity: Focus on the fifth and sixth grade science. Journal of the Korean Association for Science Education, 36(1), 87-101.   DOI
44 Choi, J.-Y. (2006). An qualitative case study of pre-service teacher's planning for the practical arts instruction in the elementary school. The Journal of Elementary Education, 19(1), 477-499.
45 Davis, E. A., Palincsar, A. S., Arias, A. M., Bismack, A. S., Marulis, L., & Iwashyna, S. (2014). Designing educative curriculum materials: A theoretically and empirically driven process. Harvard Educational Review, 84(1), 24-52.   DOI
46 Ferguson, L. E., Braten, I., & Stromso, H. I. (2012). Epistemic cognition when students read multiple documents containing conflicting scientific evidence: A think-aloud study. Learning and Instruction, 22(2), 103-120.   DOI
47 McMillan, J. H. (2014). Classroom assessment: Principles and practice for effective standards-based instruction (6th Ed.). Boston, MA: Pearson.
48 Lee, K. H., & Choi, M. Y. (2013). Critical examination of 2009 revised teacher's guide book by an aspect of pedagogical content knowledge. Journal of Learner-Centered Curriculum and Instruction, 13(6), 667-689.
49 Magnusson, S., Krajcik, J., & Borko, H. (1999). Nature, source, and development of pedagogical content knowledge for science teaching. In J. Gess-Newsome, & N. Lederman (Eds.), Examining pedagogical content knowledge. Dordrect, The Netherlands: Kluwer Academic Publishers.
50 Marzano, R. J. (2006). Classroom assessment and grading that work. Alexandria, VA: Association for Supervision and Curriculum Development.
51 McTighe, J., & Wiggins, G. (2004). Understanding by design: Professional development workbook. Alexandria, Virginia: Association for Supervision and Curriculum Development.
52 Min, H. J. (2012). Development of assessment expertise model through analyzing realities of science teacher's student assessment and teacher training. (Doctoral dissertation). Korea National University of Education, Cheongju.
53 Mulholland, J., & Wallace, J. (2005). Growing the tree of teacher knowledge: Ten years of learning to teach elementary science. Journal of Research in Science Teaching, 42(7), 767–790.   DOI
54 Nam, M., Park, S., Song, M., Kim, K., Kim, S., Cho, I., Lim, W., Lee, K., Oh, S., Kang, M. & Kang, J. (2006). A study on improvement of teacher's competence in student assessment(III) [교사의 학생평가 전문성 신장 연구(III)]. Seoul: Korea Institute for Curriculum and Evaluation (RRE 2006-5).
55 Noh, T., Lee, J., Kang, S., & Kang, H. (2015). Secondary school science teachers' actual and preferred types of assessment. Journal of the Korean Association for Science Education, 35(4), 725-733.   DOI