Browse > Article
http://dx.doi.org/10.14697/jkase.2018.38.5.611

Verbal Behaviors and Interactions in Processes of Making Written Test Items Using Paired Think Aloud Problem Solving for Pre-Service Secondary Chemistry Teachers  

Kang, Hunsik (Seoul National University of Education)
Publication Information
Journal of The Korean Association For Science Education / v.38, no.5, 2018 , pp. 611-623 More about this Journal
Abstract
This study investigated verbal behaviors and interactions in the processes of making written test items using paired think aloud problem solving for pre-service secondary chemistry teachers. The processes of making written test items using paired think-aloud problem solving in four small groups consisting of two pre-service chemistry teachers were recorded and transcribed. The analysis of the results revealed that 'item making' for ten subcategories for solver's verbal behaviors were most frequently exhibited regardless of 'integration' among the components of pedagogical content knowledge (PCK). The solver's 'provide', 'modify', 'require agreement', 'ask', 'agree', and 'justify' were also frequently exhibited although fewer than 'item making'. Especially, the solver's 'ask' was more frequently used in 'non-integration', whereas 'justify' was more frequently used in 'integration'. In listener's verbal behaviors consisted of eight subcategories, 'point out', 'ask', and 'agree' were frequently exhibited regardless of 'integration'. Listener's 'ask' and 'agree' were exhibited more in 'non-integration', whereas 'point out' was exhibited more in 'integration'. Many verbal interactions were analyzed to be in 'symmetrical type' more than 'solver-dominant type' or 'listener-dominant type'. 'Symmetrical type' was also more frequently exhibited in 'integration', whereas 'solver-dominant type' was more frequently exhibited in 'non-integration'. There were little differences between 'integration' and 'non-integration' in 'listener-dominant type'. In 23 subcategories of 'symmetrical type', 'ask-provide' and 'point out-justify' were most frequently found. Especially, 'ask-provide' was more frequently found in 'non-integration', whereas 'point out-justify' was more frequently found in 'integration'. 'Point out-modify' was the most frequent in 4 subcategories of 'listener-dominant type', while 'item making-agree' in three subcategories of 'solver-dominant type' regardless of 'integration'. However, only a little of other subcategories of the three types were found.
Keywords
paired think-aloud problem solving; verbal behavior; verbal interaction; written test item; pedagogical content knowledge(PCK);
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Kim, H. J., & Yoo, J. (2012). An analysis on rater error in holistic scoring for performance assessments of middle school students' science investigation activities. Journal of the Korean Association for Research in Science Education, 32(1), 160-181.   DOI
2 Kim, K.-M. & Kim, S.-W. (2002). A study on the weight of assessment domains in science education focused on the teacher's view points. Journal of the Korean Association for Science Education, 22(3), 540-549.
3 Kim, K., Park, E., Song, M., Sang, K., Kim, S., Kim, H., Shin, J., Seo, J., Lee, C., Kim, J., Kim, K. & Choi, S. (2012). A study on management of standards-based assessment in secondary schools [중등학교의 성취평가제 운영 방안 연구]. Seoul: Korea Institute for Curriculum and Evaluation (CRE 2012-8).
4 Kim, S. (2002). A study on the teacher's competence for classroom assessment. Journal of Educational Evaluation, 15(1), 151-171.
5 Kim, S.-W., & Hyun, M.-S. (2005). The study on the recognition of science teachers about the general matters of performance assessment and the appropriate performance assessment methods in middle school science curriculum. Journal of Research in Curriculum Instruction, 9(2), 213-232.
6 Ko, M.-S., Kim, E.-A., Heo, J.-M., & Yang, I.-H. (2013). Elementary school teachers' beliefs of inquiry and practice of science performance assessment. Journal of the Korean Society of Earth Science Education, 6(2), 124-135.   DOI
7 Kwon, J.-S., Kim, B. K., Choi, B.-S., Kim, H.-N., Paik, S.-H., Yang, I.-H., Kwon, Y.-J., Cha, H., Woo, J.-O., & Jeong, J.-W. (2012). Theories in science education [과학교육론]. Seoul: Kyoyookbook Publication Co.
8 Lee, E., Yoon, J., & Kang, S. (2014). Exploring the effects of grouping by learning style of gifted-student in science on the verbal interaction. Journal of the Korean Chemical Society, 58(4), 406-417.   DOI
9 Atjonen, P. (2014). Teachers' views of their assessment practice. The Curriculum Journal, 25(2), 238-259.   DOI
10 Lee, I., Kim, B.-K., Lee, B., Park, J., Jin, J., Kim, O., Seo, S., Kim, S., Kang, S., Kwon, J., Kim, S.-W., Paik, S.-H., Shin, D.-H., Lee, H., Cho, H.-H., & Cha, H. (2004). An exploratory study of professional standards of Korean secondary school science teacher's assessment of students [과학과 교사의 학생 평가 전문성 신장 모형과 기준] (Research report RRE 2004-5-5). Seoul: Korea Institute of Curriculum & Evaluation.
11 McMillan, J. H. (2014). Classroom assessment: Principles and practice for effective standards-based instruction (6th Ed.). Boston, MA: Pearson.
12 Min, H. J. (2012). Development of assessment expertise model through analyzing realities of science teacher's student assessment and teacher training. (Doctoral dissertation). Korea National University of Education, Cheongju.
13 Noh, T., Park, J., & Kang, H. (2016). Interactions among PCK components of pre-service secondary chemistry teachers considered in processes of making written test items. Journal of the Korean Association for Research in Science Education, 36(5), 769-781.   DOI
14 Abell, S. K., & Siegel, M. A. (2011). Assessment literacy: What science teachers need to know and be able to do. In D. Corrigan, J. Dillon, & R. Gunstone (Eds.), The professional knowledge base of science teaching (pp. 205-221). London, UK: Springer.
15 Joo, Y., Kim, K., & Noh, T. (2014). A comparison of verbal interaction patterns in science cooperative learning based on grouping by middle school students' collectivism. Journal of the Korean Association for Research in Science Education, 34(3), 221-233.   DOI
16 Kang, H., & Kang, S. (2015). Analysis of elementary school teachers' self-diagnosis on their competency for assessment in science. Journal of Korean Elementary Science Education, 34(2), 153-163.   DOI
17 Kang, H., Park, J., & Han J. (2017). The Influence of paired think-aloud problem solving on interactions among PCK components considered in the processes of making written test items by pre-service chemistry teachers. Journal of the Korean Association for Research in Science Education, 37(3), 429-440.
18 Nam, M., Park, S., Song, M., Kim, K., Kim, S., Cho, I., Lim, W., Lee, K., Oh, S., Kang, M., & Kang, J. (2006). A study on teacher's professional competency in students assessment (III) [교사의 학생평가 전문성 신장 연구(III)] (Research report RRE 2006-5). Seoul: Korea Institute of Curriculum & Evaluation.
19 Noh, T., Kang, H., & Jeon, K. (2003). Verbal interaction in paired think-aloud problem solving: Comparison of the characteristics of small groups based on achievement. Journal of the Korean Chemical Society, 47(5), 519-529.   DOI
20 Noh, T., Lee, J., Kang, S., & Kang, H. (2015). Secondary school science teachers' actual and preferred types of assessment. Journal of the Korean Association for Science Education, 35(4), 725-733.   DOI
21 Park, S., & Chen, Y.-C. (2012). Mapping out the integration of the components of pedagogical content knowledge (PCK): Examples from high school biology classrooms. Journal of Research in Science Teaching, 49(7), 922-941.   DOI
22 Noh, T., Yoon, J., & Kang, S. (2009). The investigation of elementary school teachers' perceptions toward constructivist science assessment and their relationship with related variables. Journal of Korean Elementary Science Education, 28(3), 352-360.
23 Park, H. (2016). A survey on the conditions of middle school science evaluation. Teacher Education Research, 55(3), 389-398.   DOI
24 Park, H. J., Jeong, D. H., & Choi, W. H. (2011). Science teachers' perceptions of science practices. Journal of the Korean Association for Science Education, 31(1), 61-77.   DOI
25 Yang, I., Na, J., Lim, S., Lim, J., & Choi, H. (2008). An analysis of elementary schools' science test items by Klopfer' taxonomy of educational objectives: Focusing on the first term of the 5th grade Journal of Korean Elementary Science Education, 27(3), 221-232.
26 Park, S., & Oliver, J. S. (2008). Revisiting the conceptualization of pedagogical content knowledge (PCK): PCK as a conceptual tool to understand teachers as professionals. Research in Science Education, 38(3), 261-284.   DOI
27 Shin, J., Ryu, S., & Yang, I. (2016). Teachers' needs and utilization of science performance assessment in the elementary schools. KNUE Journal of Research in Science Education, 22(2), 18-29.
28 Siegel, M. A., & Wissehr, C. (2011). Preparing for the plunge: Preservice teachers' assessment literacy. Journal of Science Teacher Education, 22(4), 371-391.   DOI
29 Kim, H.-J., Kwack, D.-O., & Sung, M.-W. (2000). An investigation on science teachers' evaluation practices in the secondary schools. Journal of the Korean Association for Science Education, 20(1), 101-111.
30 Aydin, S., & Boz, Y. (2013). The nature of integration among PCK components: A case study of two experienced chemistry teachers. Chemistry Education Research and Practice, 14(4), 615-624.   DOI
31 Aydin, S., Demirdogen, B., Akin, F. N., & Uzuntiryaki-Kondakci, E. (2015). The nature and development of interaction among components of pedagogical content knowledge in practicum. Teaching and Teacher Education, 46, 37-50.   DOI
32 Black, P., Harrison, C., Lee, C., Marshall, B., & Wiliam, D. (2004). Working inside the black box: Assessment for learning in the classroom. Phi Delta Kappan, 86(1), 8-21.   DOI
33 Brookhart, S. M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practice, 30(1), 3-12.   DOI
34 Choi, H. S., & Kim, J. B. (2013). A study on performance level of pre-service physics teachers in constructing questions for classroom assessment - Focused on analysis of multiple choice question about physics conceptest for formative assessment. Journal of Science Education, 37(3), 458-475.   DOI
35 Choi, J.-I., & Paik, S.-H. (2016). An analysis of content validity of behavioral domain of descriptive tests and factors that affect content validity: Focus on the fifth and sixth grade science. Journal of the Korean Association for Science Education, 36(1), 87-101.   DOI
36 Falk, A. (2012). Teachers learning from professional development in elementary science: Reciprocal relations between formative assessment and pedagogical content knowledge. Science Education, 96(2), 265-290.   DOI
37 Jang, S.-M., & Kim, J.-Y. (2002). Analysis on the status of performance assessment in science based on the elementary teachers' concerns. Journal of Korean Elementary Science Education, 21(2), 227-240.