Browse > Article
http://dx.doi.org/10.14697/jkase.2019.39.2.263

Analysing the Use of Test Tools in Science-Related Affective Domain and its Improvements  

Chung, Sue-Im (Eungye Middle School)
Shin, Donghee (Ewha Womans University)
Publication Information
Journal of The Korean Association For Science Education / v.39, no.2, 2019 , pp. 263-277 More about this Journal
Abstract
This study analyzed the current use of science-related test tools in affective area in Korean academic journals for the last 30 years since 1989 and the cases of modification of the original tools related to the tools. This provides practical information on the development and improvement of test tools in the future and offers the basis for developing valid test tools. The study was conducted in two stages. We analyzed the status of 88 domestic science education researches dealing with testing tools related affective characteristics and 57 domestic and foreign resource tools referenced by them. After that, we compared the characteristics of the five cases in which the original tool was revised and the concrete item correction examples. The results were analyzed as follows: topics that have emerged continuously or that have recently begun to appear in domestic research, the research situations according to their purpose and measurement methods used by the tool, and use state of original tools. The background and key points of revision were analyzed for the five tools, TOSRA, SAI, PISA items, STEBI-A/B, SMQ, whose revision process were disclosed. In addition, the changes of the items were analyzed by comparing the four test items with the questions before and after the revision. As a result of item analysis, item improvement was proceeding in the direction of enhancing readability, clarifying meaning, and changing items according to change of sub constructs. The implications of this study are as follows: notes on interpreting the results obtained from the tool with multiple mixed constructs, the possibility of the testing tool that broadens the horizon of the research, error recognition in the subjective self-report, and notes when applying test tools from other disciplines to science.
Keywords
Science-related affective characteristics; test tool revision; item improvement; research trend; science education assessment;
Citations & Related Records
Times Cited By KSCI : 16  (Citation Analysis)
연도 인용수 순위
1 Jeong, E., & Kim, Y. (1993). Development of an instrument to assess middle school students' attitude toward environmental pollution. Journal of the Korean Association for Science Education, 13(2), 271-281.
2 Jo, S. (2011). A study on the use of gifted behavior rating scale in teacher's recommendation for the gifted education. The Journal of the Korean Society for the Gifted and Talented, 10(2), 5-30.   DOI
3 Jo, S., & Ku, J. (2013). An exploration in the measurement and application of attitude towards science based on social constructivism. Journal of the Korean Association for Science Education, 33(2), 466-477.   DOI
4 Jurges, H., Schneider, K., & Buchel, F. (2005). The effect of central exit examinations on student achievement: quasi-experimental evidence from TIMSS Germany. Journal of the European Economic Association, 3(5), 1134-1155.   DOI
5 Keller, J. (1984). The use of the ARCS model of motivation in teacher training. In K. E. Shaw(Ed.), Aspects of educational technology XVII. Staff development and career updating. New York: Nichols.
6 Kim, S., Byeon, J., Lee, I., & Kwon, Y. (2012). An eye tracking study on test-item solving of science scholastic achievement focused in elementary school students. Journal of Learner-Centered Curriculum and Instruction, 12(1), 65-78.
7 Kim, Y., Park, Y., Park, H., Shin, D., Jung, J., & Song, S. (2014). World of science education. Seoul: Book's hill.
8 Kim, N., & Ryu, C. (2010). Development and application of tool for measuring high school students' scientific experience. Journal of the Korean Earth Science Society, 31(3), 276-287.   DOI
9 Kim, S., & Seo, H. (2011). Self-regulated learning ability related to science inquiry skill and affective domain of science in middle school students. Journal of Science Education, 35(2), 307-323.   DOI
10 Ko, M., Kim, E., Heo, J., & Yang, I. (2013). Elementary school teachers' beliefs of inquiry and practice of science performance assessment. The Korean Society of Earth Science Education, 6(2), 124-135.
11 Koballa, T. R. (1988). Attitude and related concepts in science education. Science Education, 72(2), 115-126.   DOI
12 Krynowsky, B. (1988). Problems in assessing student attitude in science education: A partial solution. Science Education, 72(4), 575-584.   DOI
13 Ku, J., Kim, S., Lee, H., Cho, S., & Park, H. (2016). OECD programme for international students assessment: An analysis of PISA 2015 Results. Seoul: Korea Institute for Curriculum and Evaluation.
14 Kwak, H., & Shin, Y. (2014). The effects of formative assessment using mobile applications on interest and self-directedness in science instruction. Journal of the Korean Association for Science Education, 34(3), 285-294.   DOI
15 Kwak, Y. (2017). Exploration of features of Korean eighth grade students' attitudes toward science. Journal of the Korean Association for Science Education, 37(1), 135-142.   DOI
16 Laughton, W. H., & Wilkinson, W. J. (1968). Pupils' attitudes to science teaching. Education in Science, 26, 31-33.   DOI
17 Park, E., Lee, S., Rachmatullah, A., & Ha, M. (2017). Validating the translated version of CARS(Changes in Attitude About the Relevance of Science), exploring variables related to CARS Scores, and constructing two equivalent test sets of CARS. Journal of Science Education, 41(2), 179-194.   DOI
18 Park, S. (1997). Development and validation of the Korean science teaching efficacy beliefs instrument (K-STEBI) for prospective elementary school teachers. Journal of the Korean Association for Science Education, 16(2), 205-224.
19 Yu, I., & Yoon, I. (2001). Teacher's attitude and practical application of performance assessment in the home economics education, Korean Home Economics Education Association, 13(1), 93-106.
20 Park, H., & Paik, S. (2001). The effects of lessons adopting portfolio assessment regarding feedback on elementary school student's scientific knowledge, inquiry ability, and their perception, Journal of the Korean Association for Science Education, 21(1), 22-29.
21 Pekrun, R., Goetz, T., Frenzel, A., Barchfeld, P., & Perry, R. (2011). Measuring emotions in students' learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36-48.   DOI
22 Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students' self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91-106.   DOI
23 Pintrich, P. R., & DeGroot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33-40.   DOI
24 Reach, G., Zerrouki, A., Leclercq, D., & d'Ivernois, J. F. (2005). Adjusting insulin doses: From knowledge to decision. Patient Education and Counseling, 56(1), 98-103.   DOI
25 Riggs, I., & Enochs, L. (1990). Toward the development of an elementary teacher's science teaching efficacy belief instrument. Science Education, 74(6), 625-637.   DOI
26 Lee, C. (2017). The development of a concise science achievement emotions questionnaire for secondary school students(Master's thesis). Kongju University, Kongju, Korea.
27 Lee, J., & Kim, B. (1998). Development of the psychological learning environment instrument generated by science teachers in the science instruction. Journal of the Korean Association for Science Education, 18(3), 313-325.
28 Lee, H., Choi, K., & Nam, J. (2000). The effects of formative assessment with detailed feedback on students science achievement, attitude, and interaction between teacher and Students. Journal of the Korean Association for Science Education, 20(3), 479-490.
29 Lee, M., & Hann, A. (2001). Effect of portfolio assessment in elementary science teaching. Journal of Korean Elementary Science Education, 20(1), 107-122.
30 Lee, S., & Hur, M. (1998). The development of middle school students' attitude evaluation instrument in laboratory work. Journal of Research in Curriculum & Instruction. 2(2), 194-213.
31 Lee, S., & Kim, Y. (2013). A study of the development of the Korean youth moral test: standardization of the test and categorization of moral type. Journal of ethics education studies, 31, 237-259.
32 Lee, K., & Woo, J. (1996). A study of valid measurement in science related attitudes(II): To develop an affective component of attitudes toward science scale. Journal of the Korean Association for Science Education, 16(2), 190-199.
33 Liu, X. (2012). Developing measurement instruments for science education research. In B. J. Fraser, G. T. Kenneth, & C. J. McRobbi(Eds), Second International Handbook of Science Education, Dadrecht; New York: Springer.
34 Markle, G. C. (1978). Assessing the validity and reliability of the subject preference inventory with preservice elementary teacher. Journal of Research in Science Teaching, 15, 519-522.   DOI
35 Ministry of Culture and Education. (1981). Middle school education curriculum. Notification No. 1981-442 of MOCE. Seoul: MOCE.
36 Merrell, K., & Gueldner, B. (2010). Social and emotional learning in the classroom: promoting mental health and academic success. New York: Guilford publishing.
37 Meyer, G. R. (1969). A test of interest. Milton, Queensland: Jacaranda Press.
38 Midgley, C., Maehr, M., & Urdan, T. (1993). Patterns of adaptive learning survey. Ann Arbor, MI: University of Michigan Press.
39 Ministry of Culture and Education. (1987). Middle school education curriculum. Notification No. 87-9 of MOCE. Seoul: MOCE.
40 Ministry of Education. (1992). Middle school curriculum. Notification No. 1992-11 of MOE. Seoul: MOE.
41 Ministry of Education. (1997). Middle school curriculum reference book. Notification No. 1997-15 of MOE. Seoul: MOE.
42 Ministry of Education and Human Resources Development. (2007). Middle school curriculum. Notification No. 2007-79 of MOEHRD. Seoul: MOEHRD.
43 Ministry of Education Science, and Technology. (2011). Science curriculum. Notification No. 2011-361 of MOEST. Seoul: MOEST.
44 Ministry of Education. (2015). Science curriculum. Notification No. 2015-74 of MOE. Seoul: MOE.
45 Moore, R., & Sutman, F. (1970). The development, field test and validation of an inventory of scientific attitudes. Journal of Research in science Teaching, 7, 85-94.   DOI
46 Moore, R., & Foy, R. (1997). The scientific attitude inventory: A revision(SAI II). Journal of Research in Science Teaching, 34(4), 327-336.   DOI
47 Shen, C., & Pedulla, J. (2000). The relationship between students' achievement and their self-perception of competence and rigour of mathematics and science: A cross-national analysis. Assessment in Education, 7(2), 237-253.   DOI
48 School Council Project for Evaluation of Science Teaching Methods(1973). A modified version of the science pupil opinion poll. University of Leicester.
49 Schunk, D. (1991). Self-efficacy and academic motivation. Journal Educational Psychologist, 26(3-4), 207-231.   DOI
50 Seo, J., Choi, J., & Kim, Y. (2007). Comparison of life learning skills of gifted science students and normal students in high school. Biology Education, 35(1), 61-72.   DOI
51 Shin, S., Ha, M., & Lee, J. (2016). The development and validation of instrument for measuring high school students' STEM career motivation. Journal of the Korean Association for Science Education, 36(1), 75-86.   DOI
52 Shin, Y., Kang, H., Kwak, Y., Kim, H., Lee, S., & Lee, S. H. (2017a). A comparative analysis of the test tools in science-related affective domains. Biology Education, 45(1), 41-54.   DOI
53 Shin, Y., Kwak, Y., Kim, H., Lee, S. Y., Lee, S. H., & Kang, H. (2017b). Study on the development of test for indicators of positive experiences about science. Journal of the Korean Association for Science Education, 37(2), 335-346.   DOI
54 So, K., Shim, K., Lee, H., & Chang, N. (2000). Study on attitude of science gifted and talented middle school students toward science. Journal of the Korean Association for Science Education, 20(1), 166-173.
55 Song, M., Choi, H., Rim, H., Park, H., & Son, S. (2013). OECD programme for international student assessment: Establishing PISA 2015 fildd trial(Research report RRE 2013-6-2). Seoul: Korea Institute for Curriculum and Evaluation.
56 Kim, S., Jung, C., & Shin, D. (2015). Research trends of science related attitude in the Korean major journals of science education. Journal of Learner-Centered Curriculum and Instruction, 15(12), 179-200.
57 Kim, H., Chung, W., & Jeong, J. (1998). National assessment system development of science-related affective domain. Journal of the Korean Association for Science Education, 18(3), 357-369.
58 Kim, M., Hong, J., & Chang, N. (2001). Development of the instrument for assessing the degree of ambivalence of the attitudes of high school students. Biology Education, 29(1), 27-33.
59 Kim, S., Jeong, S., & Hwang, Y. (2005). Development and application of self-evaluation test items for secondary science teacher professional growth. Journal of the Korean Association for Science Education, 25(7), 736-745.
60 Kim, H., & Kim, C. (1999). The effects of portfolio assessment on elementary school students' science knowledge, inquiry ability and science attitudes. Journal of the Korean Association for Science Education, 19(1), 19-28.
61 Kim, S., & Kim, H. (2016). Development of a science ethicality test for elementary school students. Journal of the Korean Association for Science Education, 36(1), 1-13.   DOI
62 Kim, K., Kim, S., Kim, M., Kim, S., Kang, M., Park, H., & Jung, S. (2009). Comparative analysis of curriculum and achievement characteristics between Korea and high performing countries in PISA & TIMSS. Seoul: Korea Institute for Curriculum and Evaluation.
63 Kim, S., Kim, K., & Park, J, (2014). The effect of mathematics achievement on changes in mathematics interest and values for middle school students. Journal of Research in Curriculum Instruction, 18(3), 683-701.   DOI
64 Munby, H. (1983). Thirty studies involving the "Scientific Attitude Inventory": What confidence can we have in this instrument? Journal of Research in Science Teaching, 20, 141-162.   DOI
65 Kim, J., & Lee, H. (2018). Emotional response of gifted students in the class based on the evaluation of core competencies. Journal of Learner-Centered Curriculum and Instruction, 18(4), 225-246.
66 Mun, K., Mun, J., Shin, S., & Kim, S. (2014). Development and application of high school students 'physics self-efficacy'. Journal of the Korean Association for Science Education, 34(7), 693-701.   DOI
67 Munby, H. (1980). An evaluation of instruments which measure attitudes to science. In C. McFadden(Ed.), World Trends in Science Education. Halifax, Nova Scotia: Atlantic Institute of Education.
68 Nagy, P. (1978). Subtest formation by cluster analysis of the Scientific Attitude Inventory. Journal of Research in Science Teaching, 15, 355-360.   DOI
69 National Research Council(2002). Scientific research in education. Washington, DC: National Academic Press.
70 OECD (2007). PISA 2006: Science competencies for tomorrow's world, vol 1. Paris: OECD Publishing.
71 OECD (2016). PISA 2015 results (volume I): Excellence and equity in education. Paris: OECD Publishing.
72 Ormerod, M. B. (1971). The social implications' factor in attitudes to science. British Journal of Educational Psychology, 41, 335-338.   DOI
73 Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational Research, 66(4), 543-578.   DOI
74 Bandura, A. (1997). Self-efficacy. Harvard Mental Health Letter, 13(9), 4.
75 Park, C. (2007). The trend in the Korean middle school student's affective variables toward mathematics and its effect on their mathematics achievement. The Mathematical Education, 46(1). 19-31.
76 Park, M., Kim, Y., & Jeon, D. (2007). The effect of factors in assessment on the science learning motivation of high achieving students. Journal of the Korean Association for Science Education, 27(7), 623-630.
77 Anderson, L. W., & Bourke, S. F. (2000). Assessing affective characteristics in the schools. New York: Routledge.
78 Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191-215.   DOI
79 Bandura, A. (1986). Social foundation of thoughts and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
80 Britton, E. D., & Schneider, S. A. (2007). Large-scale assessments in science education. In S. K. Abell & N. G. Lederman(Eds.), Handbook of research on science education. Mahwa, NJ: Lawrence Erlbaum.
81 Brophy, K. A. (1988). On motivating students. In D. Berliner & B. Rosenshine(Eds.), Talks to teachers(pp. 201-245). New York: Random House.
82 Byeon, J., Kim, S., Lee, I. Kwon, Y. (2013). A study on attention type and shift of task commitment in secondary students' biological classification-eye-tracking approach. Biology Education, 41(2), 254-266.   DOI
83 Choi, S., Kim, S. Y., & Kim, S. W. (2007). The development of instruments to assess attitudes toward science of students and their parents. Journal of the Korean Association for Science Education, 27(3), 272-284.
84 Chun, E., Na, J., Joung, Y., & Song, J. (2015). Development and application of the measuring instrument for the analysis of science classroom culture from the perspective of 'community of practice'. Journal of the Korean Association for Science Education, 35(1), 131-142.   DOI
85 Chung, S., & Shin, D. (2016). Trends of assessment research in science education. Journal of the Korean Association for Science Education, 36(4), 563-579.   DOI
86 Chung, S., & Shin, D. (2017). Cases of discrepancy in high school students' achievement in science education assessment: Focusing on testing tool in affective area. Journal of the Korean Association for Science Education, 37(5), 891-909.   DOI
87 Chung, W., Yeun, B., & Hur, M. (1994). The development of an instrument for measuring scientific attitudes of elementary school children. Journal of the Korean Association for Science Education, 14(3), 265-271.
88 De Vellis, R. F. (2017). Scale development: Theory and applications(4th Edition). Los Angeles: Sage.
89 Sung, T. (2010). Modern educational evaluation(3rd ed.) Seoul: Hakjisa.
90 Song, Y., & Choi, H. (2017). Development and application of measurement tools for physics image using the semantic differential method. Journal of the Korean Association for Science Education, 37(6), 1051-1061.   DOI
91 Tamir, P. (1998). Assessment and evaluation in science education: Opportunities to learn and outcomes. In B. J. Fraser & K. G. Tobin(Eds.), International handbook of science education. Dordrecht, The Netherlands: Kluwer Academie.
92 Tuan, H., Chin, C., & Shieh, S. (2005). The development of a questionnaire to measure students' motivation towards science learning. International Journal of Science Education, 27(6), 639-654.   DOI
93 Uguroglu, M., Schiller, D., & Walberg, H. (1981). A multidimensional motivational instrument. Psychology in the Schools, 18, 279-285.   DOI
94 Fraser, B. J. (1977). Selection and validation of attitude scales for curriculum evaluation. Science Education, 61(3), 317-329.   DOI
95 Doran, R. L., Lawrenz, F., & Helgeson, S. (1994). Research on assessment in science. In D. L. Gabel(Ed.), Handbook of research on science teaching and learning. New York: Macmillan Publishing Company.
96 Elias, M., Parker, S., Kash, M.,, Weissberg, R., & O'Brien, M. U. (2008). Social and emotional learning, Moral education and character education: A comparative analysis and a view toward convergence. In L. P. Nucci, T. Krettenauer, & D. Narvaez(Eds.), Handbook of moral and character education. New York: Routledge.
97 Enochs, L., & Riggs, I. (1990). Further development of an elementary science teaching efficacy belief instrument: A preservice elementary scale. School Science and Mathematics, 90(8), 694-706.   DOI
98 Fraser, B. J. (1978). Development of a test of science-related attitudes. Science Education, 62(4), 509-515.   DOI
99 Fraser, B. J. (1981). TOSRA: Test of science related attitudes handbook. Melbourne: The Australian Council for Educational Research.
100 Glynn, S., Brickman, P., Armstrong, N., & Taasoobshirazi, G. (2011). Science motivation questionnaire II: Validation with science majors and nonscience majors, Journal of Research in Science Teaching, 48(10), 1159-1176.   DOI
101 Glynn, S., & Koballa, T. (2006). Motivation to learn in college science. In J. J. Mintzes & W. H. Leonard(Eds.), Handbook of college science teaching(pp. 25-32). Arlington, VA: National Science Teachers Association Press.
102 Glynn, S., Taasoobshirazi, G., & Brickman, P. (2007). Nonscience majors learning science: A theoretical model of motivation. Journal of Research in Science Teaching, 44, 1088-1107.   DOI
103 Yoo, S. (2000). Using portfolios as tools to implement preservice teachers' professional development and reflective thinking in early science education. Journal of Early Childhood Education, 20(1), 163-184.
104 White, R. T., & Mackay, L. D. (1974). Tests of perception of scientists and self. Paper presented to the forty seventh annual meeting of the National Association for Research in Science Teaching, Chicago, April.
105 Woo, H., & Chung, Y. (1994). A study on elementary school students' and middle school students' attitudes toward environmental problems. Journal of the Korean Association for Science Education, 14(2), 225-235.
106 Woo, M., Rachmatullah, A., & Ha, M. (2017). Validating overconfidence biases measurement using genetics and evolution concept test and exploring gender and academic track differences. Journal of Learner-Centered Curriculum and Instruction, 17(12), 27-51.
107 Hong, J. (2014). The case study of self and peer evaluation for pre-service biology teachers for teaching practice. Biology Education, 42(3), 290-303.   DOI
108 Glynn, S., Taasoobshirazi, G., & Brickman, P., (2009). Science motivation questionnaire: Construct validation with nonscience majors. Journal of Research in Science Teaching, 46(2), 127-146.   DOI
109 Ha, M., & Lee, J. (2013). The item response, generalizability, and structural validity for the translation of Science Motivation Questionnaire II (SMQ II). Journal of Learner-Centered Curriculum and Instruction, 13(5), 1-18.
110 Hasan, O. E., & Billeh, V. Y. (1975). Relationship between teachers' change in attitudes toward science and some professional variables. Journal of Research in Science Teaching, 12(3), 255-261.   DOI
111 Hwang, S., Kim, H., Yoo, J., & Park, S. (2001). Ninth graders' self - assessment of scientific process skills in open investigation. Journal of the Korean Association for Science Education, 21(3), 506-515.
112 Jeon, J. (2014). Development and construct validation of the achievement emotions questionnaire-Korean middle school Science(AEQ-KMS). Journal of the Korean Association for Science Education, 34(8), 745-754.   DOI
113 Jeon, S. (2011). A Study on the cognition of gifted students and parents about observation and recommendation system for selection of mathematics and science gifted students(Master's thesis). Korea University, Seoul, Korea.
114 Jeong, J. (2007). Development of an instrument to measure elementary and secondary school students' scientific emotions and a survey of scientific emotions in the generation of biological hypotheses. Biology Education, 35(1), 11-26.   DOI