Journal of The Korean Association For Science Education (한국과학교육학회지)

The Korean Association for Science Education (한국과학교육학회)
권호 표지
DOI QR코드

DOI QR Code

Analysing the Use of Test Tools in Science-Related Affective Domain and its Improvements

과학 관련 정의적 영역 검사 도구 활용 및 개선 내용 분석

  • Received : 2019.02.05
  • Accepted : 2019.03.25
  • Published : 2019.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study analyzed the current use of science-related test tools in affective area in Korean academic journals for the last 30 years since 1989 and the cases of modification of the original tools related to the tools. This provides practical information on the development and improvement of test tools in the future and offers the basis for developing valid test tools. The study was conducted in two stages. We analyzed the status of 88 domestic science education researches dealing with testing tools related affective characteristics and 57 domestic and foreign resource tools referenced by them. After that, we compared the characteristics of the five cases in which the original tool was revised and the concrete item correction examples. The results were analyzed as follows: topics that have emerged continuously or that have recently begun to appear in domestic research, the research situations according to their purpose and measurement methods used by the tool, and use state of original tools. The background and key points of revision were analyzed for the five tools, TOSRA, SAI, PISA items, STEBI-A/B, SMQ, whose revision process were disclosed. In addition, the changes of the items were analyzed by comparing the four test items with the questions before and after the revision. As a result of item analysis, item improvement was proceeding in the direction of enhancing readability, clarifying meaning, and changing items according to change of sub constructs. The implications of this study are as follows: notes on interpreting the results obtained from the tool with multiple mixed constructs, the possibility of the testing tool that broadens the horizon of the research, error recognition in the subjective self-report, and notes when applying test tools from other disciplines to science.

이 연구는 1989년 이후 30년간 국내 학술지에 발표된 과학 관련 정의적 영역 검사 도구 활용 현황과 이와 관련한 검사 도구의 수정 사례와 내용을 분석했다. 이로써 향후 검사 도구 개발과 개선 과정에 대한 실질적 정보를 제공하고, 타당한 검사 도구 개발을 위한 근거를 마련했다. 연구는 두 단계로 진행되었다. 정의적 영역 검사 도구를 중심으로 한 국내 과학 교육 연구 88편의 현황과 이들이 참고한 국내 외 원도구 57건의 현황을 분석했다. 그 후 원도구가 개정되었던 사례 5건의 특징과 구체적 문항 수정 사례를 비교했다. 연구 결과 국내 연구 현황에서는 지속적으로 나타난 주제와 최근에 출현하기 시작한 주제, 연구 목적과 평가 방법에 따른 연구 상황, 원도구 활용 현황 등이 분석되었다. 분석 대상 연구의 원도구 중 개정 과정이 공개된 5건의 검사 도구인 TOSRA, SAI, PISA 문항, STEBI-A/B, SMQ 등에 대해 개정 배경과 주요 사항을 분석했다. 개정 전후의 문항이 공개된 4개의 검사 문항을 비교해서 문항의 변천 과정을 분석했다. 분석 결과 문항 개선은 하위 구인의 변화에 따른 신설과 삭제, 가독성 향상, 의미를 명료화하는 방향으로 진행되고 있었다. 본 연구 결과의 시사점으로 여러 구인이 혼재된 검사 도구에서 얻은 결과 해석상 유의점, 연구의 지평을 넓혀주는 검사 도구의 가능성, 주관적 자기 보고에서 나타나는 오차 인식, 타학문에서 유래한 검사 도구를 과학과에 적용시킬 때 유의할 점 등을 제안했다.

Keywords

Table 1. Number of papers and items analyzed

GHGOBX_2019_v39n2_263_t0001.png 이미지

Table 2. Analysis criteria

GHGOBX_2019_v39n2_263_t0002.png 이미지

Table 3. Science-related affective domain assessments mentioned in National Science Curriculum

GHGOBX_2019_v39n2_263_t0003.png 이미지

Table 4. Research organized by topics according to research purpose and measurement method from 1989 to 2018

GHGOBX_2019_v39n2_263_t0004.png 이미지

Table 5. Use of test tool according to research purpose

GHGOBX_2019_v39n2_263_t0005.png 이미지

Table 6. Original tool used in domestic studies

GHGOBX_2019_v39n2_263_t0006.png 이미지

Table 7. Contents modified when original tools are revised

GHGOBX_2019_v39n2_263_t0007.png 이미지

Table 8. Change of Items when original tools are revised

GHGOBX_2019_v39n2_263_t0008.png 이미지

Table 9. Cases of item change when original tools are revised

GHGOBX_2019_v39n2_263_t0009.png 이미지

References

  1. Anderson, L. W., & Bourke, S. F. (2000). Assessing affective characteristics in the schools. New York: Routledge.
  2. Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191-215. https://doi.org/10.1037/0033-295X.84.2.191
  3. Bandura, A. (1986). Social foundation of thoughts and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
  4. Bandura, A. (1997). Self-efficacy. Harvard Mental Health Letter, 13(9), 4.
  5. Britton, E. D., & Schneider, S. A. (2007). Large-scale assessments in science education. In S. K. Abell & N. G. Lederman(Eds.), Handbook of research on science education. Mahwa, NJ: Lawrence Erlbaum.
  6. Brophy, K. A. (1988). On motivating students. In D. Berliner & B. Rosenshine(Eds.), Talks to teachers(pp. 201-245). New York: Random House.
  7. Byeon, J., Kim, S., Lee, I. Kwon, Y. (2013). A study on attention type and shift of task commitment in secondary students' biological classification-eye-tracking approach. Biology Education, 41(2), 254-266. https://doi.org/10.15717/bioedu.2013.41.2.254
  8. Choi, S., Kim, S. Y., & Kim, S. W. (2007). The development of instruments to assess attitudes toward science of students and their parents. Journal of the Korean Association for Science Education, 27(3), 272-284.
  9. Chun, E., Na, J., Joung, Y., & Song, J. (2015). Development and application of the measuring instrument for the analysis of science classroom culture from the perspective of 'community of practice'. Journal of the Korean Association for Science Education, 35(1), 131-142. https://doi.org/10.14697/jkase.2015.35.1.0131
  10. Chung, S., & Shin, D. (2016). Trends of assessment research in science education. Journal of the Korean Association for Science Education, 36(4), 563-579. https://doi.org/10.14697/jkase.2016.36.4.0563
  11. Chung, S., & Shin, D. (2017). Cases of discrepancy in high school students' achievement in science education assessment: Focusing on testing tool in affective area. Journal of the Korean Association for Science Education, 37(5), 891-909. https://doi.org/10.14697/JKASE.2017.37.5.891
  12. Chung, W., Yeun, B., & Hur, M. (1994). The development of an instrument for measuring scientific attitudes of elementary school children. Journal of the Korean Association for Science Education, 14(3), 265-271.
  13. De Vellis, R. F. (2017). Scale development: Theory and applications(4th Edition). Los Angeles: Sage.
  14. Doran, R. L., Lawrenz, F., & Helgeson, S. (1994). Research on assessment in science. In D. L. Gabel(Ed.), Handbook of research on science teaching and learning. New York: Macmillan Publishing Company.
  15. Elias, M., Parker, S., Kash, M.,, Weissberg, R., & O'Brien, M. U. (2008). Social and emotional learning, Moral education and character education: A comparative analysis and a view toward convergence. In L. P. Nucci, T. Krettenauer, & D. Narvaez(Eds.), Handbook of moral and character education. New York: Routledge.
  16. Enochs, L., & Riggs, I. (1990). Further development of an elementary science teaching efficacy belief instrument: A preservice elementary scale. School Science and Mathematics, 90(8), 694-706. https://doi.org/10.1111/j.1949-8594.1990.tb12048.x
  17. Fraser, B. J. (1977). Selection and validation of attitude scales for curriculum evaluation. Science Education, 61(3), 317-329. https://doi.org/10.1002/sce.3730610307
  18. Fraser, B. J. (1978). Development of a test of science-related attitudes. Science Education, 62(4), 509-515. https://doi.org/10.1002/sce.3730620411
  19. Fraser, B. J. (1981). TOSRA: Test of science related attitudes handbook. Melbourne: The Australian Council for Educational Research.
  20. Glynn, S., Brickman, P., Armstrong, N., & Taasoobshirazi, G. (2011). Science motivation questionnaire II: Validation with science majors and nonscience majors, Journal of Research in Science Teaching, 48(10), 1159-1176. https://doi.org/10.1002/tea.20442
  21. Glynn, S., & Koballa, T. (2006). Motivation to learn in college science. In J. J. Mintzes & W. H. Leonard(Eds.), Handbook of college science teaching(pp. 25-32). Arlington, VA: National Science Teachers Association Press.
  22. Glynn, S., Taasoobshirazi, G., & Brickman, P. (2007). Nonscience majors learning science: A theoretical model of motivation. Journal of Research in Science Teaching, 44, 1088-1107. https://doi.org/10.1002/tea.20181
  23. Glynn, S., Taasoobshirazi, G., & Brickman, P., (2009). Science motivation questionnaire: Construct validation with nonscience majors. Journal of Research in Science Teaching, 46(2), 127-146. https://doi.org/10.1002/tea.20267
  24. Ha, M., & Lee, J. (2013). The item response, generalizability, and structural validity for the translation of Science Motivation Questionnaire II (SMQ II). Journal of Learner-Centered Curriculum and Instruction, 13(5), 1-18.
  25. Hasan, O. E., & Billeh, V. Y. (1975). Relationship between teachers' change in attitudes toward science and some professional variables. Journal of Research in Science Teaching, 12(3), 255-261. https://doi.org/10.1002/tea.3660120308
  26. Hong, J. (2014). The case study of self and peer evaluation for pre-service biology teachers for teaching practice. Biology Education, 42(3), 290-303. https://doi.org/10.15717/bioedu.2014.42.3.290
  27. Hwang, S., Kim, H., Yoo, J., & Park, S. (2001). Ninth graders' self - assessment of scientific process skills in open investigation. Journal of the Korean Association for Science Education, 21(3), 506-515.
  28. Jeon, J. (2014). Development and construct validation of the achievement emotions questionnaire-Korean middle school Science(AEQ-KMS). Journal of the Korean Association for Science Education, 34(8), 745-754. https://doi.org/10.14697/jkase.2014.34.8.0745
  29. Jeon, S. (2011). A Study on the cognition of gifted students and parents about observation and recommendation system for selection of mathematics and science gifted students(Master's thesis). Korea University, Seoul, Korea.
  30. Jeong, J. (2007). Development of an instrument to measure elementary and secondary school students' scientific emotions and a survey of scientific emotions in the generation of biological hypotheses. Biology Education, 35(1), 11-26. https://doi.org/10.15717/bioedu.2007.35.1.11
  31. Jeong, E., & Kim, Y. (1993). Development of an instrument to assess middle school students' attitude toward environmental pollution. Journal of the Korean Association for Science Education, 13(2), 271-281.
  32. Jo, S. (2011). A study on the use of gifted behavior rating scale in teacher's recommendation for the gifted education. The Journal of the Korean Society for the Gifted and Talented, 10(2), 5-30. https://doi.org/10.17839/JKSGT.2011.10.2.5
  33. Jo, S., & Ku, J. (2013). An exploration in the measurement and application of attitude towards science based on social constructivism. Journal of the Korean Association for Science Education, 33(2), 466-477. https://doi.org/10.14697/jkase.2013.33.2.466
  34. Jurges, H., Schneider, K., & Buchel, F. (2005). The effect of central exit examinations on student achievement: quasi-experimental evidence from TIMSS Germany. Journal of the European Economic Association, 3(5), 1134-1155. https://doi.org/10.1162/1542476054729400
  35. Keller, J. (1984). The use of the ARCS model of motivation in teacher training. In K. E. Shaw(Ed.), Aspects of educational technology XVII. Staff development and career updating. New York: Nichols.
  36. Kim, S., Byeon, J., Lee, I., & Kwon, Y. (2012). An eye tracking study on test-item solving of science scholastic achievement focused in elementary school students. Journal of Learner-Centered Curriculum and Instruction, 12(1), 65-78.
  37. Kim, H., Chung, W., & Jeong, J. (1998). National assessment system development of science-related affective domain. Journal of the Korean Association for Science Education, 18(3), 357-369.
  38. Kim, M., Hong, J., & Chang, N. (2001). Development of the instrument for assessing the degree of ambivalence of the attitudes of high school students. Biology Education, 29(1), 27-33.
  39. Kim, S., Jeong, S., & Hwang, Y. (2005). Development and application of self-evaluation test items for secondary science teacher professional growth. Journal of the Korean Association for Science Education, 25(7), 736-745.
  40. Kim, S., Jung, C., & Shin, D. (2015). Research trends of science related attitude in the Korean major journals of science education. Journal of Learner-Centered Curriculum and Instruction, 15(12), 179-200.
  41. Kim, H., & Kim, C. (1999). The effects of portfolio assessment on elementary school students' science knowledge, inquiry ability and science attitudes. Journal of the Korean Association for Science Education, 19(1), 19-28.
  42. Kim, S., & Kim, H. (2016). Development of a science ethicality test for elementary school students. Journal of the Korean Association for Science Education, 36(1), 1-13. https://doi.org/10.14697/jkase.2016.36.1.0001
  43. Kim, K., Kim, S., Kim, M., Kim, S., Kang, M., Park, H., & Jung, S. (2009). Comparative analysis of curriculum and achievement characteristics between Korea and high performing countries in PISA & TIMSS. Seoul: Korea Institute for Curriculum and Evaluation.
  44. Kim, S., Kim, K., & Park, J, (2014). The effect of mathematics achievement on changes in mathematics interest and values for middle school students. Journal of Research in Curriculum Instruction, 18(3), 683-701. https://doi.org/10.24231/rici.2014.18.3.683
  45. Kim, J., & Lee, H. (2018). Emotional response of gifted students in the class based on the evaluation of core competencies. Journal of Learner-Centered Curriculum and Instruction, 18(4), 225-246.
  46. Kim, Y., Park, Y., Park, H., Shin, D., Jung, J., & Song, S. (2014). World of science education. Seoul: Book's hill.
  47. Kim, N., & Ryu, C. (2010). Development and application of tool for measuring high school students' scientific experience. Journal of the Korean Earth Science Society, 31(3), 276-287. https://doi.org/10.5467/JKESS.2010.31.3.276
  48. Kim, S., & Seo, H. (2011). Self-regulated learning ability related to science inquiry skill and affective domain of science in middle school students. Journal of Science Education, 35(2), 307-323. https://doi.org/10.21796/jse.2011.35.2.307
  49. Ko, M., Kim, E., Heo, J., & Yang, I. (2013). Elementary school teachers' beliefs of inquiry and practice of science performance assessment. The Korean Society of Earth Science Education, 6(2), 124-135.
  50. Koballa, T. R. (1988). Attitude and related concepts in science education. Science Education, 72(2), 115-126. https://doi.org/10.1002/sce.3730720202
  51. Krynowsky, B. (1988). Problems in assessing student attitude in science education: A partial solution. Science Education, 72(4), 575-584. https://doi.org/10.1002/sce.3730720504
  52. Ku, J., Kim, S., Lee, H., Cho, S., & Park, H. (2016). OECD programme for international students assessment: An analysis of PISA 2015 Results. Seoul: Korea Institute for Curriculum and Evaluation.
  53. Kwak, H., & Shin, Y. (2014). The effects of formative assessment using mobile applications on interest and self-directedness in science instruction. Journal of the Korean Association for Science Education, 34(3), 285-294. https://doi.org/10.14697/jkase.2014.34.3.0285
  54. Kwak, Y. (2017). Exploration of features of Korean eighth grade students' attitudes toward science. Journal of the Korean Association for Science Education, 37(1), 135-142. https://doi.org/10.14697/jkase.2017.37.1.0135
  55. Laughton, W. H., & Wilkinson, W. J. (1968). Pupils' attitudes to science teaching. Education in Science, 26, 31-33. https://doi.org/10.3969/j.issn.1002-8064.2010.01.008
  56. Lee, C. (2017). The development of a concise science achievement emotions questionnaire for secondary school students(Master's thesis). Kongju University, Kongju, Korea.
  57. Lee, H., Choi, K., & Nam, J. (2000). The effects of formative assessment with detailed feedback on students science achievement, attitude, and interaction between teacher and Students. Journal of the Korean Association for Science Education, 20(3), 479-490.
  58. Lee, M., & Hann, A. (2001). Effect of portfolio assessment in elementary science teaching. Journal of Korean Elementary Science Education, 20(1), 107-122.
  59. Lee, S., & Hur, M. (1998). The development of middle school students' attitude evaluation instrument in laboratory work. Journal of Research in Curriculum & Instruction. 2(2), 194-213.
  60. Lee, J., & Kim, B. (1998). Development of the psychological learning environment instrument generated by science teachers in the science instruction. Journal of the Korean Association for Science Education, 18(3), 313-325.
  61. Lee, S., & Kim, Y. (2013). A study of the development of the Korean youth moral test: standardization of the test and categorization of moral type. Journal of ethics education studies, 31, 237-259.
  62. Lee, K., & Woo, J. (1996). A study of valid measurement in science related attitudes(II): To develop an affective component of attitudes toward science scale. Journal of the Korean Association for Science Education, 16(2), 190-199.
  63. Liu, X. (2012). Developing measurement instruments for science education research. In B. J. Fraser, G. T. Kenneth, & C. J. McRobbi(Eds), Second International Handbook of Science Education, Dadrecht; New York: Springer.
  64. Markle, G. C. (1978). Assessing the validity and reliability of the subject preference inventory with preservice elementary teacher. Journal of Research in Science Teaching, 15, 519-522. https://doi.org/10.1002/tea.3660150612
  65. Merrell, K., & Gueldner, B. (2010). Social and emotional learning in the classroom: promoting mental health and academic success. New York: Guilford publishing.
  66. Meyer, G. R. (1969). A test of interest. Milton, Queensland: Jacaranda Press.
  67. Midgley, C., Maehr, M., & Urdan, T. (1993). Patterns of adaptive learning survey. Ann Arbor, MI: University of Michigan Press.
  68. Ministry of Culture and Education. (1981). Middle school education curriculum. Notification No. 1981-442 of MOCE. Seoul: MOCE.
  69. Ministry of Culture and Education. (1987). Middle school education curriculum. Notification No. 87-9 of MOCE. Seoul: MOCE.
  70. Ministry of Education. (1992). Middle school curriculum. Notification No. 1992-11 of MOE. Seoul: MOE.
  71. Ministry of Education. (1997). Middle school curriculum reference book. Notification No. 1997-15 of MOE. Seoul: MOE.
  72. Ministry of Education and Human Resources Development. (2007). Middle school curriculum. Notification No. 2007-79 of MOEHRD. Seoul: MOEHRD.
  73. Ministry of Education Science, and Technology. (2011). Science curriculum. Notification No. 2011-361 of MOEST. Seoul: MOEST.
  74. Ministry of Education. (2015). Science curriculum. Notification No. 2015-74 of MOE. Seoul: MOE.
  75. Moore, R., & Sutman, F. (1970). The development, field test and validation of an inventory of scientific attitudes. Journal of Research in science Teaching, 7, 85-94. https://doi.org/10.1002/tea.3660070203
  76. Moore, R., & Foy, R. (1997). The scientific attitude inventory: A revision(SAI II). Journal of Research in Science Teaching, 34(4), 327-336. https://doi.org/10.1002/(SICI)1098-2736(199704)34:4<327::AID-TEA3>3.0.CO;2-T
  77. Mun, K., Mun, J., Shin, S., & Kim, S. (2014). Development and application of high school students 'physics self-efficacy'. Journal of the Korean Association for Science Education, 34(7), 693-701. https://doi.org/10.14697/jkase.2014.34.7.0693
  78. Munby, H. (1980). An evaluation of instruments which measure attitudes to science. In C. McFadden(Ed.), World Trends in Science Education. Halifax, Nova Scotia: Atlantic Institute of Education.
  79. Munby, H. (1983). Thirty studies involving the "Scientific Attitude Inventory": What confidence can we have in this instrument? Journal of Research in Science Teaching, 20, 141-162. https://doi.org/10.1002/tea.3660200206
  80. Nagy, P. (1978). Subtest formation by cluster analysis of the Scientific Attitude Inventory. Journal of Research in Science Teaching, 15, 355-360. https://doi.org/10.1002/tea.3660150506
  81. National Research Council(2002). Scientific research in education. Washington, DC: National Academic Press.
  82. OECD (2007). PISA 2006: Science competencies for tomorrow's world, vol 1. Paris: OECD Publishing.
  83. OECD (2016). PISA 2015 results (volume I): Excellence and equity in education. Paris: OECD Publishing.
  84. Ormerod, M. B. (1971). The social implications' factor in attitudes to science. British Journal of Educational Psychology, 41, 335-338. https://doi.org/10.1111/j.2044-8279.1971.tb00683.x
  85. Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational Research, 66(4), 543-578. https://doi.org/10.3102/00346543066004543
  86. Park, C. (2007). The trend in the Korean middle school student's affective variables toward mathematics and its effect on their mathematics achievement. The Mathematical Education, 46(1). 19-31.
  87. Park, M., Kim, Y., & Jeon, D. (2007). The effect of factors in assessment on the science learning motivation of high achieving students. Journal of the Korean Association for Science Education, 27(7), 623-630.
  88. Park, E., Lee, S., Rachmatullah, A., & Ha, M. (2017). Validating the translated version of CARS(Changes in Attitude About the Relevance of Science), exploring variables related to CARS Scores, and constructing two equivalent test sets of CARS. Journal of Science Education, 41(2), 179-194. https://doi.org/10.21796/jse.2017.41.2.179
  89. Park, H., & Paik, S. (2001). The effects of lessons adopting portfolio assessment regarding feedback on elementary school student's scientific knowledge, inquiry ability, and their perception, Journal of the Korean Association for Science Education, 21(1), 22-29.
  90. Park, S. (1997). Development and validation of the Korean science teaching efficacy beliefs instrument (K-STEBI) for prospective elementary school teachers. Journal of the Korean Association for Science Education, 16(2), 205-224.
  91. Pekrun, R., Goetz, T., Frenzel, A., Barchfeld, P., & Perry, R. (2011). Measuring emotions in students' learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36-48. https://doi.org/10.1016/j.cedpsych.2010.10.002
  92. Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students' self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91-106. https://doi.org/10.1207/S15326985EP3702_4
  93. Pintrich, P. R., & DeGroot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33-40. https://doi.org/10.1037/0022-0663.82.1.33
  94. Reach, G., Zerrouki, A., Leclercq, D., & d'Ivernois, J. F. (2005). Adjusting insulin doses: From knowledge to decision. Patient Education and Counseling, 56(1), 98-103. https://doi.org/10.1016/j.pec.2004.01.001
  95. Riggs, I., & Enochs, L. (1990). Toward the development of an elementary teacher's science teaching efficacy belief instrument. Science Education, 74(6), 625-637. https://doi.org/10.1002/sce.3730740605
  96. School Council Project for Evaluation of Science Teaching Methods(1973). A modified version of the science pupil opinion poll. University of Leicester.
  97. Schunk, D. (1991). Self-efficacy and academic motivation. Journal Educational Psychologist, 26(3-4), 207-231. https://doi.org/10.1207/s15326985ep2603&4_2
  98. Seo, J., Choi, J., & Kim, Y. (2007). Comparison of life learning skills of gifted science students and normal students in high school. Biology Education, 35(1), 61-72. https://doi.org/10.15717/bioedu.2007.35.1.61
  99. Shen, C., & Pedulla, J. (2000). The relationship between students' achievement and their self-perception of competence and rigour of mathematics and science: A cross-national analysis. Assessment in Education, 7(2), 237-253. https://doi.org/10.1177/107319110000700304
  100. Shin, S., Ha, M., & Lee, J. (2016). The development and validation of instrument for measuring high school students' STEM career motivation. Journal of the Korean Association for Science Education, 36(1), 75-86. https://doi.org/10.14697/jkase.2016.36.1.0075
  101. Shin, Y., Kang, H., Kwak, Y., Kim, H., Lee, S., & Lee, S. H. (2017a). A comparative analysis of the test tools in science-related affective domains. Biology Education, 45(1), 41-54. https://doi.org/10.15717/bioedu.2017.45.1.41
  102. Shin, Y., Kwak, Y., Kim, H., Lee, S. Y., Lee, S. H., & Kang, H. (2017b). Study on the development of test for indicators of positive experiences about science. Journal of the Korean Association for Science Education, 37(2), 335-346. https://doi.org/10.14697/JKASE.2017.37.2.0335
  103. So, K., Shim, K., Lee, H., & Chang, N. (2000). Study on attitude of science gifted and talented middle school students toward science. Journal of the Korean Association for Science Education, 20(1), 166-173.
  104. Song, M., Choi, H., Rim, H., Park, H., & Son, S. (2013). OECD programme for international student assessment: Establishing PISA 2015 fildd trial(Research report RRE 2013-6-2). Seoul: Korea Institute for Curriculum and Evaluation.
  105. Song, Y., & Choi, H. (2017). Development and application of measurement tools for physics image using the semantic differential method. Journal of the Korean Association for Science Education, 37(6), 1051-1061. https://doi.org/10.14697/JKASE.2017.37.6.1051
  106. Sung, T. (2010). Modern educational evaluation(3rd ed.) Seoul: Hakjisa.
  107. Tamir, P. (1998). Assessment and evaluation in science education: Opportunities to learn and outcomes. In B. J. Fraser & K. G. Tobin(Eds.), International handbook of science education. Dordrecht, The Netherlands: Kluwer Academie.
  108. Tuan, H., Chin, C., & Shieh, S. (2005). The development of a questionnaire to measure students' motivation towards science learning. International Journal of Science Education, 27(6), 639-654. https://doi.org/10.1080/0950069042000323737
  109. Uguroglu, M., Schiller, D., & Walberg, H. (1981). A multidimensional motivational instrument. Psychology in the Schools, 18, 279-285. https://doi.org/10.1002/1520-6807(198107)18:3<279::AID-PITS2310180305>3.0.CO;2-X
  110. White, R. T., & Mackay, L. D. (1974). Tests of perception of scientists and self. Paper presented to the forty seventh annual meeting of the National Association for Research in Science Teaching, Chicago, April.
  111. Woo, H., & Chung, Y. (1994). A study on elementary school students' and middle school students' attitudes toward environmental problems. Journal of the Korean Association for Science Education, 14(2), 225-235.
  112. Woo, M., Rachmatullah, A., & Ha, M. (2017). Validating overconfidence biases measurement using genetics and evolution concept test and exploring gender and academic track differences. Journal of Learner-Centered Curriculum and Instruction, 17(12), 27-51.
  113. Yoo, S. (2000). Using portfolios as tools to implement preservice teachers' professional development and reflective thinking in early science education. Journal of Early Childhood Education, 20(1), 163-184.
  114. Yu, I., & Yoon, I. (2001). Teacher's attitude and practical application of performance assessment in the home economics education, Korean Home Economics Education Association, 13(1), 93-106.