Journal of The Korean Association For Science Education (한국과학교육학회지)

The Korean Association for Science Education (한국과학교육학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Evaluation Criteria for Online Problem-Based Science Learning

온라인 문제기반 과학 탐구과제 평가준거 개발

  • Received : 2017.09.26
  • Accepted : 2017.10.25
  • Published : 2017.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to develop the evaluation criteria for students' research reports on online science inquiry problems that promote thinking abilities. The steps of developing the evaluation criteria are as follows; First, based on previous study results and literature review, the evaluation categories of the science inquiry contents were determined: 1) knowledge, 2) logical and analytical thinking, 3) critical thinking, 4) science process skills, 5) problem-solving, and 6) creative thinking. Second, evaluation criteria are developed according to the following steps: 1) define each category, 2) identify sub-category, 3) develop evaluation criteria for all categories that could serve as guidelines in the development of scoring rubrics, and 4) expert validation processes were performed. Finally, the usability test for these evaluation categories and criteria were done by being applied to the development of real scoring rubrics for 24 problems included in e-learning contents. Then the users' feedbacks were filed and the implications of this study were discussed.

본 연구에서는 문제기반 탐구학습으로 설계된 초등학교 및 중학교 온라인 과학 과목을 대상으로 고차적인 사고력을 평가할 수 있도록 개발된 평가문제에 대해 목표 분류학에 기반하여 평가하고자 하는 사고력을 도출하고 이를 구조화함으로써 평가준거를 개발하고자 하였다. 평가준거의 개발 과정은 다음과 같다. 먼저, 선행 연구 및 문헌분석, 전문가 타당화를 거쳐 6개의 평가요소 즉, 지식, 논리 분석적 사고, 비판적 사고, 탐구능력, 문제해결, 창의적 사고를 도출하였다. 다음으로, 평가요소의 정의, 하위 요소 및 평가 기준 등을 연구진이 수립하였고 2차에 걸친 전문가 타당화를 통해 수정, 보완하여 평가 기준안을 개발하였다. 마지막으로, 이와 같이 개발된 평가 기준안을 실제 온라인 탐구 과제 24종에 적용하여 과제별 평가 루브릭을 개발하였으며, 이 과정에서 수정, 보완할 영역을 도출하고, 개선하여 최종 평가 기준안을 완성하였다. 본 연구에서 개발한 평가 기준안은 평가문제가 평가하고자 하는 내용과 함께 그 문제가 요구하는 사고기능이 무엇인지 확인함으로써 내용 영역의 학습과 함께 사고기능의 개발효과를 확인할 수 있는 평가준거가 될 것이며, 다양한 탐구 중심의 학습 방법과 과학적 사고력, 과학적 문제 해결력 등의 핵심역량을 요구하는 교육 현장에 유용하게 활용될 수 있을 것이다.

Keywords

References

  1. Anderson, L. W & Krathwohl, D. R. (Eds). (2001). A taxonomy for learning teaching and assessing A revision of Bloom's Taxonomy of Educational Objectives (Complete ed.). New York: Longman.
  2. Bloom, B Engelhart, M. D., J, Hill, w. H., & Krathwohl, D. R. (1956). Taxonomy of educational objectives: The classification of educational goals. Handbook Cognitive domain. White Plains, NY: Longman.
  3. Brookhart, S. M. (2010) How to assess higher order thinking skills in your classroom. ASCD product#109111
  4. Cho, H. (2014). Theory of Science Education. Seoul: Kyoyookbook..
  5. Cho, H., & Choi, K. (2008). Theory and Practice of Science Education (2nd ed). Seoul: Kyoyookbook..
  6. Cho, Y., Choi, K., & Cho, D. (1997). Focusing on the 6th national curriculum, textbooks, teacher's guide and classroom observations = A study for the elementary science curriculum to enhance creative problem solving abilities. The Journal of Elementary Education, 11(1), 185-211.
  7. Davis, G. A., Rimm, S., & Siegle, D. (2011). Education of the Gifted and Talented (6th ed). (Translated by Lee, M., Ryu, J., Lee, Y., Lee, H., and Chae, Y.). Seoul: Bakhaksa.
  8. Huh, K., Kim, H., Cho, Y., Im, S.(1990). A Study of Thinking Ability Development Program(IV). KEDI Research Report, RR 90-17.
  9. Kim, H. & Song, J. (2003). Middle School Students' Ideas about the Purposes of Laboratory Work. Journal of the Korean Association for Research in Science Education, 23(3), 254-264.
  10. Kim, Y. (2002). Thinking & Problem Solving Psychology. Seoul: Parkyoungsa.
  11. Kim, Y. & Kim, Y. (2012). The Development of a Free-response Test for the Assessment of Science Process Skills. Biology Education, 40(1), 167-177. https://doi.org/10.15717/bioedu.2012.40.1.167
  12. Kim, K., Kim, A., & Cho, S. (1997). Conceptualization of Creative Problem Solving for the Development of Curriculum for School Subjects. The Journal of Curriculum Studies, 15(2),129-153.
  13. Lee, B., Son, J., & Jung, H. (2006). The development of an online scientific inquiry learning system. The Korean Society of Elementary Science Education, 25(3), 271-280.
  14. Lee, J., & Jeong, E. (2013). Development of an Evaluation Tool for Assessing Scientific Thinking Ability Using Science Writing. Teacher Education Research, 52(3), 575-588. https://doi.org/10.15812/ter.52.3.201312.575
  15. Lee, S., Chae, Y., & Sung, E.(2017). A Comparison study of self-directed learning competency between high-achiever of high school students and gifted learners. Journal of Gifted/Talented Education, 27(2), 123-137. https://doi.org/10.9722/JGTE.2017.27.2.123
  16. Lee, S, Kim, I. (2010). The development of assessment tool about science inquiry performance ability based on science gifted students. Journal of Science and Science Education 26(1), 25-39.
  17. Lee, S., You, M., & Choi, B. (2008). The differences of attribution tendency and self-regulated learning strategy between gifted students and general students in elementary School. Journal of Gifted/Talented Education, 18(3), 425-442.
  18. Lee, S, & Hong, J. (2011). A comparison of psychological, physical and environmental characteristics of the general students and gifted students, and among gifted students' specific gifted areas. The Korea Educational Review, 17(1), 351-371.
  19. Lee, Y., Park, J., & Lee, B.(2004). Analysis and Evaluation of the Science Content Relevance in the National Science Curriculum. RRC 2004-1-6, Korea Institute of Curriculum and Evaluation.
  20. Lim, B. (2003). Experiences of college students in online inquiry-based learning environment: Implications for design of inquiry on the web. Journal of Educational Technology, 19(3), 69-99. https://doi.org/10.17232/KSET.19.3.69
  21. Linn, M. C., Davis, E. A., & Bell, P. (2004). Internet environments for science education. Lawrence Erlbaum.
  22. Ministry of Education. (2015). Elementary education curriculum. Notification No. 2007-74 of MOE. Seoul: MOEHRD.
  23. Orpwood, G. (2001). The role of assessment in science curriculum reform. Assessment in Education, 8(2), 135-151. https://doi.org/10.1080/09695940125120
  24. Park, I. (2010). Development and implementation of science programs enhancing creative problem solving skills applying meta-cognition. Unpublished Doctoral Dissertation, Ewha Womans University.
  25. Park, I. & Kang, S. (2011). Science Teachers' Perceptions on Scientific and Creative Problem Solving. Journal of the Korean Association for Research in Science Education, 31(2), 314-327.
  26. Park, I. & Kang, S. (2012). The Development of Assessment Tools to Measure Scientific Creative Problem Solving ability for Middle School Students. Journal of the Korean Association for Research in Science Education, 32(2), 210-235. https://doi.org/10.14697/jkase.2012.32.2.210
  27. Park, H. & Kim, Y. (2013). Correlations between Scientific Knowledge, Science Process Skill, Creativity, and Science Related Attitudes of the Gifted Middle School Students in Science, Biology Education, 41(3), 459-469. https://doi.org/10.15717/bioedu.2013.41.3.459
  28. Park, K., Ryu, C., & Choi, J. (2017). An Analysis of Learning Objective Characteristics of Educational Programs of Centers for the University Affiliated Science-Gifted Education Using Semantic Network Analysis. Journal of Gifted/Talented Education, 27(1), 17-35. https://doi.org/10.9722/JGTE.2017.27.1.17
  29. Shin, J., Min, J., Kim, S., & Kwon, S. (2013). The Principles of Effective Higher-Thinking Programs and Limitations of Their Implementation in Schools. The Korean Journal of Thinking & Problem Solving, 9(2), 71-98.
  30. Son, J. (2006). A Science Writing Teaching Method Based on Scientific Thinking for Improving Scientific Essay Writing Ability. The Journal of Curriculum and Evaluation, 9(2), 333-355.
  31. Song, S., Kil, J., & Shim, K. (2015). A Case Study on the Evaluation of Scientific Inquiry Ability of Elementary Scientifically Gifted Students : Observing and Inferring, Designing an Experiment, and Concluding. Journal of Science Education, 39(3), 376-388. https://doi.org/10.21796/jse.2015.39.3.376
  32. Sung, I., Kwak, B., Park, T., Im, S., Yang, M., Han, S., Kim, J., & Yi, H. (1987). A study of thinking ability development program. KEDI Research Report RR 87-37.
  33. Weisberg, R. W. (2009). Creativity (Translated by Kim, M.). Seoul: Sigma Press.
  34. Yang, T. (2003). A comparative study on cognitive and affective characteristics of scientifically gifted and non-gifted students. Graduate School, Incheon National University, Master's thesis.