Browse > Article
http://dx.doi.org/10.14697/jkase.2014.34.1.1.0001

Over-Efficacy in Problem Solving and Overconfidence of Knowledge on Photosynthesis: A Study of Comparison Between Multiple-Choice and Supply-Type Test Formats  

Ha, Minsu (State University of New York at Stony Brook)
Lee, Jun-Ki (Chonbuk National University)
Publication Information
Journal of The Korean Association For Science Education / v.34, no.1, 2014 , pp. 1-9 More about this Journal
Abstract
This study aimed to explore the over-efficacy in problem solving and overconfidence of knowledge of students performing assessments in two different test formats: multiple-choice and supply-type. Two hundred and four female middle school students participated in this study. Multiple-choice and supply-type formats of tests on photosynthesis were used, and each item contained scales indicating one's self-efficacy on problem-solving and confidence of knowledge. The results showed that the correlation coefficients of performance between the two different assessment formats were less than 0.5 and the correlation coefficients between efficacy/confidence and actual performance were less than 0.45. Moreover, students tended to exhibit more over-efficacy and overconfidence in multiple-choice formats. The percentage of over-efficacy and overconfidence was higher in the group that completed the multiple-choice test first followed by the supply-type assessment than in the group that started with the supply-type followed by the multiple-choice assessment. From this study, it can be suggested that more use of supply-type assessment is required in science education. If test administrators require the combination of both multiple-choice and supply-type in an assessment, the supply-type assessment format should come first so that students can maintain the appropriate level of efficacy and confidence. In addition, science educators need to develop new learning programs to enhance students' self-monitoring skills of their problem-solving ability and knowledge.
Keywords
over-efficacy; overconfidence; assessment format; multiple-choice test; supply-type test;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Dunlosky, J., & Rawson, K. A. (2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students' learning and retention. Learning and Instruction, 22(4), 271-280.   DOI   ScienceOn
2 Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
3 Beggrow, E. P., Ha, M., Nehm, R. H., Pearl, D., & Boone, W. J. (in press). Assessing scientific practices using machine-learning methods: How closely do they match clinical interview performance? Journal of Science Education and Technology.
4 Bruttomesso, D., Gagnayre, R., Leclercq, D., Crazzolara, D., Busata, E., d'Ivernois, J. F., Casiglia, E., & Baritussio, A. (2003). The use of degrees of certainty to evaluate knowledge. Patient Education and Counseling, 51(1), 29-37.   DOI   ScienceOn
5 Choi, K., Lee, H., Shin, N., Kim, S. W., & Krajcik, J. (2011). Reconceptualization of scientific literacy in South Korea for the 21st century. Journal of Research in Science Teaching, 48(6), 670-697.   DOI   ScienceOn
6 de Bruin, A. B., & van Gog, T. (2012). Improving self-monitoring and self-regulation: From cognitive Psychology to the classroom. Learning and Instruction, 22(4), 245-252.   DOI   ScienceOn
7 Ha, M., Haury, L. D., Nehm, R. H. (2012). Feeling of certainty: Uncovering a missing link between knowledge and acceptance of evolution. Journal of Research in Science Teaching. 49(1), 95-121.   DOI   ScienceOn
8 Ha, M., Nehm, R. H., Urban-Lurain, M. & Merrill, J. E. (2011). Applying computerized scoring models of written biological explanations across courses and colleges: Prospects and limitations. CBE-Life Science Education, 10, 379-393.
9 Hong, M. Y., Park, C., & Kim, S. (2001). An analysis of science achievement of the third international mathematics and science study-repeated(TIMSS-R). Journal of the Korean Association for Research in Science Education, 21(2), 328-341.(in Korean)   과학기술학회마을
10 Johnson, D. D., & Fowler, J. H. (2011). The evolution of overconfidence. Nature, 477(7364), 317-320.   DOI   ScienceOn
11 Karpicke, J. D., & Blunt, J. R. (2011). Retrieval practice produces more learning than elaborative studying with concept mapping. Science, 331(6018), 772-775.   DOI   ScienceOn
12 Langendyk, V. (2006). Not knowing that they do not know: self-assessment accuracy of third-year medical students. Medical education, 40(2), 173-179.   DOI   ScienceOn
13 Lee, C. Y. (2011). Objective Test Allowing Multiple Choice for the Correct Answer with Penalty for Incorrect Choices. School Science Journal, 5(1), 17-26. (in Korean)   DOI
14 Kim, M, H., Noh, E. H., & Sim, J. H. (2013). The application of automatic scoring program to supply-type items of basic competency test. The Journal of Curriculum and Evaluation, 16(1), 137-160.(in Korean)
15 Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6(2), 107-118.   DOI
16 Lee, K. S. (2008). The dominance of objective examinations and the state intervention in Korea. Philosophy of Education, 34, 245-275.(in Korean)
17 Lipko, A. R., Dunlosky, J., Hartwig, M. K., Rawson, K. A., Swan, K., & Cook, D. (2009). Using standards to improve middle-school students' accuracy at evaluating the quality of their recall. Journal of Experimental Psychology: Applied, 15, 307-318.   DOI   ScienceOn
18 Luszczynska, A., Gutierrez-Dona, B., & Schwarzer, R. (2005). General selfefficacy in various domains of human functioning: Evidence from five countries. International Journal of Psychology, 40(2), 80-89.   DOI   ScienceOn
19 Marmaroti, P., & Galanopoulou, D. (2006). Pupils' understanding of photosynthesis: a questionnaire for the simultaneous assessment of all aspects. International Journal of Science Education, 28(4), 383-403.   DOI   ScienceOn
20 Nehm, R. H., & Schonfeld, I. S. (2008). Measuring knowledge of natural selection: A comparison of the CINS, an open-response instrument, and an oral interview. Journal of Research in Science Teaching, 45(10), 1131-1160.   DOI   ScienceOn
21 Opfer, J. E., Nehm, R. H., & Ha, M. (2012).Cognitive foundations for science assessment design: Knowing what students know about evolution. Journal of Research in Science Teaching, 49(6), 744-777.   DOI   ScienceOn
22 Nehm, R. H., Ha, M., & Mayfield, E. (2012). Transforming biology assessment with machine learning: Automated scoring of written evolutionary explanations. Journal of Science Education and Technology, 21(1), 183-196.   DOI
23 Nehm, R. H., Ha, M., & Mayfield, E. (2012). Transforming biology assessment with machine learning: Automated scoring of written evolutionary explanations. Journal of Science Education and Technology, 21(1), 183-196.   DOI
24 Nowell, C., & Alston, R. M. (2007). I thought I got an A! Overconfidence across the economics curriculum. The Journal of Economic Education, 38(2), 131-142.   DOI   ScienceOn
25 Oskamp, S. (1965). Overconfidence in case-study judgments. Journal of consulting psychology, 29(3), 261-265.   DOI   ScienceOn
26 Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational Research, 66, 543-578.   DOI   ScienceOn
27 Pajares, F., & Miller, M. D. (1997). Mathematics self-efficacy and mathematical problem solving: Implications of using different forms of assessment. The Journal of Experimental Education, 65(3), 213-228.   DOI   ScienceOn
28 Reach, G., Zerrouki, A., Leclercq, D., & d'Ivernois, J. F. (2005). Adjusting insulin doses: From knowledge to decision. Patient Education and Counseling, 56(1), 98-103.   DOI   ScienceOn
29 Park, C., & Hong, M. Y. (2002). A relative effectiveness of item types for estimating science ability in TIMSS-R. Journal of the Korean Association for Research in Science Education, 22(1), 122-131.(in Korean)   과학기술학회마을
30 Zakay, D., & Glicksohn, J. (1992). Overconfidence in a multiple-choice test and its relationship to achievement. The Psychological Record, 42(4), 519-524.
31 Schunk, D. H. (1991). Self-efficacy and academic motivation. Educational Psychologist, 26, 207-231.   DOI   ScienceOn
32 Yates, J. F., Lee, J. W., & Bush, J. G. (1997). General knowledge overconfidence: cross-national variations, response style, and "reality". Organizational behavior and human decision processes, 70(2), 87-94.   DOI   ScienceOn
33 Park, J. (2010). Constructive multiple choice testing system. British Journal of Educational Technology, 41(6), 1054-1064.   DOI   ScienceOn
34 Pallier, G. (2003). Gender differences in the self-assessment of accuracy on cognitive tasks. Sex Roles, 48(5-6), 265-276.   DOI   ScienceOn