Educational Technology International

The Korean Society for Education Technology (한국교육공학회)
권호 표지
DOI QR코드

DOI QR Code

Development of a Structured Debriefing for Business Simulation Games and Its Effect on College Students' Business Knowledge and Entrepreneurship Competencies

  • Received : 2024.03.11
  • Accepted : 2024.04.16
  • Published : 2024.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study evaluates the effect of structured debriefing for a business simulation game for university students. The program provides an authentic learning experience of real-world business management by allowing learners to make decisions related to R&D, marketing, production, and finance through a business simulation game, and check the results in real time. In 2022, University A and B each ran a business simulation game-based program as an extra-curricular activity. University A conducted a traditional instructor-led debriefing where the instructor explained the summarized process and results, while University B implemented a structured debriefing which had been developed based on Gibbs' and 3D models. To assess the effect of the structured debriefing compared to the traditional instructor-led debriefing, business knowledge and entrepreneurship competencies were measured three times. Repeated measures ANOVA was used to test for the differences between the two groups and to examine interaction effects between group and time. The structured debriefing group achieved statistically significantly higher academic scores than the traditional instructor-led debriefing group at the post-test and in 2 weeks. There was no statistically significant difference between the groups in terms of entrepreneurship competencies. There was no interaction effect between group and time, both in academic achievement and in entrepreneurship competencies. In conclusion, the simulation game-based program integrated with the structured debriefing session is more likely to have a stronger impact on academic achievement and its retention.

Keywords

References

  1. Ahn, M., Yeom, J., Kim, S., & Jung, J. (2020). A systematic literature review of game-based learning and educational gamification design research trends in korea. Journal of Korean Association for Educational Information and Media, 26(3), 425-454. https://doi.org/10.15833/KAFEIAM.26.3.425
  2. Bacigalupo, M., Compylis, P., Punie, Y. & Brande, G. (2016). Entrecomp: The entrepreneurship competence frameworks. Publication Office of the European Union.
  3. Ben-Zvi, T., & Carton, T. C. (2008). Applying Bloom's revised taxonomy in business games. Developments in Business Simulation and Experiential Exercises, 35, 265-272.
  4. Bian, J., Yoon, G., & Lee, J. (2021). The relationship between satisfaction of educational experience and entrepreneurial intention: Focusing on the mediating effect of entrepreneurship competence and differences in college affiliated groups. Journal of the Korean Entrepreneurship Society, 16(4), 112-140.
  5. Boet, S., Bould, M. D., Bruppacher, H. R., Desjardins, F., Chandra, D. B., & Naik, V. N. (2011). Looking in the mirror: self-debriefing versus instructor debriefing for simulated crises. Critical Care Medicine, 39(6), 1377-1381. https://doi.org/10.1097/CCM.0b013e31820eb8be
  6. Boet, S., Bould, M. D., Sharma, B., Revees, S., Naik, V. N., Triby, E., & Grantcharov, T. (2013). Within-team debriefing versus instructor-led debriefing for simulation-based education: A randomized controlled trial. Annals of Surgery, 258(1), 53-58. https://doi.org/10.1097/SLA.0b013e31829659e4
  7. Choi, H., & Kim, J. (2023). Comparison of clinical competence, problem-solving, self-efficacy and satisfaction of self and peer-led debriefing in simulation nursing education. Korean Association for Learner-Centered Curriculum and Instruction, 23(11), 339-351. https://doi.org/10.22251/jlcci.2023.23.11.339
  8. Decker, S., Alinier, G., Crawford, S. B., Gordon, R. M., Jenkins, D., & Wilson, C. (2021). Healthcare simulation standards of best practiceTM The debriefing process. Clinical Simulation in Nursing, 58, 27-32. https://doi.org/10.1016/j.ecns.2021.08.011
  9. Deterding, S., Sicart, M., Nacke, L., O'Hara, K., & Dixon, D. (2011, May 7-12). Gamification. using game-design elements in non-gaming contexts [Conference session]. In CHI'11 extended abstracts on human factors in computing systems, Vancouver, BC, Canada.
  10. Dreifuerst, K. T. (2012). Using debriefing for meaningful learning to foster development of clinical reasoning in simulation. Journal of Nursing Education, 51(6), 326-333.
  11. Eun, Y., & Bang, S. (2016). Effects of the Lasater's clinical rubric of debriefing in advanced cardiovascular life support training. The Journal of the Korea Contents Association, 16(4), 516-527. https://doi.org/10.5392/JKCA.2016.16.04.516
  12. Fanning, R. M., & Gaba, D. M. (2007). The role of debriefing in simulation-based learning. Simulation in Healthcare, 2(2), 115-125. https://doi.org/10.1097/SIH.0b013e3180315539
  13. Flanagan, B. (2008). Debriefing: theory and techniques. Manual of Simulation in Healthcare, 155, 70.
  14. Fraser, K., & McLaughlin, K. (2019). Temporal pattern of emotions and cognitive load during simulation training and debriefing. Medical Teacher, 41(2), 184-189. https://doi.org/10.1080/0142159X.2018.1459531
  15. Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441-467. https://doi.org/10.1177/1046878102238607
  16. Gibbs, G. (1988). Learning by doing: A guide to teaching and learning methods. Further Education Unit.
  17. Ha, E., & Song, H. (2015). The effects of structured self-debriefing using on the clinical competency, self-efficacy, and educational satisfaction in nursing students after simulation. The Journal of Korean Academic Society of Nursing Education, 21(4), 444-453.
  18. INACSL Standards Committee (2016). INACSL standards of best practice: SimulationSM debriefing. Clinical Simulation in Nursing, 12(S), S21-S25. https://doi.org/10.1016/j.ecns.2016.09.008
  19. Jansson, M. M., Syrjala, H. P., Ohtonen, P. P., Merilainen, M. H., Kyngas, H. A., & Ala-Kokko, T. I. (2017a). Effects of simulation education on oral care practices-a randomized controlled trial. Nursing in Critical Care, 22(3), 161-168. https://doi.org/10.1111/nicc.12276
  20. Jansson, M. M., Syrjala, H. P., Ohtonen. P. P., Merilainen, M. H., Kyngas, H. A., & Ala-Kokko, T. I. (2017b). Longitudinal effects of single-dose simulation education with structured debriefing and verbal feedback on endotracheal suctioning knowledge and skills: a randomized controlled trial. American Journal of Infection Control, 45(1), 83-85. https://doi.org/10.1016/j.ajic.2016.05.032
  21. Jeong, K., & Choi, J. (2017). Effect of debriefing based on the clinical judgment model on simulation-based learning outcomes of end-of-life care for nursing students: A non-randomized controlled trial. Journal of Korean Academy of Nursing, 47(6), 842-853. https://doi.org/10.4040/jkan.2017.47.6.842
  22. Kim, E., Kim, Y., & Moon, S. (2017). Nursing students' perceptions of meaning, response, and effective methods for debriefing in simulation-based education. Journal of Korean Academy of Fundamentals of Nursing, 24(1), 51-59. https://doi.org/10.7739/jkafn.2017.24.1.51
  23. Kim, N., & Kim, Y. (2023). The effects of debriefing utilizing the clinical judgment model in simulation-based korean advanced life support training for nursing students. Journal of the Korea Academia-Industrial cooperation Society, 24(8). 32-43.
  24. Kim, S. (2016). Design and implementation of socket-based multi-player game service for elementary mathematics learning. Journal of Service Research and Studies, 6(2), 175-184. https://doi.org/10.18807/JSRS.2016.6.2.175
  25. Kim, S., & Kim, Y. (2016). An empirical study on the educational effects and success factors of a business simulation game. Korean Business Education Review, 31(6), 281-309. https://doi.org/10.23839/kabe.2016.31.6.281
  26. Kim, S., & Rim, S. (2016). An empirical study on the educational effect of business simulation game. Information Systems Review, 8(2), 173-188.
  27. Kim, Y. (2016). A study on the success factors and development methodology for educational business simulation games [Unpublished doctoral dissertation, Hanyang University].
  28. Kolb, D. A. (1984). Experiential learning as sources of learning and development. Englewood Cliffs.
  29. Kriz, W. C. (2010). A systemic-constructivist approach to the facilitation and debriefing of simulations and games. Simulation & Gaming, 41(5), 663-680. https://doi.org/10.1177/1046878108319867
  30. Lacruz, A. J., & Americo, B. L. (2018). Debriefing's influence on learning in business game: An experimental design. Brazilian Business Review, 15, 192-208. https://doi.org/10.15728/bbr.2018.15.2.6
  31. Lapum, J. L., Verkuyl, M., Hughes, M., Romaniuk, D., McCulloch, T., & Mastrilli, P. (2019). Self-debriefing in virtual simulation. Nurse Educator, 44(6), E6-E8.
  32. Lasater, K. (2007). Clinical judgment development: Using simulation to create an assessment rubric. Journal of Nursing Education, 46(11), 496-503. https://doi.org/10.3928/01484834-20071101-04
  33. Lasater, K. (2011). Clinical judgement: The last frontier for evaluation. Nurse Education in Practice, 11(2), 86-92.
  34. Lee, K. (2022). The effects of applying debriefing for meaningful learning(DML) in simulation education. Journal of the Society of Next Generation Convergence Technology, 6(2). 369-38.
  35. Lee, J., Lee, H., Kim, S., Choi, M., Ko, I., Bae, J., & Kim, S. (2020). Debriefing methods and learning outcomes in simulation nursing education: A systematic review and meta-analysis. Nurse Education Today, 87, 104345.
  36. Mariani, B., Cantrell, M. A., Meakim, C., Prieto, P., & Dreifuerst, K. T. (2013). Structured debriefing and students' clinical judgment abilities in simulation. Clinical Simulation in Nursing, 9(5). 147-155.
  37. Morse, K. J. (2015). Structured model of debriefing on perspective transformation for NP students. Clinical Simulation in Nursing, 11(3), 172-179. https://doi.org/10.1016/j.ecns.2015.01.001
  38. Moreno-Ger, P., Burgos, D., Martinez-Ortiz, I., Sierra, L. J., & Fernandez-Manjon, B. (2008). Educational game design for online education. Computers in Human Behavior, 24(6), 2530-2540.
  39. Oh, Y., Kang, H., Song, Y., & Lindquist, R. (2021). Effects of a transformative learning theory based debriefing in simulation: A randomized trial, Nurse Education in Practice, 50, 102962.
  40. O'donnell, J., Rodgers, D., Lee, W., Edelson, D., Haag, J., Hamilton, M., Hoadley, T., McCullough, A., & Meeks, R. (2009). Structured and supported debriefing. American Heart Association.
  41. Peters, V., & Vissers, G. (2004). A simple classification model for debriefing simulation games. Simulation & Gaming, 35(1), 70-84. https://doi.org/10.1177/1046878103253719
  42. Rudolph, J. W., Simon, R., Raemer, D. B., & Eppich, W. J. (2008). Debriefing as formative assessment: Closing performance gaps in medical education. Academic Emergency Medicine, 15(11), 1010-1016.
  43. Sheckley, B., Kehrhahn, M., Bell, S., & Grenier, R. (2008, December 17). Trio: An emerging model of adult professional learning [Conference session]. Adult Education Research Conference, University of Missouri, St. Louis., United States.
  44. Son, H. (2022). Effects of team-based debriefing in simulation on clinical judgement, critical thinking and learning satisfaction of undergraduate health profession students. Korean Journal of Safety Culture, -(19), 143-154
  45. Song, C., Lee, H., & Yoon, S. (2021). The effects of peer-led group debriefing utilizing video recording for simulation education on clinical performance, satisfaction on simulation session and debriefing. The Journal of Learner-Centered Curriculum and Instruction, 21(15), 781-792.
  46. Song, T., & Park, S. (2022). Effectiveness of debriefing in simulation-based education for nursing students: A systematic review and meta-analysis. The Korean Journal of Fundamentals of Nursing, 29(4), 399-415. https://doi.org/10.7739/jkafn.2022.29.4.399
  47. Spencer, L. M., & Spencer, S. M. (1993). Competence at work: Models for superior performance. New York.
  48. Tovar, E., Tabuenca, B., & Piedra, N. (2020, April 27-30). EntreCom4ALL MODEL to sustain the entrepreneurship competence needs [Conference session]. 2020 IEEE Global Engineering Education Conference (EDUCON), Porto, Portugal.
  49. Van Der Meij, H., Leemkuil, H., & Li, J. L. (2013). Does individual or collaborative self-debriefing better enhance learning from games? Computers in Human Behavior, 29(6), 2471-2479. https://doi.org/10.1016/j.chb.2013.06.001
  50. Verkuyl, M., Atack, L., McCulloch, T., Liu, L., Betts, L., Lapum, J. L., Hughes, M., Mastrilli, P., & Romaniuk, D. (2018). Comparison of debriefing methods after a virtual simulation: An experiment. Clinical Simulation in Nursing, 19, 1-7. https://doi.org/10.1016/j.ecns.2018.03.002
  51. Wotton, K., Davis, J., Button, D., & Kelton, M. (2010). Third-year undergraduate nursing students' perceptions of high-fidelity simulation. Journal of Nursing Education, 49(11), 632-639.
  52. Yun, J. (2020). Development and effect of collaborative-based reflection debriefing of virtual simulation in nursing practice education [Unpublished doctoral dissertation, Busan University].
  53. Yun, J., & Son, M. (2022). Effects of debriefing method of simulation nursing practical education; systematic review. Journal of Korea Academia-Industrial Cooperation Society, 23(10), 593-604. https://doi.org/10.5762/KAIS.2022.23.10.593
  54. Zigmont, J. J. (2010). How paramedics learn: The role of experience, mental models, and analogical reasoning. University of Connecticut.
  55. Zigmont, J. J., Kappus, L. J., & Sudikoff, S. N. (2011). The 3D model of debriefing: Defusing, discovering, and deepening. Seminars in Perinatology, 35(2), 52-58.  https://doi.org/10.1053/j.semperi.2011.01.003