Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

Development and Validation of a Situational Judgment Test for a Competencey of Public Ethics: A Case of an University in South Korea

대학생 상황판단형 공적윤리 역량 진단도구 개발과 타당화: S대학교를 중심으로

  • 송영숙 (숭실대학교 베어드학부대학)
  • Received : 2015.03.20
  • Accepted : 2015.07.16
  • Published : 2015.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper aims to develop and validate a situational judgement test to diagnose the Competencey of public ethics for undergraduates. A criterion group composing of high performers was formed. Critical incidents and responses were developed from interviews with members of the criterion group. Also an expert committee was composed of six university members who have professional knowledge and experience on Competencey based selection or education. This committee reviewed all the items developed and selected some of them for the final test. Item validity and reliability were examined through the final test that 519 college students took. The result of the confirmatory as well as exploratory factor analysis showed that the Competencey of public ethics consisted of 2 sub-elements which were work ethics and democratic citizenship. The correlation between results of the test and the HEXACO model was statistically significant. Overall, the findings of the study highlight that a situational judgement test can be developed and utilized to diagnose Competencey levels of public ethics for undergraduates.

본 연구의 목적은 S대학교 사례에 기초하여 대학생 상황판단형 공적윤리 역량 진단도구를 개발하고, 개발된 진단도구의 타당성을 검증하는 것이다. 이를 위해 준거집단과 전문가 위원회를 구성하고, 중요 상황 수집과 상황 시나리오를 개발하였다. 또한 반응대안 개발과 가중치 추출을 실시하고, 519명의 학생들을 대상으로 본 조사를 실시하여 진단도구에 대한 타당도 분석을 수행하였다. 탐색적 요인분석과 확인적 요인분석결과 2개 요인으로 수렴되었으며, 구조모형의 적합성을 확인하였다. 또한, 기존에 공인된 HEXOCO 성격검사의 정직/겸손성 요인과의 상관분석 결과, 공적윤리 역량의 세부 역량은 정직/겸손성 요인의 하위요인 모두와 통계적으로 유의한 상관을 나타내고 있어 공적윤리 역량 측정도구는 개인의 윤리적 행동과 공공성의 특성파악에 유용하다는 것을 확인하였다. 이와 같은 결과는 대학생들이 인격과 지성을 겸비한 우수 인재로 성장하기 위해 필수적인 공적윤리역량을 진단하는 데 있어 상황판단형 역량진단도구를 대학의 특성에 맞도록 개발하여 학생의 선발이나 역량개발, 교육과정 개편, 교육프로그램 효과 분석 등에 다양하게 활용하는데 시사점을 제시하고 있다.

Keywords

References

  1. J. Y. Choi and J. E. Chae, "OECD Higher Education Learning Outcomes Assessment Project Study (V): 2009-2013 Comprehensive Feasibility Evaluation", The Korea Educational Development Institute, 2013.
  2. M. S. Jin, Y. M. Sohn, and H. J. Chu, "A Study on Development Plan of K-CESA for College Education Assessment", The Journal of Educational Administration, 29(4), pp.461-486, 2011.
  3. S. Y. Kim and H. J. Yu, "Development and validation of the Essential Competency Assessment of Vocation for Local College Students", Korean Journal of Human Resource Development, 15(4), pp.71-100, 2013. https://doi.org/10.18211/kjhrdq.2013.15.4.004
  4. Y. S. Noh and S. S. Lee, "Developing and Validating the Instrument for Diagnosing the Competency of University Students : A Case Study of D Women's University", Journal of Human Resource Development, 15(3), pp.273-305, 2013
  5. D. Holmquist, "Ethics-How Important is it in Today's Office?" Public Personnel Management, 22(4), pp.537-544, 1993. https://doi.org/10.1177/009102609302200403
  6. Y. G. Lee, "Empirical Analysis and Policy Directions of Ethics Training to Public Servants: Focusing on the Case Study of Seongnam City", Society and Public Administration, 14(1), pp.47-76, 2003.
  7. B. W. Kim, "A Review on Confucian Ethics in Search of a Kong Ethics", The Korean Ethics Studies Association. 57, pp.327-357. 2004.
  8. Y. B. Lee, "The Vocational Ethics Required in Contemporary Society-Focused on Minimal Morality Based on Individualism", Master Degree Thesis of Sungkyunkwan University, 2001.
  9. U. Lim, C. S. Park, and J. H. Choi, "The Korean Professionalism and Work Ethic", Korea Research Institute for Vocational Education and Training, 2010.
  10. D. H. Lee, "A Study on the Determinants of Work Ethic : The Influence of Personal Characteristics, Socialization, and Job-Related Characteristics", Korea Business Review, 24(3), pp265-300, 1995.
  11. K. H. Kim, J. Y. Lee, and Y. K. Jung. "A Study on the Korean Work Ethic", The Korea Research Institute for Vocational Education and Training, 1999.
  12. W. R. Nord, A. P. Brief, J. M. Atieh, and E. M. Doherty, "Work Values and The Conduct of Organizational-Behavior". Research in Organizational Behavior, 10, pp.1-42, 1988. https://doi.org/10.1016/0167-2681(88)90025-X
  13. J. Greenberg, "Protestant Ethic Endorsement and Attitudes toward Commuting to Work among Mass Transit Riders", Journal of Applied Psychology, 63(6), pp. 755-758, 1978. https://doi.org/10.1037/0021-9010.63.6.755
  14. R. J. Aldag, and A. P. Brief, "Some Correlates of Work Values", Journal of Applied Psychology, 60(6), pp.757-760, 1975. https://doi.org/10.1037/0021-9010.60.6.757
  15. E. F. Stone, "The Moderating Effect of Work-related Values on the Job Scope-Job Satisfaction Relationship", Organizational Behavior and Human Performance, 15, pp.147-167, 1976. https://doi.org/10.1016/0030-5073(76)90034-9
  16. H. W. Na, "The Effects of a Participation in Self-Governing Activity Program on Democratic Citizenship of Students in Innovation School", Master Degree Thesis of Ewha Womans University, 2013.
  17. D. S. Park and K. Y. Kim, "Korean Democratic Citizenship: the Public and the Elite," Seoul National University Press, 1989.
  18. B. Frattczak-Rudnicka, and J. Torney-Purta, "Competencies for Civic and Political Life in Democracy", In Rychen, D. S., L. H. Salganik, and M. E. McLaughlin (Eds.), Contributions to the Second DeSeCo Symposium, Geneva, Switzerland, February 11-13, 2002.
  19. T. J. Kim, "Korea Citizenship Status and Educational Implications: Focusing on the Criticism and Respect for Diversity Consciousness", The Korea Educational Development Institute, 2004.
  20. Bureau of Public Information, "Citizenship International Comparative Survey," Bureau of Public Information, 1997.
  21. T. J. Kim, A. N. Kim, N. H. Kim, B. J. Lee and J. Han,(2003), "This Study Measured in Terms of Citizenship and Social Capital," The Korea Educational Development Institute, 2003.
  22. E. L. Chi, "Validating the Scale of Global Citizenship and Examining the Related Variables," Research of Educational Evaluation, 20(2), pp.151-172, 2007.
  23. T. J. Kim, I. S. Jun, J. I. Byoun, H. S. Jang, J, C, Ban, and Y. H. Cho. "Civic Competence of Korea Youth International Comparative Study: International Civic Education Study (ICCS) Participation". The Korea Educational Development Institute, 2010.
  24. K. A. Son, H, G, Lee, I. N. Ok, and Y. K. Park, "The research status of school civic education," Future Korea Foundation, 2009.
  25. Korea University News(2005), "Korea, China, Japan, the Three Countries of Citizenship, Compared to College," Korea University News, 2005.2.15., http://www.unn.net/
  26. J. A. Weekley, & R. E. Ployhart,(Ed.). "Situational Judgement Test: Theory, Measurement, and Application", Mahwah, NJ:Lawrence Erlbaum Associates, Inc. 2006.
  27. F. A. Moss, "Do You Know How to Get Along with People? Why Some People Get Ahead in the World While Others Do Not", Scientific American, 135, pp.26-27, 1926. https://doi.org/10.1038/scientificamerican0726-26
  28. M. A. McDaniel, and N. T. Nguyen, "Situational Judgment Tests: A Review of Practice and Constructs Assessed", International Journal of Selection and Assessment, 9(1/2), pp.103-113, 2001. DOI: http://dx.doi.org/10.1111/1468-2389.00167
  29. E. S. Kim, Y. S. Han, and M. S. Kim, "Comparison of Validities for Scoring Keys and Scoring Algorithms in Situational Judgment Test: The Influence of Faking", The Korean Journal of Industrial and Organizational Psychology, 24(1), pp.231-255, 2011. https://doi.org/10.24230/ksiop.24.1.201102.231
  30. J. J. Namgung, S. M. Lee, and H. S. Kim, "Exploratory Factor Analysis on Situational Judgment Data after Controling for Scenario Effect", The Korean Journal of Industrial and Organizational Psychology, 26(4), pp.599-624, 2013. https://doi.org/10.24230/ksiop.26.4.201311.599
  31. S. C. Lee, S. M. Lee, and Y. I. Cho, "Critical Review on Paper and Pencil Situational Judgement Test", The Korean Journal of Industrial and Organizational Psychology, 16(3), pp.129-154, 2003.
  32. Y. M. Choi, "Development and Validation of Collegiate Teamwork Competency Test", Journal of Vocational Education, 30(2), pp.173-196, 2011.
  33. H. S. Kim, "Development and Validation of a Situational Judgment Test Measuring Creative Personality for College Students", Master Degree Thesis of Sungkyunkwan University, 2013.
  34. R. E. Ployhart, and M. G. Ehrhart, "Be Careful What You Ask for: Effects of Response Instructions on the Construct Validity and Reliability of Situational Judgment Tests", International Journal of Selection and assessment, 11(1), pp.1-16, 2003. https://doi.org/10.1111/1468-2389.00222
  35. J. C. Flanagan, "The Critical Incident Technique", Psychological Bulletin, 51(4), p.327, 1954. https://doi.org/10.1037/h0061470
  36. D. J. Knapp, C. H. Campbell, W. C. Borman, and E. D. Pulakos, "Performance Assessment for a Population of Jobs". In J. P. Campbell and D. J. Knapp(Eds.), Exploring the Limits in Personnel Selection and Classification. Mahwah, NJ:Lawrence Erlbaum Associates, Inc. 2001.
  37. M. U. Kang, C. Y. Min, and S. M. Lee, " Comparison of Validities of Different Response Instructions and Scoring Alternatives in Situational Judgement Test", Korean Journal of Industrial and Organizational Psychology, 18(3), pp.547-565, 2005.
  38. H S. Chung, and D. G. Park, "The study of Criterion-related Validities of Different Combinations of Keying and Scoring Methods in Situational Judgement Test with Knowledge Instructions", Korean Journal of Industrial and Organizational Psychology, 22(1), pp.53-70, 2009. https://doi.org/10.24230/ksiop.22.1.200902.53