Development of Evaluation Indicator on Industrial Safety and Health Education Program

산업장 안전보건교육 프로그램 평가지표 개발

  • Oh, Young-A (Department of Healthcare Management, Kyungwon University) ;
  • Lee, Myung-Sun (Department of Health Education & Management, Ewha Womans University)
  • Published : 2007.10.30

Abstract

Objectives: The purpose of this study was to verify the validity of the evaluation indicators on safety and health education programs provided to Korean industrial workers, by developing further. Methods: To develop the early evaluation indicator, the secondary analysis was made on 'Survey on Industrial safety & health trends', the national wide survey data product by Korea Occupational Safety & Health Agency, as well as the various examinations on literatures. To validate such developed evaluation indicator, 13 safety and health managers in Focus Group discussion to prove the reliability of the contents were composed. To confirm the face validity, the interview with 6 industrial safety and health education experts was held to study the appropriateness of the content. With the cooperation from Korea Occupational Safety & Health Agency, the structured survey was performed with the safety and health managers from 588 businesses who participated in the education program for the later half of 2006. In this study, the number of responses was randomly divided into 1:1 two groups, in which one group was for the Exploratory Factor Analysis and the other group was for the Confirmatory Factor Analysis. Results: The results were as follows. First, for the Structure category, 18 evaluation indicators were developed into 4 evaluation categories such as a preliminary examination, education staff and organization, education environment and rules/ regulation. Secondly, the Activity category was comprised of 10 evaluation indicators with respect to 2 areas of curriculum satisfaction and program evaluation. Finally, for the Output category, 9 evaluation indicators were developed into 2 evaluation areas such as documentation and information share and education effects. Conclusions: The evaluation indicators developed through this study will possibly develop and be applied to evaluation tools on safety and health education program, which may further become the standardized indicators to better operate the industrial safety and health education programs.

Keywords

References

  1. 강종철. 산업안전보건교육 실효성 제고방안에 관한 연구. 한국안전학회지 2005;20(1):144-147
  2. 김동철. 산업안전 보건교육체제의 개선에 관한 연구[석사학위논문]. 서울산업대학교 대학원, 2004
  3. 김동하, 고병인, 임현교. 건설현장 근로자 및 관리기사의 안전의식과 안전교육 효율화 방안. 한국산업안전학회지 1999;14(2):163-169
  4. 김미숙, 이동임, 김수원, 박종성, 이상준. 2000년도 직업능력개발 훈련기관 및 과정평가(민간부문). 서울: 한국직업능력개발원, 2000
  5. 김병숙, 김주섭, 김철희. 직업훈련기관 유형별 평가방안. 서울: 한국직업능력개발원, 1999
  6. 김철식, 송철기. 산업재해 분석을 통한 안전교육훈련의 개선에 관한 연구. 공학교육연구 2003;6(2):15-21
  7. 박태준. 직업교육 훈련프로그램 평가방안 연구. 서울: 한국직업능력개발원, 1998
  8. 배성규, 박동현. 인적 요인을 중심으로 하는 산업재해 평가 모델에 대한 연구. 산업안전학회지 2003;18(4):155-163
  9. 변종화, 문상식, 이주열, 남정자, 한영자, 문옥륜, 이규식. 국민건강증진기금사업의 운영 및 평가체계개발. 서울: 보건복지부, 1999
  10. 보건복지부. 건강증진거점보건소 기술지원평가단 1999년 사업보고서. 서울: 보건복지부, 2000
  11. 성태제. 현대교육평가. 학지사, 2002
  12. 성태제. 타당도와 신뢰도. 학지사, 2005
  13. 서준호, 서창교, 김현수, 고혜원. 2000년도 직업능력개발 훈련기관 및 과정평가(공공부문). 서울: 한국직업능력개발원, 2000
  14. 송정아. 중년기 부부관계 향상 프로그램 개발. 한국가정관리학회지 1997;14(1):113-130
  15. 송현종. 보건소 건강증진사업 평가지표 개발[박사학위논문]. 연세대학교 대학원, 2002
  16. 심규범. 건설현장 근로자들의 안전교육실태와 사고예방과의 관련요인 조사연구[석사학위논문]. 경희대학교 대학원, 2002
  17. 안덕현, 김수욱, 나승일, 변재면, 서규선, 이용환, 정철영. 농업인력 확보 및 육성방안 연구, 한국농업전문학교, 2001
  18. 양동주. 미국 등 주요선진국과 우리나라의 안전보건교육제도 비교연구. 안전보건 2001;51-57
  19. 오향순. 국내 종합병원 병원감염관리 현황 및 평가지표와 모형개발[박사학위논문]. 서울대학교 대학원, 2005
  20. 오혁진. 성인교육 프로그램에 대한 학습자의 평가준거 연구[박사학위논문]. 서울대학교 대학원, 2000
  21. 이관형, 박동현. 안전효능감과 산업재해의 관계분석. 산업안전학회지 1999;14(2):127-139
  22. 이명선, 박경옥, 이관형. 산업장 안전보건교육 관리요인. 한국보건교육건강증진학회지 2006;23(2):121-140
  23. 이윤혁, 이상도. 조선업 산업재해예방을 위한 안전의식 실태조사. 한국산업안전학회지 1998;13(1):119-130
  24. 장동민. 보건소의 지역보건 시범사업 평가모형 개발. 인제논집 2005;20(1):27-40
  25. 장현숙, 이태범, 남소영, 진영란. 방문보건사업 평가지표 개발. 보건행정학회지 2006;16(4):112-127 https://doi.org/10.4332/KJHPA.2006.16.4.112
  26. 지화승. 한국의 산업안전보건교육의 실효성 제고에 관한 연구[석사학위논문]. 가톨릭대학교대학원, 2005
  27. 한국산업안전공단. 외국인 근로자 안전보건 실태조사 연구. 인천: 한국산업안전공단, 2002
  28. 한국산업안전공단. 제조업 사업장의 안전문화 수준과 관련된 안전보건활동 요인분석. 인천:한국산업안전공단, 2005
  29. 한국산업안전공단. 사업장 안전보건수준 지수 개발 및 도입방안 모색(I). 인천: 한국산업안전공단, 2006
  30. Ahmad AA, Mohamed Z. Training Evaluation: An Empirical Study in Kuwait. Journal of European Industrial Training 2002;26(5):241-251 https://doi.org/10.1108/03090590210424911
  31. APHA(American Public Health Association). Healthy Communities 2000; Model Standards. Washington DC, 1990
  32. Bouzounis AC. A Most Valuable Proposition. Occupational Health & Safety 2006; 75(9):70-72
  33. Boyle PG. Planning Better Programs. New York: McGraw Hill, 1981
  34. Brinkerhoff RO. Achieving Results from Training. San Francisco: Jossey-Bass, 1988
  35. Caffarella R, O'donnell JM. Judging the Quality of Work related, Self directed Learning. Adult Education Quarterly 1991;42(1):98-110
  36. Carroll JB, McKenna J. Theory to Practice: Using the Logic Model to Organize and Report Research Results in a Collaborative Project. Journal of Family and Consumer Sciences 2001;93(4): 63-54
  37. Cheadle A, Sterling TD, Schmid TL, Fwacett SB. Promising Community Level Indicators for Evaluating Cardiovascular Health Promotion Program. Health Education Research 2000;15(1): 109-116 https://doi.org/10.1093/her/15.1.109
  38. Clarke S. Perception of Organizational Safety: Implications for Development Implications for the Development of Safety Culture. Journal of Organizational Behavior 1999;20: 195-198
  39. Cohen A, Colligan MJ. Assessing Occupational Safety and Health Training. Cincinnati: National Institute for Occupational Safety and Health, 1998
  40. Cohen A. Factors in Successful Occupational Safety Programs. Journal of Safety Research 1977
  41. Cohen A, Smith MJ. Self Protective Measures against Workplace Hazards. Journal of Safety Research 1975;11: 121-131
  42. Cromwell SE, Kolb JA. An Examination of Work-Environment Support Factors Affecting Transfer of Supervisory Skills Training to the Workplace. Human Resource Development Quarterly 2004; 15(4):449- 471 https://doi.org/10.1002/hrdq.1115
  43. Cromwell SE, Kolb JA. An Examination of Work-Environment Support Factors Affecting Transfer of Supervisory Skills Training to the Workplace. Human Resource Development Quarterly 2004; 15(4):449- 471 https://doi.org/10.1002/hrdq.1115
  44. Cuba E, Lincoln Y. Forth Generation Evaluation. Newbury Park: Sage, 1989
  45. Dehar MA, Casswell S, Duignam P. Formative and Process Evaluation of Health Promotion and Disease Prevention Programs. Evaluation Review 1993;17(2):204-220 https://doi.org/10.1177/0193841X9301700205
  46. Erickson JA. Uncovering Employees' Views About Safety. Occupational Hazards 1997;68(1):45-58
  47. Fink A. Evaluation Fundamentals: Guiding Health Programs, Research and Policy. Newbury Park: Sage publication, 1993
  48. Fisher EB, Auslander WF, Munro JF, Arfken CL, Brownson RC, Owens NW. Neighbors of Smoke Free North Side: Evaluation of a Community Organization Approach to Promoting Smoking Cessation among African American. American Journal of Public Health 1999
  49. Green LW, Kreuter MW. Health Promotion Planning: An Educational and Ecological Approach. Mayfield Publishing Company, Mountain View, 1999
  50. Gregg L. Worker Training: An Investment in Safety. Occupational Hazards 1991;53(8):23-26
  51. GRI(Global Reporting Initiative). Substantiality Reporting Guidelines, 2002
  52. Hahn CP. Development of Performance Evaluation and Selection Precedures for Cooperative Extension Service. USDA, 1979
  53. Hamblin AC. Evaluation and Control of Training. London: McGraw Hill, 1974
  54. Hare AP. Handbook of Small Group Research. New York: Free Press, 1976
  55. Hinze J, Gambatese J. Factors That Influence Safety Performance of Specialty Contractors. Journal of Construction Engineering and Management 2003; 129(2):159-164 https://doi.org/10.1061/(ASCE)0733-9364(2003)129:2(159)
  56. Huang TC. The Relation of Training Practices and Organizational Performance in Small and Medium Size Enterprise. Education & Training 2001; 43(8/9):437-444 https://doi.org/10.1108/00400910110411620
  57. Julian DA, Jones A, Deyo D. Open Systems Evaluation and the Logic Model: Program Planning and Evaluation Tools. Evaluation and Program Planning 1995;18(4):333-341 https://doi.org/10.1016/0149-7189(95)00034-8
  58. Karwowski W. Potential Applications of Fuzzy Sets in Industrial Safety Engineering. Fuzzy Sets and Systems 1986;9
  59. Kirkpatrick DL. Evaluating Training Programs: The Four Levels(2ne ed.). San Francisco: Berrett-Koehler Publishers, Inc, 1998
  60. LeBlanc M. Post Training Checkups. Occupational Health and Safety 1994; 63(10):102-104
  61. Lee TR et al. Making a Difference: Community Programs That Last. Louisville, KY: Paper presented at the Linking Families and Communities, 1996
  62. Mann S. What Should Training Evaluations Evaluate?. Journal of European Industrial Training 1996;20(9):14-21 https://doi.org/10.1108/03090599610150264
  63. McDonald G, Veen C, Tones K. Evidence for Success in Health Promotion: Suggestions for Improvement. Health Education Research 1996;11(3):367-376 https://doi.org/10.1093/her/11.3.367
  64. McQuiston TH. Empowerment Evaluation of Worker Safety and Health Education Programs. American Journal of Industrial Medicine 1996;38: 584-597
  65. Mulder M. Customer Satisfaction with Trai- ning Programs. Journal of European Industrial Training 2001;25(6/7):321-331 https://doi.org/10.1108/03090590110401791
  66. Nachmias CF, Nachmias D. Research Methods in the Social Sciences. Worth Publishing, 1987
  67. NHS Executive. Quality and Performance in the NHS: NHS Performance Indicators, 2000
  68. National Safety Council. Award-Winning Program, In Accident Prevention Manual for Industrial Operation. 6th ed. NSC, 1971
  69. Nutbeam D, Smith C, Catford J. Evaluation in Health Education. A Review of Progress, Possibilities, and Problems. Journal of Epidemiology and Community Health 1990;44;83-89 https://doi.org/10.1136/jech.44.2.83
  70. Occupational Safety and Health Administration. Training Requirements in OSHA Construction Industry Standards and Training Guidelines. OSHA Office of Training and Education, 1996
  71. OECD. OECD Guiding Principles for Chemical Accident Prevention, Preparedness and Response, 2003
  72. O'Loughlin J, Renaud L, Paradis G, Meshefedjian G. Screening School Personnel for Cardiovascular Disease Risk Factors: Short Term Impact on Behavior and Perceived Role as Promoters of Heart Health. Preventive Medicine 1996;25(6):660-667 https://doi.org/10.1006/pmed.1996.0104
  73. Onisawa T, Nishiwaki Y. Fuzzy Human Reliability Analysis on the Chernobyl Accident. Fuzzy Sets and Systems 1998;28:115-127 https://doi.org/10.1016/0165-0114(88)90194-7
  74. Perkins R. Evaluation of and Alaskan Marine Safety Training Program. Public Health Reports 1998;110(6): 701-703
  75. Phillips JJ. Handbook of Training Evaluation and Measurement Methods. Huston, TX: Gulf Publishing, 1988
  76. Raizman DJ, Montgomery DH, Osganizam SK, Ebzery MK, Evans MA, Nicklas TA, Zive MM, Hann BJ, Snyder MP, Clesi AL. CATCH: Food Service Program Process Evaluation in a Multicenter Trial. Health Education Quarterly 1994;2:51-57
  77. Reed K, Cheadle A, Thompson B. Evaluating Prevention Programs with the Results Mapping Evaluation Tool: A Case Study of a Youth Substance Abuse Prevention Program. Health Education Research 2000;15(1): 73-84 https://doi.org/10.1093/her/15.1.73
  78. Rose M. Draft Survey in Extension: Processes and Gaps. RIRDC, 1996
  79. Scriven M. The Methodology of Evaluation. Social Education Consortium Publication, 1967
  80. Seever B, Graham D, Gamon J, Conklin N. Education through Cooperative Extension. Delmar Publishers, 1997
  81. Smith ML. The Whole is Greater: Combining Qualitative and Quantitative Approaches in Evaluation Studies. New Directions for Program Evaluation, 1986;30: 37-54
  82. Story M, Mays RW, Bishop DB, Perry CL, Taylor G, Smyth M, Gray C. 5-a-Day Power Plus: Process Evaluation of a Multicomponent Elementary School Program to Increase Fruit and Vegetable Consumption. Health Education & Behavior 2000;27(2): 187-200 https://doi.org/10.1177/109019810002700205
  83. Talmage H. Evaluation of Program. in H.E. Mitzel(ed.). Encyclopedia of educational research(5th ed.). N.Y.L The Free Press, 1982
  84. Torp S, Moen BE. The Effect of Occupational Health and Safety Management on work Environment and Health: A prospective study. Applied Ergonomics 2006;37:775-783 https://doi.org/10.1016/j.apergo.2005.11.005
  85. Watada J, Fu KS. Linguistic Assessment of Structural Damage. Technical Report, Purdue Univ. CE-STR, 1984;94:30
  86. Westhead P, Storey D. Training Provision and the Development of Small and Medium-sized Enterprises. DFEE Research Report. 26: HMSO, London, 1997
  87. Van den Ban AW, Hawkins HS. Agricultural Extension(2nd ed.). Blackwell Science, 1996
  88. Vandenberg RJ, Park KO, Dejoy DM, Wilson MG, Griffin-Blake CS. The Healthy Work Organization Model: Expanding the View of Individual Health and Well Being in the Workplace. Research in Occupational Stress and Well Being 2002;2:57-115 https://doi.org/10.1016/S1479-3555(02)02002-4
  89. Van Manen M. Researching lived experiences: Human Science of an Action Sensitive Pedagogy. New York: The Sate University of New York Press, 1990
  90. Young DR, Haskell WL, Taylor CB, Fortmann SP. Effects of Community Health Education on Physical Activity Knowledge, Attitudes and Behavior. American Journal of Epidemiology 1996;144(3):264-274 https://doi.org/10.1093/oxfordjournals.aje.a008921