Browse > Article

Development of Evaluation Indicator on Industrial Safety and Health Education Program  

Oh, Young-A (Department of Healthcare Management, Kyungwon University)
Lee, Myung-Sun (Department of Health Education & Management, Ewha Womans University)
Publication Information
Abstract
Objectives: The purpose of this study was to verify the validity of the evaluation indicators on safety and health education programs provided to Korean industrial workers, by developing further. Methods: To develop the early evaluation indicator, the secondary analysis was made on 'Survey on Industrial safety & health trends', the national wide survey data product by Korea Occupational Safety & Health Agency, as well as the various examinations on literatures. To validate such developed evaluation indicator, 13 safety and health managers in Focus Group discussion to prove the reliability of the contents were composed. To confirm the face validity, the interview with 6 industrial safety and health education experts was held to study the appropriateness of the content. With the cooperation from Korea Occupational Safety & Health Agency, the structured survey was performed with the safety and health managers from 588 businesses who participated in the education program for the later half of 2006. In this study, the number of responses was randomly divided into 1:1 two groups, in which one group was for the Exploratory Factor Analysis and the other group was for the Confirmatory Factor Analysis. Results: The results were as follows. First, for the Structure category, 18 evaluation indicators were developed into 4 evaluation categories such as a preliminary examination, education staff and organization, education environment and rules/ regulation. Secondly, the Activity category was comprised of 10 evaluation indicators with respect to 2 areas of curriculum satisfaction and program evaluation. Finally, for the Output category, 9 evaluation indicators were developed into 2 evaluation areas such as documentation and information share and education effects. Conclusions: The evaluation indicators developed through this study will possibly develop and be applied to evaluation tools on safety and health education program, which may further become the standardized indicators to better operate the industrial safety and health education programs.
Keywords
Industrial safety and Health education; Evaluation indicator;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 김동하, 고병인, 임현교. 건설현장 근로자 및 관리기사의 안전의식과 안전교육 효율화 방안. 한국산업안전학회지 1999;14(2):163-169
2 김미숙, 이동임, 김수원, 박종성, 이상준. 2000년도 직업능력개발 훈련기관 및 과정평가(민간부문). 서울: 한국직업능력개발원, 2000
3 김철식, 송철기. 산업재해 분석을 통한 안전교육훈련의 개선에 관한 연구. 공학교육연구 2003;6(2):15-21
4 박태준. 직업교육 훈련프로그램 평가방안 연구. 서울: 한국직업능력개발원, 1998
5 심규범. 건설현장 근로자들의 안전교육실태와 사고예방과의 관련요인 조사연구[석사학위논문]. 경희대학교 대학원, 2002
6 이관형, 박동현. 안전효능감과 산업재해의 관계분석. 산업안전학회지 1999;14(2):127-139
7 장동민. 보건소의 지역보건 시범사업 평가모형 개발. 인제논집 2005;20(1):27-40
8 Ahmad AA, Mohamed Z. Training Evaluation: An Empirical Study in Kuwait. Journal of European Industrial Training 2002;26(5):241-251   DOI   ScienceOn
9 Carroll JB, McKenna J. Theory to Practice: Using the Logic Model to Organize and Report Research Results in a Collaborative Project. Journal of Family and Consumer Sciences 2001;93(4): 63-54
10 Clarke S. Perception of Organizational Safety: Implications for Development Implications for the Development of Safety Culture. Journal of Organizational Behavior 1999;20: 195-198
11 Cuba E, Lincoln Y. Forth Generation Evaluation. Newbury Park: Sage, 1989
12 Dehar MA, Casswell S, Duignam P. Formative and Process Evaluation of Health Promotion and Disease Prevention Programs. Evaluation Review 1993;17(2):204-220   DOI   ScienceOn
13 Hinze J, Gambatese J. Factors That Influence Safety Performance of Specialty Contractors. Journal of Construction Engineering and Management 2003; 129(2):159-164   DOI   ScienceOn
14 Huang TC. The Relation of Training Practices and Organizational Performance in Small and Medium Size Enterprise. Education & Training 2001; 43(8/9):437-444   DOI   ScienceOn
15 Kirkpatrick DL. Evaluating Training Programs: The Four Levels(2ne ed.). San Francisco: Berrett-Koehler Publishers, Inc, 1998
16 Mann S. What Should Training Evaluations Evaluate?. Journal of European Industrial Training 1996;20(9):14-21   DOI   ScienceOn
17 Mulder M. Customer Satisfaction with Trai- ning Programs. Journal of European Industrial Training 2001;25(6/7):321-331   DOI   ScienceOn
18 Nachmias CF, Nachmias D. Research Methods in the Social Sciences. Worth Publishing, 1987
19 NHS Executive. Quality and Performance in the NHS: NHS Performance Indicators, 2000
20 Occupational Safety and Health Administration. Training Requirements in OSHA Construction Industry Standards and Training Guidelines. OSHA Office of Training and Education, 1996
21 OECD. OECD Guiding Principles for Chemical Accident Prevention, Preparedness and Response, 2003
22 Phillips JJ. Handbook of Training Evaluation and Measurement Methods. Huston, TX: Gulf Publishing, 1988
23 Reed K, Cheadle A, Thompson B. Evaluating Prevention Programs with the Results Mapping Evaluation Tool: A Case Study of a Youth Substance Abuse Prevention Program. Health Education Research 2000;15(1): 73-84   DOI   ScienceOn
24 Scriven M. The Methodology of Evaluation. Social Education Consortium Publication, 1967
25 Torp S, Moen BE. The Effect of Occupational Health and Safety Management on work Environment and Health: A prospective study. Applied Ergonomics 2006;37:775-783   DOI   ScienceOn
26 Seever B, Graham D, Gamon J, Conklin N. Education through Cooperative Extension. Delmar Publishers, 1997
27 Story M, Mays RW, Bishop DB, Perry CL, Taylor G, Smyth M, Gray C. 5-a-Day Power Plus: Process Evaluation of a Multicomponent Elementary School Program to Increase Fruit and Vegetable Consumption. Health Education & Behavior 2000;27(2): 187-200   DOI
28 Talmage H. Evaluation of Program. in H.E. Mitzel(ed.). Encyclopedia of educational research(5th ed.). N.Y.L The Free Press, 1982
29 Van den Ban AW, Hawkins HS. Agricultural Extension(2nd ed.). Blackwell Science, 1996
30 Vandenberg RJ, Park KO, Dejoy DM, Wilson MG, Griffin-Blake CS. The Healthy Work Organization Model: Expanding the View of Individual Health and Well Being in the Workplace. Research in Occupational Stress and Well Being 2002;2:57-115   DOI
31 Van Manen M. Researching lived experiences: Human Science of an Action Sensitive Pedagogy. New York: The Sate University of New York Press, 1990
32 김동철. 산업안전 보건교육체제의 개선에 관한 연구[석사학위논문]. 서울산업대학교 대학원, 2004
33 Cromwell SE, Kolb JA. An Examination of Work-Environment Support Factors Affecting Transfer of Supervisory Skills Training to the Workplace. Human Resource Development Quarterly 2004; 15(4):449- 471   DOI   ScienceOn
34 Perkins R. Evaluation of and Alaskan Marine Safety Training Program. Public Health Reports 1998;110(6): 701-703
35 Erickson JA. Uncovering Employees' Views About Safety. Occupational Hazards 1997;68(1):45-58
36 강종철. 산업안전보건교육 실효성 제고방안에 관한 연구. 한국안전학회지 2005;20(1):144-147
37 Hare AP. Handbook of Small Group Research. New York: Free Press, 1976
38 Nutbeam D, Smith C, Catford J. Evaluation in Health Education. A Review of Progress, Possibilities, and Problems. Journal of Epidemiology and Community Health 1990;44;83-89   DOI
39 Onisawa T, Nishiwaki Y. Fuzzy Human Reliability Analysis on the Chernobyl Accident. Fuzzy Sets and Systems 1998;28:115-127   DOI   ScienceOn
40 한국산업안전공단. 제조업 사업장의 안전문화 수준과 관련된 안전보건활동 요인분석. 인천:한국산업안전공단, 2005
41 Westhead P, Storey D. Training Provision and the Development of Small and Medium-sized Enterprises. DFEE Research Report. 26: HMSO, London, 1997
42 서준호, 서창교, 김현수, 고혜원. 2000년도 직업능력개발 훈련기관 및 과정평가(공공부문). 서울: 한국직업능력개발원, 2000
43 Karwowski W. Potential Applications of Fuzzy Sets in Industrial Safety Engineering. Fuzzy Sets and Systems 1986;9
44 GRI(Global Reporting Initiative). Substantiality Reporting Guidelines, 2002
45 한국산업안전공단. 외국인 근로자 안전보건 실태조사 연구. 인천: 한국산업안전공단, 2002
46 오혁진. 성인교육 프로그램에 대한 학습자의 평가준거 연구[박사학위논문]. 서울대학교 대학원, 2000
47 Bouzounis AC. A Most Valuable Proposition. Occupational Health & Safety 2006; 75(9):70-72
48 McDonald G, Veen C, Tones K. Evidence for Success in Health Promotion: Suggestions for Improvement. Health Education Research 1996;11(3):367-376   DOI   ScienceOn
49 Caffarella R, O'donnell JM. Judging the Quality of Work related, Self directed Learning. Adult Education Quarterly 1991;42(1):98-110
50 Raizman DJ, Montgomery DH, Osganizam SK, Ebzery MK, Evans MA, Nicklas TA, Zive MM, Hann BJ, Snyder MP, Clesi AL. CATCH: Food Service Program Process Evaluation in a Multicenter Trial. Health Education Quarterly 1994;2:51-57
51 한국산업안전공단. 사업장 안전보건수준 지수 개발 및 도입방안 모색(I). 인천: 한국산업안전공단, 2006
52 Green LW, Kreuter MW. Health Promotion Planning: An Educational and Ecological Approach. Mayfield Publishing Company, Mountain View, 1999
53 Gregg L. Worker Training: An Investment in Safety. Occupational Hazards 1991;53(8):23-26
54 변종화, 문상식, 이주열, 남정자, 한영자, 문옥륜, 이규식. 국민건강증진기금사업의 운영 및 평가체계개발. 서울: 보건복지부, 1999
55 Brinkerhoff RO. Achieving Results from Training. San Francisco: Jossey-Bass, 1988
56 Cohen A. Factors in Successful Occupational Safety Programs. Journal of Safety Research 1977
57 Cohen A, Smith MJ. Self Protective Measures against Workplace Hazards. Journal of Safety Research 1975;11: 121-131
58 Smith ML. The Whole is Greater: Combining Qualitative and Quantitative Approaches in Evaluation Studies. New Directions for Program Evaluation, 1986;30: 37-54
59 Hamblin AC. Evaluation and Control of Training. London: McGraw Hill, 1974
60 오향순. 국내 종합병원 병원감염관리 현황 및 평가지표와 모형개발[박사학위논문]. 서울대학교 대학원, 2005
61 Rose M. Draft Survey in Extension: Processes and Gaps. RIRDC, 1996
62 송현종. 보건소 건강증진사업 평가지표 개발[박사학위논문]. 연세대학교 대학원, 2002
63 Boyle PG. Planning Better Programs. New York: McGraw Hill, 1981
64 Lee TR et al. Making a Difference: Community Programs That Last. Louisville, KY: Paper presented at the Linking Families and Communities, 1996
65 Young DR, Haskell WL, Taylor CB, Fortmann SP. Effects of Community Health Education on Physical Activity Knowledge, Attitudes and Behavior. American Journal of Epidemiology 1996;144(3):264-274   DOI   PUBMED   ScienceOn
66 김병숙, 김주섭, 김철희. 직업훈련기관 유형별 평가방안. 서울: 한국직업능력개발원, 1999
67 성태제. 타당도와 신뢰도. 학지사, 2005
68 이명선, 박경옥, 이관형. 산업장 안전보건교육 관리요인. 한국보건교육건강증진학회지 2006;23(2):121-140   과학기술학회마을
69 이윤혁, 이상도. 조선업 산업재해예방을 위한 안전의식 실태조사. 한국산업안전학회지 1998;13(1):119-130
70 Cohen A, Colligan MJ. Assessing Occupational Safety and Health Training. Cincinnati: National Institute for Occupational Safety and Health, 1998
71 Cromwell SE, Kolb JA. An Examination of Work-Environment Support Factors Affecting Transfer of Supervisory Skills Training to the Workplace. Human Resource Development Quarterly 2004; 15(4):449- 471   DOI   ScienceOn
72 LeBlanc M. Post Training Checkups. Occupational Health and Safety 1994; 63(10):102-104
73 배성규, 박동현. 인적 요인을 중심으로 하는 산업재해 평가 모델에 대한 연구. 산업안전학회지 2003;18(4):155-163
74 Julian DA, Jones A, Deyo D. Open Systems Evaluation and the Logic Model: Program Planning and Evaluation Tools. Evaluation and Program Planning 1995;18(4):333-341   DOI   ScienceOn
75 O'Loughlin J, Renaud L, Paradis G, Meshefedjian G. Screening School Personnel for Cardiovascular Disease Risk Factors: Short Term Impact on Behavior and Perceived Role as Promoters of Heart Health. Preventive Medicine 1996;25(6):660-667   DOI   ScienceOn
76 Fisher EB, Auslander WF, Munro JF, Arfken CL, Brownson RC, Owens NW. Neighbors of Smoke Free North Side: Evaluation of a Community Organization Approach to Promoting Smoking Cessation among African American. American Journal of Public Health 1999
77 Hahn CP. Development of Performance Evaluation and Selection Precedures for Cooperative Extension Service. USDA, 1979
78 Watada J, Fu KS. Linguistic Assessment of Structural Damage. Technical Report, Purdue Univ. CE-STR, 1984;94:30
79 성태제. 현대교육평가. 학지사, 2002
80 APHA(American Public Health Association). Healthy Communities 2000; Model Standards. Washington DC, 1990
81 McQuiston TH. Empowerment Evaluation of Worker Safety and Health Education Programs. American Journal of Industrial Medicine 1996;38: 584-597
82 안덕현, 김수욱, 나승일, 변재면, 서규선, 이용환, 정철영. 농업인력 확보 및 육성방안 연구, 한국농업전문학교, 2001
83 양동주. 미국 등 주요선진국과 우리나라의 안전보건교육제도 비교연구. 안전보건 2001;51-57
84 보건복지부. 건강증진거점보건소 기술지원평가단 1999년 사업보고서. 서울: 보건복지부, 2000
85 송정아. 중년기 부부관계 향상 프로그램 개발. 한국가정관리학회지 1997;14(1):113-130
86 지화승. 한국의 산업안전보건교육의 실효성 제고에 관한 연구[석사학위논문]. 가톨릭대학교대학원, 2005
87 National Safety Council. Award-Winning Program, In Accident Prevention Manual for Industrial Operation. 6th ed. NSC, 1971
88 Cheadle A, Sterling TD, Schmid TL, Fwacett SB. Promising Community Level Indicators for Evaluating Cardiovascular Health Promotion Program. Health Education Research 2000;15(1): 109-116   DOI   ScienceOn
89 장현숙, 이태범, 남소영, 진영란. 방문보건사업 평가지표 개발. 보건행정학회지 2006;16(4):112-127   과학기술학회마을   DOI
90 Fink A. Evaluation Fundamentals: Guiding Health Programs, Research and Policy. Newbury Park: Sage publication, 1993