Browse > Article
http://dx.doi.org/10.4332/KJHPA.2003.13.4.001

Development of Program Evaluation Indicator ： Community Health Center's Health Promotion Program  

송현종 (한국보건사회연구원)
진기남 (연세대학교 보건행정학과)
Publication Information
Health Policy and Management / v.13, no.4, 2003 , pp. 1-27 More about this Journal
Abstract
The purpose of this study was to develop the evaluation indicator for the health promotion programs of the Community Health Centers and to test its validity. The modified logic model was used as the evaluation model based on the literature reviews. Using this model, four dimensions, eleven sub­dimensions, and forty­one individual indicators were developed. These evaluation indicators are superior in reflecting the distinctiveness of the community health promotion programs, and also flexible enough to accommodate diverse programs. These indicators also emphasize the role of process evaluation, and the diversity of outcomes. To test content validity, survey method of experts in the community health promotion field was conducted. Eleven in three expert groups(professionals, practitioners in Community Health Centers, and policy makers) generally agreed with the validity of evaluation indicators. To examine criteria and construct validity, these indicators were used to evaluate the health promotion programs conducted by the 18 Key Community Health Centers. The data came from the interview surveys of the main health promotion practitioner and 30 visitors from each center. The ranks of these eighteen Community Health Centers were computed from these data. There was no significant difference in ranking either by these indicators or by the existing indicators, which was developed by Technical Support and Evaluation Team for criteria validity. There was no statistically significant difference in ranking between input, process and outcome dimensions. Based on these study results, evaluation indicators developed in this study are valid to evaluate Community Health Center's health promotion program. It can be used both by the Community Health Center for internal evaluation, and by the stakeholders for external evaluation.
Keywords
Community health promotion program; Evaluation indicator;
Citations & Related Records
연도 인용수 순위
  • Reference
1 McDonald G, Veen C, Tones K. Evidence for success in health promotion: Suggestions for improvement. Health Education Research 1996;11(3):367-376.   DOI   ScienceOn
2 Card JJ, Greeno C, Peterson JL. Planning an evaluation and estimating its cost. Evaluation & Health Professionals 1992;15(1):75-89.   DOI   ScienceOn
3 Kegler MC, Twiss JM, Look V. Assessing community change at multiple level: The genesis of an evaluation framework for the California Healthy City Project. Health Education & Behavior 2000;27(6):760-779.   DOI   ScienceOn
4 Korhonen T, Uutela A, Korhonen HJ, Urjanheimo EL, Puska P. Smoking cessation advice from health professionals: process evaluation of a community-based program. Patient Education and Counseling 1999;36:13-21.   DOI   ScienceOn
5 보건복지부. 국민건강증진사업 편람. 서울:보건복지부;2001.
6 보건복지부, 보건산업진흥원. 21세기 국민건강증진을 위한 보건소 업무개선 및 사업평가방안개발. 서울:보건산업진흥원;1999.
7 오대규. 국민건강증진의 목표와 전략. 건강증진 및 금연심포지움 자료집. 서울:건강증진 및 금연 심포지움;2001
8 변종화, 문상식, 이주열, 남정자, 한영자, 문옥륜 등. 국민건강증진기금사업의 운영 및 평가체계 개발. 서울:보건복지부;1999.
9 World Health Organization. Health Programme Evaluation: Guiding Principles for its Application in the Managerial Process for National Health Development. Geneva:WHO:1981.
10 Cheadle A, Psaty BM, Dieher P, Koespell T, Wagner E, Curry S, Kristal A Evaluating community-based nutrition program: Comparing grocery store and individual-level survey measures of program impact. Preventive Medicine 1995;24:71-79.   DOI   ScienceOn
11 McKenzie JF, Smeltzer A. Planning, implementing, and evaluating health promotion programs: A primer. Needham Heights:Allyn and Bacon;1997.
12 Cheadle A, Sterling TD, Schmid TL, Fwacett SB. Promising community-level indicators for evaluating cardiovascular health-promotion programs. Health Education Research 2000;15(1): 109-116.   DOI   ScienceOn
13 Shediac-Rizkallah MC, Liang W, Cassady CE, Harlow J, Scheirer MA, Staff of the Breast and Cervical Program. Linking implementation to outcomes: Evaluation of a community-based breast and cervical cancer screening program. International Quarterly of Community Health Education 1996-1997;16(1):5-23.   DOI
14 변종화. 지역사회 건강증진사업 실태와 개선방안. 보건복지포럼 1998;2:76-86.
15 보건복지부, 건강증진거점보건소기술지원평가단. 건강증진거점보건소 기술지원평가단 1999년도 사업보고서. 서울:건강증진거점보건소기술지원평가단;2000.
16 McKinlay JB. More Appropriate Evaluation Methods for Community-Level Health Interventions: Introduction to the Special Issue. Evaluation Review 1996;20(3):237-243.   DOI   ScienceOn
17 Reed K, Cheadle A, Thompson B. Evaluating Prevention Programs with the Results Mapping Evaluation Tool: A Case Study of a Youth Substance Abuse Prevention Program. Health Education Research 2000;15(1):73-84.   DOI   ScienceOn
18 Thompson JC. Program Evaluation within a Health Promotion Framework. Canadian Journal of Public Health 1992;March-April(Supplement1):S67-S71.
19 Hancock L, Sanson-Fisher R, Perkins J. McClintock A, Howley P, Gibberd R. Effect of a community action program on adult quit smoking rates in rural Australian Towns: The CART project. Preventive Medicine 2001;32:118-127.   DOI   ScienceOn
20 박노예, 장영섭, 양숙자, 전미순. 지역단위 보건사업 평가서 개발에 관한 연구. 국립보건원보 1993;30(1):211-250.
21 이선희, 조희숙, 박영숙, 김한중, 손명세, 박혜숙 등. 보건소 건강증진사업에서의 전략적 사업영역 결정. 보건행정학회지 1998;8(2):109-124   과학기술학회마을
22 유지인. 균형성과표(BSC)를 이용한 수술실 간호부서의 성과평가지표 개발[석사학위논문]. 서울:연세대학교 대학원;2001
23 Alan Dever GE, Rousseau RH, Houser FM. Disease patterns, epidemiology and evaluation: An evolutionary perspective. New Directions for Program Evaluation 1981;10:69-76.
24 McGraw SA, Stone EJ, Osgania SK, Elder JP, Perry CL, Johnson CC et al. Design of process evaluation within the Child and Adolescent Trial for Cardiovascular Health(CATCH). Health Education Quarterly 1994;Supple 2:S5-S26.
25 Julian DA, Jones A, Deyo D. Open systems evaluation and the logic model: program planning and evaluation tools. Evaluation and Program Planning 1995;18(4):333-341.   DOI   ScienceOn
26 Green LW, Lewis FM. Measurement and Evaluation in Health Education and Health Promotion. Palo Alto:Mayfield Publishing;1986.
27 김은주. 보건교육 효과측정을 위한 평가지표 개발 및 적용. 보건학종합학술대회 자료집. 서울:대한보건협회;1998.
28 무도 다가시, 후구와다리 야스시. 건강교육 및 건강증진의 평가. 방숙(옮김). 보건교육 및 건강증진의 평가방법. 서울:한국보건사회연구원;1998. 쪽 114-115.
29 Goodman RM, Wheeler FC, Lee PR. Evaluation of the Heart to Heart Project: Lessons from a community-based chronic disease prevention project. American Journal of Health Promotion 1995;9(6):443-455.   DOI
30 Taylor SM, Ross NA, Cummings M, Glasgow RE, Goldsmith CH, Zanna MP et al. Community Intervention Trial for Smoking Cessation(COMMIT): Changes in community attitudes toward cigarette smoking Health Education Research 1998;13(1):109-122.   DOI   ScienceOn
31 이희원. S병원 성과평가지표 개발에 관한 연구[석사학위논문]. 서울:연세대학교 대학원;2000.
32 Laver SM, Borne BD, Kok G, Woelk G. Was the intervention implemented as intended?: A process evaluation of an AIDS prevention intervention in rural Zimbabwe. International Quarterly of Community Health Education 1996-97;16(1):25-46.   DOI
33 차병준, 박재용. 보건소의 사업성과와 관련된 요인. 보건행정학회지 1996;6(1):29-58
34 NHS Executive. Quality and performance in the NHS: NHS performance indicators. London:NHS;2000.
35 김진현, 유왕근. 보건소 보건사업의 효율성 평가와 정책적 의의-DEA를 이용한 경상남도 사례분석-. 보건행정학회지 1999;9(4):87-119.   과학기술학회마을
36 Fink A. Evaluation Fundamentals: Guiding Health Programs, Research, and Policy. Newbury Park: Sage Publication;1993.
37 안형식, 박형근, 김용익. 보건소의 보건사업평가 지표의 개발과 활용방안. 한국보건행정학회 후기 학술대회 연제집. 서울:한국보건행정학회;1998.
38 Morgan MV, Campain AC, Crowley SJ, Wright FAC. An evaluation of a primary preventive dental programme in non-fluoridated area of Victoria, Australia. Australian Dental Journal 1997;42(6):381-388.   DOI   ScienceOn
39 O'Loughlin JL, Paradis G, Gray-Donald K, Renaud L. The impact of a community-based heart disease prevention program in a low-income, inner-city neighborhood. American Journal of Public Health 1999;89(12):1819-1826.   DOI   ScienceOn
40 Mittlemark MB, Hunt MK, Heath GW, Schmid TL. Realistic outcomes: Lessons from community-based research and demonstration programs for the prevention of cardiovascular diseases. Journal of Public Health Policy 1993;winter:437-461.
41 APHA(American Public Health Association). Healthy Communities 2000: Model Standards. Washington DC;1991.
42 Raizman DJ, Montgomery DH, Osganian SK, Ebzery MK, Evans MA, Nicklas TA et al. CATCH: Food service program process evaluation in a multicenter trial. Health Education Quarterly 1994;Suppl2:S51-S57.
43 Luepker RV, Rastam L, Hannan PJ, Murray DM, Gray C, Baker WL et al. Community education for cardiovascular disease prevention. Morbidity and mortality results from the Minnesota Heart Health Program. American Journal of Epidemiology 1996;144(4):351-62.   DOI   ScienceOn
44 Nutbeam D. Evaluating health promotion. British Medical Journal 1999;318(7180):404A.
45 W.K. Kellogg Foundation. Evaluation Handbook. Battle Creek:W.K. Kellogg Foundation;1998.
46 Streiner DL, Norman GR. Health Measurement Scales. New York:Oxford University Press;1991.
47 Tones K. Measuring success in health promotion: Selecting indicators of performance. Hygia 1992;11(4):10-14.
48 Timmreck TC. Planning, program development, and evaluation: A handbook for health promotion, ageing, and health services. Sudbury:Jones and Bartlett;1995.
49 조수헌, 김선민, 김창엽, 홍윤철, 하은희. 중소기업 근로자 보건관리대행기관 QA평가지표의 개발과정. 한국의료QA학회지 1995;2(2):72-88
50 Jeffery RW, Hellerstedt WL, Schmid TL. Correspondence programs for smoking cessation and weight control: a comparison of two strategies in the Minnesota Heart Health Program. Health Psychology 1990;9(5):585-98.   DOI   ScienceOn
51 Havas S, Anliker J, Damron D, Feldman R, Langenberg P. Uses of process evaluation in the Maryland WIC 5-a-Day Promotion Program. Health Education & Behavior 2000;21(2): 254-263.   DOI   ScienceOn
52 Dignan MB, Carr PA. Program planning for health education and promotion. Philadelphia:Lea & Febiger;1992.
53 Lave JR, Ives DG, Traven ND, Kuller LH. Evaluation of a health promotion demonstration program for the rural elderly. Health Services Research 1996;31(3):261-281.
54 이규식. 보건소의 건강증진사업과 지역보건의료계획. 보건행정학회지 1997;7(1):1-31   과학기술학회마을
55 Chen WW, Cato BM, Rainford N. Using a Logic Model to Plan and Evaluate a Community Intervention Program: A Case Study. International Quarterly of Community Health Education 1998-99;18(4):449-458.   DOI
56 O'Loughlin J, Renaud L, Paradis G, Meshefedjian G. Screening school personnel for cardiovascular disease risk factors: short-term impact on behavior and perceived role as promoters of heart health. Preventive Medicine 1996;25(6):660-7.   DOI   ScienceOn
57 Valente TW. Evaluating Health Promotion Program. New York:Oxford University Press;2002.
58 이규식. 건강증진연구사업의 중장기 발전방안 및 우선순위 결정. 건강증진연구사업 평가를 위한 웍샵 자료집. 서울:건강증진연구사업 평가를 위한 웍샵;2001
59 Darity WA, Chen TL, Tuthill RW, Buchanan DR, Winder AE, Stanek E et al. A multi-city community based smoking research intervention project in the African-American population. International Quarterly of Community Health Education 1997-98;17(2):117-130.   DOI