Health Policy and Management (보건행정학회지)

Korean Academy of Health Policy and Management (한국보건행정학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Program Evaluation Indicator ： Community Health Center's Health Promotion Program

보건소 건강증진사업 평가지표 개발

  • 송현종 (한국보건사회연구원) ;
  • 진기남 (연세대학교 보건행정학과)
  • Published : 2003.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study was to develop the evaluation indicator for the health promotion programs of the Community Health Centers and to test its validity. The modified logic model was used as the evaluation model based on the literature reviews. Using this model, four dimensions, eleven sub­dimensions, and forty­one individual indicators were developed. These evaluation indicators are superior in reflecting the distinctiveness of the community health promotion programs, and also flexible enough to accommodate diverse programs. These indicators also emphasize the role of process evaluation, and the diversity of outcomes. To test content validity, survey method of experts in the community health promotion field was conducted. Eleven in three expert groups(professionals, practitioners in Community Health Centers, and policy makers) generally agreed with the validity of evaluation indicators. To examine criteria and construct validity, these indicators were used to evaluate the health promotion programs conducted by the 18 Key Community Health Centers. The data came from the interview surveys of the main health promotion practitioner and 30 visitors from each center. The ranks of these eighteen Community Health Centers were computed from these data. There was no significant difference in ranking either by these indicators or by the existing indicators, which was developed by Technical Support and Evaluation Team for criteria validity. There was no statistically significant difference in ranking between input, process and outcome dimensions. Based on these study results, evaluation indicators developed in this study are valid to evaluate Community Health Center's health promotion program. It can be used both by the Community Health Center for internal evaluation, and by the stakeholders for external evaluation.

Keywords

References

  1. 김은주. 보건교육 효과측정을 위한 평가지표 개발 및 적용. 보건학종합학술대회 자료집. 서울:대한보건협회;1998.
  2. 김진현, 유왕근. 보건소 보건사업의 효율성 평가와 정책적 의의-DEA를 이용한 경상남도 사례분석-. 보건행정학회지 1999;9(4):87-119.
  3. 무도 다가시, 후구와다리 야스시. 건강교육 및 건강증진의 평가. 방숙(옮김). 보건교육 및 건강증진의 평가방법. 서울:한국보건사회연구원;1998. 쪽 114-115.
  4. 박노예, 장영섭, 양숙자, 전미순. 지역단위 보건사업 평가서 개발에 관한 연구. 국립보건원보 1993;30(1):211-250.
  5. 변종화. 지역사회 건강증진사업 실태와 개선방안. 보건복지포럼 1998;2:76-86.
  6. 변종화, 문상식, 이주열, 남정자, 한영자, 문옥륜 등. 국민건강증진기금사업의 운영 및 평가체계 개발. 서울:보건복지부;1999.
  7. 보건복지부. 국민건강증진사업 편람. 서울:보건복지부;2001.
  8. 보건복지부, 건강증진거점보건소기술지원평가단. 건강증진거점보건소 기술지원평가단 1999년도 사업보고서. 서울:건강증진거점보건소기술지원평가단;2000.
  9. 보건복지부, 보건산업진흥원. 21세기 국민건강증진을 위한 보건소 업무개선 및 사업평가방안개발. 서울:보건산업진흥원;1999.
  10. 안형식, 박형근, 김용익. 보건소의 보건사업평가 지표의 개발과 활용방안. 한국보건행정학회 후기 학술대회 연제집. 서울:한국보건행정학회;1998.
  11. 오대규. 국민건강증진의 목표와 전략. 건강증진 및 금연심포지움 자료집. 서울:건강증진 및 금연 심포지움;2001
  12. 유지인. 균형성과표(BSC)를 이용한 수술실 간호부서의 성과평가지표 개발[석사학위논문]. 서울:연세대학교 대학원;2001
  13. 이규식. 보건소의 건강증진사업과 지역보건의료계획. 보건행정학회지 1997;7(1):1-31
  14. 이규식. 건강증진연구사업의 중장기 발전방안 및 우선순위 결정. 건강증진연구사업 평가를 위한 웍샵 자료집. 서울:건강증진연구사업 평가를 위한 웍샵;2001
  15. 이선희, 조희숙, 박영숙, 김한중, 손명세, 박혜숙 등. 보건소 건강증진사업에서의 전략적 사업영역 결정. 보건행정학회지 1998;8(2):109-124
  16. 이희원. S병원 성과평가지표 개발에 관한 연구[석사학위논문]. 서울:연세대학교 대학원;2000.
  17. 조수헌, 김선민, 김창엽, 홍윤철, 하은희. 중소기업 근로자 보건관리대행기관 QA평가지표의 개발과정. 한국의료QA학회지 1995;2(2):72-88
  18. 차병준, 박재용. 보건소의 사업성과와 관련된 요인. 보건행정학회지 1996;6(1):29-58
  19. Alan Dever GE, Rousseau RH, Houser FM. Disease patterns, epidemiology and evaluation: An evolutionary perspective. New Directions for Program Evaluation 1981;10:69-76.
  20. APHA(American Public Health Association). Healthy Communities 2000: Model Standards. Washington DC;1991.
  21. Card JJ, Greeno C, Peterson JL. Planning an evaluation and estimating its cost. Evaluation & Health Professionals 1992;15(1):75-89. https://doi.org/10.1177/016327879201500105
  22. Cheadle A, Psaty BM, Dieher P, Koespell T, Wagner E, Curry S, Kristal A Evaluating community-based nutrition program: Comparing grocery store and individual-level survey measures of program impact. Preventive Medicine 1995;24:71-79. https://doi.org/10.1006/pmed.1995.1010
  23. Cheadle A, Sterling TD, Schmid TL, Fwacett SB. Promising community-level indicators for evaluating cardiovascular health-promotion programs. Health Education Research 2000;15(1): 109-116. https://doi.org/10.1093/her/15.1.109
  24. Chen WW, Cato BM, Rainford N. Using a Logic Model to Plan and Evaluate a Community Intervention Program: A Case Study. International Quarterly of Community Health Education 1998-99;18(4):449-458. https://doi.org/10.2190/JDNM-MNPB-9P25-17CQ
  25. Darity WA, Chen TL, Tuthill RW, Buchanan DR, Winder AE, Stanek E et al. A multi-city community based smoking research intervention project in the African-American population. International Quarterly of Community Health Education 1997-98;17(2):117-130. https://doi.org/10.2190/CEXY-WG7C-GL3E-A2BP
  26. Dignan MB, Carr PA. Program planning for health education and promotion. Philadelphia:Lea & Febiger;1992.
  27. Fink A. Evaluation Fundamentals: Guiding Health Programs, Research, and Policy. Newbury Park: Sage Publication;1993.
  28. Goodman RM, Wheeler FC, Lee PR. Evaluation of the Heart to Heart Project: Lessons from a community-based chronic disease prevention project. American Journal of Health Promotion 1995;9(6):443-455. https://doi.org/10.4278/0890-1171-9.6.443
  29. Green LW, Lewis FM. Measurement and Evaluation in Health Education and Health Promotion. Palo Alto:Mayfield Publishing;1986.
  30. Hancock L, Sanson-Fisher R, Perkins J. McClintock A, Howley P, Gibberd R. Effect of a community action program on adult quit smoking rates in rural Australian Towns: The CART project. Preventive Medicine 2001;32:118-127. https://doi.org/10.1006/pmed.2000.0798
  31. Havas S, Anliker J, Damron D, Feldman R, Langenberg P. Uses of process evaluation in the Maryland WIC 5-a-Day Promotion Program. Health Education & Behavior 2000;21(2): 254-263. https://doi.org/10.1177/109019810002700211
  32. Jeffery RW, Hellerstedt WL, Schmid TL. Correspondence programs for smoking cessation and weight control: a comparison of two strategies in the Minnesota Heart Health Program. Health Psychology 1990;9(5):585-98. https://doi.org/10.1037/0278-6133.9.5.585
  33. Julian DA, Jones A, Deyo D. Open systems evaluation and the logic model: program planning and evaluation tools. Evaluation and Program Planning 1995;18(4):333-341. https://doi.org/10.1016/0149-7189(95)00034-8
  34. Kegler MC, Twiss JM, Look V. Assessing community change at multiple level: The genesis of an evaluation framework for the California Healthy City Project. Health Education & Behavior 2000;27(6):760-779. https://doi.org/10.1177/109019810002700610
  35. Korhonen T, Uutela A, Korhonen HJ, Urjanheimo EL, Puska P. Smoking cessation advice from health professionals: process evaluation of a community-based program. Patient Education and Counseling 1999;36:13-21. https://doi.org/10.1016/S0738-3991(98)00070-6
  36. Lave JR, Ives DG, Traven ND, Kuller LH. Evaluation of a health promotion demonstration program for the rural elderly. Health Services Research 1996;31(3):261-281.
  37. Laver SM, Borne BD, Kok G, Woelk G. Was the intervention implemented as intended?: A process evaluation of an AIDS prevention intervention in rural Zimbabwe. International Quarterly of Community Health Education 1996-97;16(1):25-46. https://doi.org/10.2190/EMCN-H455-YKAQ-TGX6
  38. Luepker RV, Rastam L, Hannan PJ, Murray DM, Gray C, Baker WL et al. Community education for cardiovascular disease prevention. Morbidity and mortality results from the Minnesota Heart Health Program. American Journal of Epidemiology 1996;144(4):351-62. https://doi.org/10.1093/oxfordjournals.aje.a008936
  39. McDonald G, Veen C, Tones K. Evidence for success in health promotion: Suggestions for improvement. Health Education Research 1996;11(3):367-376. https://doi.org/10.1093/her/11.3.367
  40. McGraw SA, Stone EJ, Osgania SK, Elder JP, Perry CL, Johnson CC et al. Design of process evaluation within the Child and Adolescent Trial for Cardiovascular Health(CATCH). Health Education Quarterly 1994;Supple 2:S5-S26.
  41. McKenzie JF, Smeltzer A. Planning, implementing, and evaluating health promotion programs: A primer. Needham Heights:Allyn and Bacon;1997.
  42. McKinlay JB. More Appropriate Evaluation Methods for Community-Level Health Interventions: Introduction to the Special Issue. Evaluation Review 1996;20(3):237-243. https://doi.org/10.1177/0193841X9602000301
  43. Mittlemark MB, Hunt MK, Heath GW, Schmid TL. Realistic outcomes: Lessons from community-based research and demonstration programs for the prevention of cardiovascular diseases. Journal of Public Health Policy 1993;winter:437-461.
  44. Morgan MV, Campain AC, Crowley SJ, Wright FAC. An evaluation of a primary preventive dental programme in non-fluoridated area of Victoria, Australia. Australian Dental Journal 1997;42(6):381-388. https://doi.org/10.1111/j.1834-7819.1997.tb06082.x
  45. NHS Executive. Quality and performance in the NHS: NHS performance indicators. London:NHS;2000.
  46. Nutbeam D. Evaluating health promotion. British Medical Journal 1999;318(7180):404A.
  47. O'Loughlin J, Renaud L, Paradis G, Meshefedjian G. Screening school personnel for cardiovascular disease risk factors: short-term impact on behavior and perceived role as promoters of heart health. Preventive Medicine 1996;25(6):660-7. https://doi.org/10.1006/pmed.1996.0104
  48. O'Loughlin JL, Paradis G, Gray-Donald K, Renaud L. The impact of a community-based heart disease prevention program in a low-income, inner-city neighborhood. American Journal of Public Health 1999;89(12):1819-1826. https://doi.org/10.2105/AJPH.89.12.1819
  49. Raizman DJ, Montgomery DH, Osganian SK, Ebzery MK, Evans MA, Nicklas TA et al. CATCH: Food service program process evaluation in a multicenter trial. Health Education Quarterly 1994;Suppl2:S51-S57.
  50. Reed K, Cheadle A, Thompson B. Evaluating Prevention Programs with the Results Mapping Evaluation Tool: A Case Study of a Youth Substance Abuse Prevention Program. Health Education Research 2000;15(1):73-84. https://doi.org/10.1093/her/15.1.73
  51. Shediac-Rizkallah MC, Liang W, Cassady CE, Harlow J, Scheirer MA, Staff of the Breast and Cervical Program. Linking implementation to outcomes: Evaluation of a community-based breast and cervical cancer screening program. International Quarterly of Community Health Education 1996-1997;16(1):5-23. https://doi.org/10.2190/NWEB-38PK-AFXV-LUDD
  52. Streiner DL, Norman GR. Health Measurement Scales. New York:Oxford University Press;1991.
  53. Taylor SM, Ross NA, Cummings M, Glasgow RE, Goldsmith CH, Zanna MP et al. Community Intervention Trial for Smoking Cessation(COMMIT): Changes in community attitudes toward cigarette smoking Health Education Research 1998;13(1):109-122. https://doi.org/10.1093/her/13.1.109
  54. Thompson JC. Program Evaluation within a Health Promotion Framework. Canadian Journal of Public Health 1992;March-April(Supplement1):S67-S71.
  55. Timmreck TC. Planning, program development, and evaluation: A handbook for health promotion, ageing, and health services. Sudbury:Jones and Bartlett;1995.
  56. Tones K. Measuring success in health promotion: Selecting indicators of performance. Hygia 1992;11(4):10-14.
  57. Valente TW. Evaluating Health Promotion Program. New York:Oxford University Press;2002.
  58. W.K. Kellogg Foundation. Evaluation Handbook. Battle Creek:W.K. Kellogg Foundation;1998.
  59. World Health Organization. Health Programme Evaluation: Guiding Principles for its Application in the Managerial Process for National Health Development. Geneva:WHO:1981.

Cited by

  1. A Systematic Review of Literature on Community Health Center Exercise Programs vol.26, pp.1, 2015, https://doi.org/10.12799/jkachn.2015.26.1.18