Browse > Article
http://dx.doi.org/10.22156/CS4SMB.2019.9.8.123

Halo Effect in Evaluating Government Funded Art Programs: The Case of Local Representative Performing Art Festivals  

Cho, Mun-Seok (Department of Public Administration, Hansung University)
Oh, Jae-Rok (Department of Public Administration, Jeonju University)
Publication Information
Journal of Convergence for Information Technology / v.9, no.8, 2019 , pp. 123-133 More about this Journal
Abstract
This research empirically investigated halo effect in evaluating culture and art performance program. We diagnosed halo effect by using correlation analysis, factor analysis, and regression model on results and scores of fifteen evaluation indicators within three categories for the 107 Local Representative Performance Art Festivals in 2014 and 2015. The results indicates strong possibility of halo effect in culture and art performance evaluation. The correlation coefficients between evaluation indicators is higher than 0.5 and factor structure does not match with evaluation categories in both years. Scores in categories and standard deviations also are also significantly correlated with each other. The results implies that more sophisticated standard, diversification of evaluator, education, and meta-anlysis are need to control halo effect.
Keywords
Halo effect; Culture and art performance; Evaluation; Evaluation error; Meta analysis;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 C. M. Lee & I. Kim. (2016). The Influence of Service Contracting-out and Managerial Characteristics of Culture & Arts Center on Service Quality. The Korean Journal of Local Government Studies, 20(1), 525-553.   DOI
2 J. H. Lee. (2018) Performance Evaluation of the Arts Organization: Focusing on Developing Alternative Evaluation Indicators of National Theater of Korea, The Korean Public Administration Journal, 27(1), 209-243.
3 S. J. Han. (2014) A Study on the Evaluation of the Effectiveness of Current Government Cultural Policies: Focused on the Importance-Performance Analysis. Korean Journal of Local Government & Administration Studies, 28(4), 209-231.   DOI
4 W. J. Baumol & W. G. Bowen. (1966). Performing Arts: The Economic Dilemma. New York: Twenty Century Fund.
5 R. Eisenberger & S. Armeli. (1997). Can Salient Reward Increase Creative Performance without Reducing Intrinsic Creative Interest? Journal of Personality and Social Psychology, 72, 652-663.   DOI
6 B. S. Frey. (1999). State Support and Creativity in the Arts: Some New Consideration. Journal of Cultural Economics, 23(1), 71-85.   DOI
7 W. J. Baumol & W. G. Bowen. (1965). On the Performing Arts: The Anatomy of Their Economic Problems. The American Economic Review, 55(1/2), 495-502.
8 G. Evans. (2000). Measures for Measure: Evaluating Performance and the Arts Organization. Studies in Culture, Organizations, and Societies, 6(2), 243-266.   DOI
9 S. Tospler. (2001). Culture, Commerce, and Civil Society. Administration & Society, 33(5), 511-532.
10 J. S. Jim. (2008). Reflection on Public Support for the Arts: A Case Study on the Gyeonggi Cultural Foundation's Arts Support Programs. The Journal of Cultural Policy, 20, 163-191
11 J. Crocker. (1981). Judgement of Covariation by Social Perceivers. Psychological Bulletin, 90, 272-292.   DOI
12 J. H. Roh & J. W. Choi. (2012). Performance Appraisal System of Employees in Culture and Art Organizations: The Case of National Gugak Center. Korean Public Personnel Administration Review, 11(2), 103-127.
13 C. K. Lee & S. R. Choi. (2009). Halo Effect in Performance Evaluation on Public Enterprise. Korean Public Administration Review, 43(3), 151-172.
14 I. J. Kim & J. S. Jeon. A Study on Problem and Improvement of Management Performance Evaluation System for the Local Public Corporations with Meta Evaluation. The Korean Journal of Local Government Studies, 13(1), 133-148.
15 E. L. Thorndike. (1920). A Constant Error in Psychological Ratings. Journal of Applied Psychology, 4(1), 25-29.   DOI
16 W. H. Cooper. (1981). Ubiquitous Halo. Psychological Bulletin, 90, 218-244.   DOI
17 J. M.. Feldman. (1981). Beyond Attribution Theory: Cognitive Processes in Performance Appraisal. Journal of Applied Psychology, 66, 127-148.   DOI
18 S. A. Fisicaro & E. L. Charles. (1990). Implications of Three Causal Models for the Measurement of Halo Error. Applied Psychological Measurement, 14(4), 419-429.   DOI
19 T. H. Feeley. (2002). Evidence of Halo Effects in Student Evaluations of Communication Instruction. Communication Education, 51(3), 225-236.   DOI
20 I. S. Han. (2016). Validity and Reliability of 360 Degree Feedback of Public Enterprise in Korea. Korean Public Administration Review, 50(2), 131-153.   DOI
21 S. A. Fisicaro & R. J. Vance. (1994). Comments on the Measurement of Halo. Educational and Psychological Measurement, 54, 366-371.   DOI
22 C. K. Lee & S. R. Choi. (2010). An Analysis on Rating Errors by Relative Performance Evaluation for Public Enterprise. Korean Journal of Public Administration, 48(1), 97-119.
23 H. Y. Jang. (2016). Analysis on the Effect of Characteristic of Policy on K-PART Focused on Culture & Art Policy. The Korean Association for Policy Sturies, 25(2), 91-124.
24 H. J. Ju, H. S. Ha & C. H. Jeong. (2016). The Study for Sustainability Securement of Culture and Arts Promotion Fund Program Evaluation: The Limitation and Reform of Program Evaluation System. Korean Comparative Government Review, 20(1), 75-99.   DOI
25 I. J. Kim & J. S. Jeon. (2009) A Study on Problem and Improvement of Management Performance Evaluation System for the Local Public Corporations with Meta Evaluation. The Korean Journal of Local Government Studies, 13(1), 133-148.
26 H. W. Chang & Y. H. Song. (2018) Actions of the Department in Context of Higher Education Evaluation Policy-A Case on the Christian Education of A University. Journal of Convergence for Information Technology, 8(3), 153-160.   DOI
27 W. C. Borman. (1979). Format and Training Effects on Rating Accuracy and Rater Errors. Journal of Applied Psychology, 64, 410-421.   DOI
28 G. S. Roh, M. C. Kim & I. H. Kim. (2004). Effect Analysis Focused on Region Economic in Culture Content Industry-Case Analysis of Culture Industry in Jeju Region. Journal of Digital Convergence, 2(1), 9-23.
29 S. M. Kim. (2016). Study on Development of Crafts Cultural Industry-Central Region of South Korea Craft Industrial as Center. Journal of Digital Convergence, 14(5), 385-390.   DOI
30 I. K. Bae. (2018). The Effects of Cultural Arts on the Improvement of Happiness Index of Seoul Citizens. Journal of Digital Convergence, 16(11), 89-96.   DOI
31 H. S. Lee. (2014). Analysis of Operational Competency of Public Culture & Arts Institution. Journal of Digital Convergence, 12(11), 23-32.   DOI