Browse > Article
http://dx.doi.org/10.7737/JKORMS.2013.38.1.029

Feedback Order and Problem-Solving Experience in Competitive Problem-Solving : An Empirical Analysis of Online Innovation Contests  

Mun, Hee Jin (연세대학교 기술경영학협동과정)
Chung, Yerim (연세대학교 경영대학)
Park, Kyung Min (연세대학교 경영대학)
Publication Information
Journal of the Korean Operations Research and Management Science Society / v.38, no.1, 2013 , pp. 29-44 More about this Journal
Abstract
This study suggests that as receiving feedback is moved back, the effectiveness of problem-solving increases. Utilizing data from innovation contests in which a number of problem solvers compete with each other, we answer questions such as whether the order of receiving first feedback affects problem-solving effectiveness and how problem-solving experience moderates the relationship between the first feedback order and problem-solving effectiveness. Empirical results based on data collected from Kaggle, an online platform for innovation contests, showed that the order that contest participants receive the first feedback increases problem-solving effectiveness. Furthermore, the more prior experience of contest participants accentuates the suggested relationship between the order of receiving the first feedback and problem-solving effectiveness.
Keywords
Feedback Order; Innovation Contests; Problem-Solving Experience;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 강희택, 오한모, "지식관리시스템에서 지각된 피드백, 동기, 지식기여간의 관계에 대한 실증분석", 한국경영과학회지 , 제37권, 제1호(2012), pp.73-88.
2 박성희, 박경민, "회계기준 및 시장기준 성과피드백이 기술탐색에 미치는 영향", 한국경영과학회지 , 제36권, 제1호(2011), pp.57-68.   과학기술학회마을
3 Afuah, A. and C.L. Tucci, "Crowdsourcing as a Solution to Distant Search," Academy of Management Review, Vol.37, No.3(2012), pp.355-375.   DOI   ScienceOn
4 Argote, L. and E. Miron-Spektor, "Organizational Learning : From Experience to Knowledge," Organization Science, Vol.22, No.5(2011), pp. 1123-1137.   DOI   ScienceOn
5 Athanasopoulos, G. and R.J. Hyndman, "The Value of Feedback in Forecasting Competitions," International Journal of Forecasting, Vol.27, No.3(2011), pp.845-849.   DOI   ScienceOn
6 Audia, P.G. and J.A. Goncalo, "Past Success and Creativity over Time : A Study of Inventors in the Hard Disk Drive Industry," Management Science, Vol.53, No.1(2007), pp.1-15.   DOI   ScienceOn
7 Bockstedt, J., C. Druehl, and A. Mishra, "Do Participation Strategy and Experience Impact the Likelihood of Winning in Unblind Innovation Contests?," Working Paper, (2011), Retrieved(http://ssrn.com/abstract=1961244).
8 Bothner, M.S., J.-H. Kang, and T.E. Stuart, "Competitive Crowding and Risk Taking in a Tournament : Evidence from NASCAR Racing," Administrative Science Quarterly, Vol.52, No.2 (2007), pp.208-247.
9 Boudreau, K.J., N. Lacetera, and K.R. Lakhani, "Incentives and Problem Uncertainty in Innovation Contests : An Empirical Analysis," Management Science, Vol.57, No.5(2011), pp.843- 863.   DOI   ScienceOn
10 Bowman, E.H. and G.T. Moskowitz, "Real Options Analysis and Strategic Decision Making," Organization Science, Vol.12, No.6(2001), pp.772-777.   DOI   ScienceOn
11 Carpenter, J., "May the Best Analyst Win," SCIENCE, Vol.331, No.6018(2011), pp.698-699.   DOI   ScienceOn
12 Chen, W.-R., "Determinants of Firms' Backward-and Forward-looking R&D Search Behavior," Organization Science, Vol.19, No.4 (2008), pp.609-622.   DOI   ScienceOn
13 Cyert, R.M. and J.G. March, A Behavioral Theory of the Firm, Prentice-Hall, Englewood Cliffs, NJ, 1963.
14 Denrell, J. and J.G. March, "Adaptation as Information Restriction : The Hot Stove Effect," Organization Science, Vol.12, No.5(2001), pp. 523-538.   DOI   ScienceOn
15 Dane, E., "Reconsidering the Trade-off between Expertise and Flexibility : A Cognitive Entrenchment Perspective," Academy of Management Review, Vol.35, No.4(2010), pp.579-603.   DOI   ScienceOn
16 Davidson, R. and J. MacKinnon, Estimation and Inference in Econometrics, Oxford University Press, New York, 1993.
17 Denrell, J., C. Fang and D.A. Levinthal, "From T-mazes to Labyrinths : Learning from Modelbased Feedback," Management Science, Vol.50, No.10(2004), pp.1366-1378.   DOI   ScienceOn
18 Fiske, S.T. and S.E. Taylor, Social Cognition, Addison-Wesley, Reading, MA, 1984.
19 Gavetti, G. and D.A. Levinthal, "Looking Forward and Looking Backward : Cognitive and Experiential Search," Administrative Science Quarterly, Vol.45, No.1(2000), pp.113-137.   DOI   ScienceOn
20 Jeppesen, L.B. and K.R. Lakhani, "Marginality and Problem-solving Effectiveness in Broadcast Search," Organization Science, Vol.21, No. 5(2010), pp.1016-1033.   DOI   ScienceOn
21 Kaplan, S. and M. Tripsas, "Thinking about Technology : Applying a Cognitive Lens to Technical Change," Research Policy, Vol.37, No.5(2008), pp.790-805.   DOI   ScienceOn
22 Katila, R. and E.L. Chen, "Effects of Search Timing on Innovation : The Value of not Being in Sync with Rivals," Administrative Science Quarterly, Vol.53, No.4(2008), pp.593-625.   DOI
23 Kauffman, S., J. Lobo, and W.G. Macready, "Optimal Search on a Technology Landscape," Journal of Economic Behavior and Organization, Vol.43, No.2(2000), pp.141-166.   DOI   ScienceOn
24 Knudsen, T. and D.A. Levinthal, "Two Faces of Search : Alternative Generation and Alternative Evaluation," Organization Science, Vol.18, No.1(2007), pp.39-54.   DOI   ScienceOn
25 Lurie, N.H. and J.M. Swaminathan, "Is timely Information Always Better? The Effect of Feedback Frequency on Decision Making," Organizational Behavior and Human Decision Processes, Vol.108, No.2(2009), pp.315-329.   DOI   ScienceOn
26 Kornish, L.J. and K.T. Ulrich, "Opportunity Spaces in Innovation : Empirical Analysis of Large Sample of Ideas," Management Science, Vol.57, No.1(2011), pp.107-128.   DOI   ScienceOn
27 Lehman, D.W., J. Hahn, R. Ramanujam, and B.J. Alge, "The Dynamics of the Performancerisk Relationship within a Performance Period : The Moderating Role of Deadline Proximity," Organization Science, Vol.22, No.6(2011), pp. 1613-1630.   DOI
28 Levinthal, D.A. and J.G. March, "A Model of Adaptive Organizational Search," Journal of Economic Behavior and Organization, Vol.2, No.4(1981), pp.307-333.   DOI   ScienceOn
29 Maggitti, P.G., K.G. Smith, and R. Katila, "The Complex Search Process of Invention," Research Policy, In Press(2012).
30 March, J.G. and J.P. Olsen, Ambiguity and Choice in Organizations, University Press of Norway, Bergen, 1976.
31 March, J.G. and H.A. Simon, Organizations, 2nd ed. Blackwell, Cambridge, MA, 1993.
32 Martin, X. and W. Mitchell, "The Influence of Local Search and Performance Heuristics on New Design Introduction in a New Product Market," Research Policy, Vol.26, No.7-8(1998), pp.753-771.   DOI   ScienceOn
33 Neter, J., M. Kutner, W. Wasserman, and C. Nachtsheim, Applied Linear Statistical Models, McGraw-Hill/Irwin, Chicago, 1996.
34 Nickerson, J.A. and T.R. Zenger, "A Knowledge-based Theory of the Firm : The Problem-solving Perspective," Organization Science, Vol.15, No.6(2004), pp.617-632.   DOI   ScienceOn
35 Shane, S., "Prior Knowledge and the Discovery of Entrepreneurial Opportunities," Organization Science, Vol.11, No.4(2000), pp.448-469.   DOI   ScienceOn
36 Papke, L.E. and J.M. Wooldridge, "Econometric Methods for Fractional Response Variables with an Application to 401(k) Plan Participation Rates," Journal of Applied Econometrics, Vol.11, No.6 (1996), pp.619-632.   DOI
37 Ramalho, E.A., J.J.S. Ramalho, and J.M.R. Murteira, "Alternative Estimating and Testing Empirical Strategies for Fractional Regression Models," Journal of Economic Surveys, Vol. 25, No.1(2011), pp.19-68.   DOI   ScienceOn
38 Ramalho, J. and J.V.D. Silva, "A Two-part Fractional Regression Model for the Financial Leverage Decisions of Micro, Small, Medium and Large Firms," Quantitative Finance, Vol.9, No.5(2009), pp.621-636.   DOI   ScienceOn
39 Taylor, A. and H.R. Greve, "Superman or the Fantastic Four? Knowledge Combination and Experience in Innovative Teams," Academy of Management Journal, Vol.49, No.4(2006), pp.723-740.   DOI   ScienceOn
40 Valentino-Devries, J., "May the Best Algorithm Win.," Wall Street Journal, 2011.
41 Walsh, J.P., "Managerial and Organizational Cognition : Notes from a Trip Down Memory Lane," Organization Science, Vol.6, No.3(1995), pp.280-321.   DOI   ScienceOn
42 Winter, S.G., G. Cattani, and A. Dorsch, "The Value of Moderate Obsession : Insights from a New Model of Organizational Search," Organization Science, Vol.18, No.3(2007), pp.403-419.   DOI   ScienceOn
43 Wooten, J.O. and K.T. Ulrich, "Idea Generation and the Role of Feedback : Evidence from Field Experiments with Innovation Tournaments," Working Paper, 2012, Retrieved(http://ssrn.com/abstract=1838733).