Why Your Manuscripts Were Rejected or Required a Major Revision: An Analysis of Asia Pacific Journal if Information Systems

MIS 논문의 '게재 불가' 및 '수정 후 재심사' 사유: Asia Pacific Journal of Information Systems 심사소견서 분석

  • Published : 2009.06.30

Abstract

As the common saying attests, a publish-or-perish world, publishing is absolutely critical for academic researchers' successful careers. It is the most objectively-accepted academic performance criteria and the most viable way to attain public and academic recognition. Asia Pacific Journal of Information Systems(APJIS) has been recognized as the most influential domestic journal in Korean MIS field since July, 1991. Therefore, publishing in APJIS means your research is original, valid, and contributive. While most researchers learn how to publish an article in APJIS through a repetitive review process, thereby improving their chance of the' accepted' through their personal trial and error experiences, such valuable lessons and know-how tend to be kept personally and rarely shared. However, useful insights into research and publication skills could be also gained from sharing others' errors, neglect, and misjudgments which are equally critical in improving researchers' knowledge in the field (Murthy and Wiggins, 2002). For this reason, other academic disciplines make systematic efforts to examine the paper review process of major journals and share the findings from these studies with the rest of the research community members (Beyer et al., 1995; Cummings et al, 1985; Daft, 1995; Jauch and Wall, 1989; Murthy and Wiggins, 2002). Recognizing the urgent need to provide such type of information to MIS research community in Korea, we have chosen the most influential academic journal, APJIS with an intention to share the answer to the following research question: "What are the common problems found in the manuscripts either 'rejected' or 'required a major revision' by APJIS reviewers?" This study analyzes the review results of manuscripts submitted to APJIS (from January, 2006 to October, 2008), particularly those that were 'rejected' or required a 'major revision' at the first round. Based on Daft's(1995) study, twelve most-likelihood problems were defined and used to analyze the reviews. The twelve criteria for classification, or "twelve problems", are as follows: No theory, Concepts and operationalization not in alignment, Insufficient definition--theory, Insufficient rationale--design, Macrostructure--organization and flow, Amateur style and tone, Inadequate research design, Not relevant to the field, Overengineering, Conclusions not in alignment, Cutting up the data, and Poor editorial practice. Upon the approval of the editorial board of APJIS, the total 252 reviews, including 11 cases of 2005 and 241 cases from July, 2006 to October, 2008, were received without any information about manuscripts, authors, or reviewers. Eleven cases of 2005 were used in the pilot test because the data of 2005 were not in complete enumeration, and the 241 reviews (113 cases of 'rejection' and 128 ones of 'major revision') of 2006, 2007, and 2008 were examined in this study. Our findings show that insufficient rationale-design(20.25%), no theory(18.45%), and insufficient definition--theory(15.69%) were the three leading reasons of 'rejection' and 'major revision.' Between these two results, the former followed the same order of three major reasons as an overall analysis (insufficient rationale-design, no theory, and insufficient definition-theory), but the latter followed the order of insufficient rationale--design, insufficient definition--theory, and no theory. Using Daft's three major skills-- 'theory skills', 'design skills', and 'communication skills'-- twelve criteria were reclassified into 'theory problems', 'design problems', and 'communication problems' to derive more practical implications of our findings. Our findings show that 'theory problems' occupied 43.48%, 'design problems' were 30.86%, and 'communication problems' were 25.86%. In general, the APJIS reviewers weigh each of these three problem areas almost equally. Comparing to other disciplines like management field shown in Daft's study, the portion of 'design problems' and 'communication problems' are much higher in manuscripts submitted to the APJIS than in those of Administrative Science Quarterly and Academy of Management Journal even though 'theory problems' are the most predominant in both disciplines.

Keywords

References

  1. Bedeian, A.G., 'The Manuscript Review Process: The Proper Roles of Authors, Referees, and Editors,' Journal ofManagement Inquiry, Vol. 12, No. 4, 2003, pp. 331-338
  2. Beyer, J.M., Chanove, R.G., and Fox, W.B., 'The Review Process and the Fates of Manuscripts Submitted to AMJ,' Academy of Management Journal, Vol. 38, No. 5, 1995, pp. 1219-1260 https://doi.org/10.2307/256856
  3. Bhattacharjee, S., Tung, Y.A, and Pathak, B., 'Author Experiences with the IS Journal Review Process,' Communications of the Association for lnformation Systems, Vol. 13, 2004, pp. 629-953
  4. Cummings, L.L., Frost, P.J., and VakiI, T.F., 'The Manuscript Review Process: A View from the Inside on Coaches, Critics and Special Cases,' Publishing in the Organizational Sciences, Homewood, IL: Irwin, 1985, pp. 193-209
  5. Daft, R.L., 'Why I Recommended that Your Manuscript Be Rejected and What You can Do about It,' Publishing in the Organizational Sciences(2nd Edition), L. Cummings and P. Frost(Eds.), Thousand Oaks, CA: Sage Publications, 1995, pp. 164-182
  6. Han, I., 'Editor's Comment,' Asia Pacific Journal of Information Systems, Vol. 18, No.4, 2008
  7. Jauch, L.R. and Wall, J.L., 'What They Do When Then Get Your Manuscript: A Survey of Academy of Management Reviewer Practices,' Academy of Management Journal, Vol. 32, No. 1, 1989, pp. 157-173 https://doi.org/10.2307/256424
  8. Kim, K.M., Park, C.S., Kim, J.S., Lee, H.G., and Im, K.S., 'An Empirical Study on Research Diversity in Journal of MIS Research,' Asia Pacific Journal of Information Systems, Vol. 15, No. 2, 2005, pp. 149-170
  9. Lee A.S., 'Reviewing a Manuscript for Publication,' Journal of Operations Management, Vol. 13, No. 1, 1995, pp. 87-92 https://doi.org/10.1016/0272-6963(95)94762-W
  10. Murthy, U.S. and Wiggins, C.E., 'Why Manuscripts Are Rejected: An Analysis of JIS Rejections,' Journal of Information Systems, Vol. 16, No. 1, 2002, pp. 41-48 https://doi.org/10.2308/jis.2002.16.1.41
  11. Scheneider, B., 'Some Propositions About Getting Research Published,' Publishing in the Organizational Sciences(2nd Edition), L. Cummings and P. Frost(Eds.), Thousand Oaks, CA: Sage Publications, 1995, pp. 216-226
  12. Seo, E.G. and Han, I., 'Bibliometric Analysis on MIS Research,' Asia Pacific Journal of Information Systems, Vol. 7, No. 3, 1997, pp 145-165
  13. Straub, D.W. and Ang, S., 'Readability and the Relevance versus Rigor Debate,' MIS Quarterly, Vol. 32, No. 4, 2008, pp.iii-xiv
  14. Whetten D.A., 'What Constitutes a Theoretical Contribution?,' Academy of Management Review, Vol. 14, No. 3, 1989, pp. 490-495 https://doi.org/10.2307/258554