Asia pacific journal of information systems

The Korea Society of Management Information Systems (한국경영정보학회)
권호 표지

A Comprehensive Evaluation Framework of Web Sites as Living Places in Cyber Space

삶의 공간으로서의 웹 사이트에 대한 평가 체계

  • Published : 2003.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

With a swift development of information technology, web sites get more important roles as user's living places. This quantitative and qualitative expansion of web sites requires the need for an evaluation framework of web sites from comprehensive perspectives. This study proposes two dimensions for web site categorization and three dimensions for web site evaluation. These dimensions were developed based on the architectural perspectives that have been used to evaluate buildings in the real world for more than a thousand years. First, in order to categorize various web sites, we extracted two dimensions, user's goals and user's behaviors from behavioral architect which approaches user's behaviors in designing buildings. Second, in order to evaluate four web sites groups, we suggested three dimensions, which are firmness, commodity, delight used in evaluating buildings in the real world. Then for each of the four different web sites groups an empirical survey was conducted to verify these three dimensions of architectural metrics. This ends with study implications and limitations.

Keywords

References

  1. 박태훈, 국내 인터넷 이용자수 급증요인 분석, 한국 인터넷 정보 센터((KRNIC), 2000
  2. 정보현, '인터넷 웹 사이트 평가 모델에 관한 연구', 중앙대학교 국제경영대학교 석사논문, 1999
  3. Alexander, J. and Tate, M.A., 'Web wisdom: How to evaluate and create information quality on the Web. Hillsdale,' Mahwah: Lawrence Erlbaum Associates, 1999
  4. Anderson Dieberger, Jay Bolter, 'On the Design of Hyper Spaces,' ACM, Vol. 38, No.8, 1995
  5. Anderson, A, Fomell, C. and Lehmann, D., 'Customer satisfaction, market share and profitability: Findings from Sweden,' Journal of Marketing, 1994, pp. 53-66
  6. Anna Bouch, Allan Kuchinsky and Nina Bhatti, 'Quality is in the Eye of the Beholder: Meeting User's Requirements for Internet Quality of Service,' ACM CHI, 2000, Vol. 21 No. 1, 2000
  7. Baecker, R., Grudin, L Buxton, W. and Greenberg, S., Readings in human-computer interaction: Toward the year 2000 (2nd ed), SanFrancisco, CA: Morgan Kaufmann Publishers, 1995
  8. Borges, J., Morales, 1.1 Rodriguez, N., 'Page design guidelines developed through us-ability testing,' Human Factors for World Wide Web Development, 1998, pp. 137-152
  9. Cardozo R.N., 'An Experimental Study of Consumer Effort, Expectation and Satisfaction,' Journal of Marketing Research, 1965, pp. 244-249
  10. Carroll, J. and Mack, R, 'Metaphors and the Cognitive Representation of Computing Systems,' IEEE Transaction on System, Man and Cybernetics, Vol. 12, No.2, 1982, pp. 107-116 https://doi.org/10.1109/TSMC.1982.4308795
  11. Conger, S.A, Mason, R.O., Planning and designing effective Web sites, Cambridge, MA: Course Technology, 1988
  12. Daft, R and Lengel, R, 'Organizational Information Requirements, Media Richness and Structural Design,' Management Science, Vol. 32, No.5, 1986, pp. 554-571 https://doi.org/10.1287/mnsc.32.5.554
  13. Flanders, V., Willis, M., Web Pages that suck. San Francisco, CA: SYBEX Inc, 1998
  14. Gick, M. L. and Holyoak, K, 'Schema induction and analogical transfer,' Cognitive Psychology, 15, 1983, pp.1-28
  15. Gonzales, M., Fernandez, C and Cameselle, J., 'Empirical Validation of a Model of User Satisfaction with Buildings and Their Environments as Workplaces,' Journal of Environmental Psychology, 17, 1997, pp. 69-74 https://doi.org/10.1006/jevp.1996.0040
  16. Hoffman, D.L. and Novak, P.T., 'Marketing in Hypermedia Computer-Mediated Environments: Conceptual Foundations,' Journal of Marketing, 60, 1996, pp. 50-68 https://doi.org/10.2307/1251841
  17. Holyoak, K. and Thagard, P., Mental leaps: Analogy in creative thought, Cambridge, MA, The MIT Press, 1995
  18. Huang, K, Lee, Y. and Wang, R, Quality Information and Knowledge, Upper Saddle River, NJ: Prentice Hall, 1999
  19. Hunt K.H., Conceptualization and Measurement of Consumer Satisfaction/Dissatisfaction, Cambridge: MA, Marketing Science Institute, 1977
  20. Ingwer Borg and Patrick Groenen, Modern Multidimensional Scaling Theory and Applications, New York, Springer 1997
  21. Instone, K, Usability heuristics for the Web, http://www.webreview.com/1997/10_10/strategists/10_10_97_1.shtml, 1997
  22. Karen D., http://www.people.vcu.edu/jcsouth/library/online/validate/content.html, 1996
  23. Karpor, M., 'Software design manifesto,' ACM'91, 3, 1991
  24. Keeker, K, Improving Web site usability and appeal: Guidelines compiled by MSN Usability Research, July 1997
  25. Kruskal, Multidimensional scaling, Beverly Hills, CA: Sage Publications, 1978
  26. Lakoff, G. and Johnson, M., Metaphors We Live By., Chicago: IL: University of Chicago Press, 1990
  27. Landlow, G.P., 'Relationally Encoded Links and the Rhetoric of Hypertext, Proc. Hypertext,' ACM'87, Baltimore, MD, 1987, pp. 331-44
  28. Levi, M. and Conrad, F., 'A heuristic evaluation of a World Wide Web prototype,' Interactions, Vol. 3, No.4, 1996, pp. 50-61 https://doi.org/10.1145/234813.234819
  29. Lewin K, Principles of Topological Psychology, New York, McGraw Hill, 1936
  30. Margaret Phillips, UC Berkeley Library, http://www.lib.berkeley.edu/TeachingLib/Guides/Evaluation.html
  31. Mark L. and Davison., Multidimensional Scaling, New York, Wiley, 1983
  32. Mitchell, T., City of bits : Space, Place and the Infobahn, Cambridge, MIT Press, 1995
  33. Nielsen, J., 'Reliability of Severity Estimates for Usability Problems Found by Heuristic Evaluation Short Talks: In Search of a Method,' ACM CHI'92 Conference on Human Factors in Computing Systems, 1992
  34. Nielsen, J. Usability engineering. New York: AP Professional, 1993a
  35. Nielsen, J., 'Usability Evaluation and Inspection Methods Tutorials,' ACM INTERCHI'93 Conference on Human Factors in Computing Systems, 1993b
  36. Nielsen, J., http://www.useit.com/books/mullet_sano_foreword.html, 1994
  37. Nielsen, J., http://www.useit.com/alertbox/20000723.html, 2000
  38. Oliver R.L., Satisfaction: A behavioral Perspective on the Consumer, New York, New York: McGraw Hill, 1997
  39. Oliver R.L., 'Whence Consumer Loyalty?,' Journal of Marketing, Special Issue, 1999, pp. 33-44
  40. Olson J.C and Dover PA, 'Disconfirmation of Consumer Expectations through Product,' Journal of Applied Psychology, Vol. 64, No.2, 1979, pp. 179-189 https://doi.org/10.1037/0021-9010.64.2.179
  41. Parunak, H., 'Hypermedia typologies and user navigation,' In Proceedings of Hypertext'89 Conference, Pittsburgh, 1989, pp. 43-50
  42. Ping Zhang, Gisela M. and Dran, 'Satisfiers and Dissatisfiers A Two Factor Model for Website Design and Evaluation, Journal of the American Society for Information Science Processes,' Journal of Marketing Research, August 2000, pp. 258 -270
  43. Ravi Dhar and Klaus Wertembroch, 'Consumer Choice Between Hedonic and Utilitarian Goods,' Journal of Marketing Research, 37, 2000
  44. Rose, G., J. Khoo, D.W. Straub, 'Current technological impediments to business-to-consumer electronic commerce, Comm.,' AIS, Vol. 1, No. 16, 1999, pp. 1-74
  45. Schmitt, B., Experiential Marketing, The Free Press, 1999
  46. Shneiderman B., 'Beyond Accuracy, Reliability and Efficiency: Criteria for a Good Computer System,' ACM CHI'94 Conference on Human Factors in Computing Systems, 2, 1994, pp. 195
  47. Shneiderman B., Designing the user interface strategies for effective human computer interaction (3rd ed.). Reading, MA: Addison-Wesley, 1998
  48. Simon M. Kaplan, Willian J. Tolone, Douglas P.B. and Celsing B, 'Flexible, Active Support For Collaborative Work with Conversation Builder,' In the Proceeding of CSCW'92, 1992
  49. Small, R.V., 'Assessing the motivational quality of World Wide Websites,' ERIC Clearinghouse on Information and Technology, 1998
  50. Smith, A, 'Testing the surf: Criteria for evaluating Internet information resources,' The Public-Access Computer Systems Review, Vol.8, No.3, 1997
  51. Spool, J., Scanlon, T., Schroeder, W., Snyder, C and DeAngelo, T., Web site usability? A designer's guide, San Francisco, CA: Morgan Kaufmann Publishers, Inc, 1999
  52. Stefik, M., Internet Dreams, Archetypes, Myths and Metaphors. Cambridge, MA: The MIT Press, 1996
  53. TerryWignograd, Bringing Design to Software, MA: Addison-Wesley, 1996, pp. 10-16
  54. Tomoharu Yamaguchi, Itaru Hosomi and Toshiaki Miyashita; 'WebStage: An Active Media Enhanced World Wide Web Browser,'In the Proceeding of CHI'97, ACM Press, 1997
  55. Utting, K. and Yankelovich, N., 'Context and Orientation in Hypertext Networks, ACM Trans,' On Information Systems, 7, 1990, pp.58-84
  56. Wang, P., 'User's interaction with World Wide Web resources: an exploratory study using a holistic approach, Information,' Processing and Management, 36, 2000, pp.229-251 https://doi.org/10.1016/S0306-4573(99)00059-X
  57. Wilkinson, G.L., Bennett, L.T. and Oliver, K. M., 'Evaluation criteria and indicators of quality for Internet resource's, Educational Technology, 1997, pp. 52-59
  58. William J. Mitchell, City of Bits, MIT Press
  59. Wilson, E., Morrison, J. and Napier, A., 'Perceived Effectiveness of Computer Mediated Communications and Face-to-Face Communications in Student Software Development Teams,' Journal of Computer Information Systems, 1997, pp. 2-7
  60. Goldberg, Y., Safran, M. and Shapiro, E., 'Active Mail? A FrameWork for Implementing Groupware,' In the Proceeding of CSCW'92, ACM Press, 1992
  61. Webby Awards, http://www.webbyawards.com, 2001
  62. Preiser, W., Rabinowitz, H, Post-Occupancy Evaluation, New York, Van Nostrand Reinhold, 1988
  63. irmring, CM. and Reizenstein, J., 'Post-Occupancy Evaluation: An Overview,' Environment and Behavior, Vol. 12, No.4, 1980, pp. 429-450 https://doi.org/10.1177/0013916580124002