Browse > Article

A Comprehensive Evaluation Framework of Web Sites as Living Places in Cyber Space  

Hong, Seo-Young (삼성 SDS)
Kim, Jin-Woo (연세대학교 경영학과)
Publication Information
Asia pacific journal of information systems / v.13, no.4, 2003 , pp. 1-27 More about this Journal
Abstract
With a swift development of information technology, web sites get more important roles as user's living places. This quantitative and qualitative expansion of web sites requires the need for an evaluation framework of web sites from comprehensive perspectives. This study proposes two dimensions for web site categorization and three dimensions for web site evaluation. These dimensions were developed based on the architectural perspectives that have been used to evaluate buildings in the real world for more than a thousand years. First, in order to categorize various web sites, we extracted two dimensions, user's goals and user's behaviors from behavioral architect which approaches user's behaviors in designing buildings. Second, in order to evaluate four web sites groups, we suggested three dimensions, which are firmness, commodity, delight used in evaluating buildings in the real world. Then for each of the four different web sites groups an empirical survey was conducted to verify these three dimensions of architectural metrics. This ends with study implications and limitations.
Keywords
Citations & Related Records
연도 인용수 순위
  • Reference
1 박태훈, 국내 인터넷 이용자수 급증요인 분석, 한국 인터넷 정보 센터((KRNIC), 2000
2 Conger, S.A, Mason, R.O., Planning and designing effective Web sites, Cambridge, MA: Course Technology, 1988
3 Daft, R and Lengel, R, 'Organizational Information Requirements, Media Richness and Structural Design,' Management Science, Vol. 32, No.5, 1986, pp. 554-571   DOI   ScienceOn
4 Gick, M. L. and Holyoak, K, 'Schema induction and analogical transfer,' Cognitive Psychology, 15, 1983, pp.1-28
5 Hoffman, D.L. and Novak, P.T., 'Marketing in Hypermedia Computer-Mediated Environments: Conceptual Foundations,' Journal of Marketing, 60, 1996, pp. 50-68   DOI   ScienceOn
6 Holyoak, K. and Thagard, P., Mental leaps: Analogy in creative thought, Cambridge, MA, The MIT Press, 1995
7 Hunt K.H., Conceptualization and Measurement of Consumer Satisfaction/Dissatisfaction, Cambridge: MA, Marketing Science Institute, 1977
8 Lakoff, G. and Johnson, M., Metaphors We Live By., Chicago: IL: University of Chicago Press, 1990
9 Levi, M. and Conrad, F., 'A heuristic evaluation of a World Wide Web prototype,' Interactions, Vol. 3, No.4, 1996, pp. 50-61   DOI   ScienceOn
10 Mark L. and Davison., Multidimensional Scaling, New York, Wiley, 1983
11 Nielsen, J., http://www.useit.com/books/mullet_sano_foreword.html, 1994
12 Olson J.C and Dover PA, 'Disconfirmation of Consumer Expectations through Product,' Journal of Applied Psychology, Vol. 64, No.2, 1979, pp. 179-189   DOI
13 Parunak, H., 'Hypermedia typologies and user navigation,' In Proceedings of Hypertext'89 Conference, Pittsburgh, 1989, pp. 43-50
14 Ping Zhang, Gisela M. and Dran, 'Satisfiers and Dissatisfiers A Two Factor Model for Website Design and Evaluation, Journal of the American Society for Information Science Processes,' Journal of Marketing Research, August 2000, pp. 258 -270
15 Rose, G., J. Khoo, D.W. Straub, 'Current technological impediments to business-to-consumer electronic commerce, Comm.,' AIS, Vol. 1, No. 16, 1999, pp. 1-74
16 Schmitt, B., Experiential Marketing, The Free Press, 1999
17 Shneiderman B., 'Beyond Accuracy, Reliability and Efficiency: Criteria for a Good Computer System,' ACM CHI'94 Conference on Human Factors in Computing Systems, 2, 1994, pp. 195
18 Small, R.V., 'Assessing the motivational quality of World Wide Websites,' ERIC Clearinghouse on Information and Technology, 1998
19 Stefik, M., Internet Dreams, Archetypes, Myths and Metaphors. Cambridge, MA: The MIT Press, 1996
20 Utting, K. and Yankelovich, N., 'Context and Orientation in Hypertext Networks, ACM Trans,' On Information Systems, 7, 1990, pp.58-84
21 Wang, P., 'User's interaction with World Wide Web resources: an exploratory study using a holistic approach, Information,' Processing and Management, 36, 2000, pp.229-251   DOI   ScienceOn
22 Wilkinson, G.L., Bennett, L.T. and Oliver, K. M., 'Evaluation criteria and indicators of quality for Internet resource's, Educational Technology, 1997, pp. 52-59
23 TerryWignograd, Bringing Design to Software, MA: Addison-Wesley, 1996, pp. 10-16
24 Goldberg, Y., Safran, M. and Shapiro, E., 'Active Mail? A FrameWork for Implementing Groupware,' In the Proceeding of CSCW'92, ACM Press, 1992
25 Webby Awards, http://www.webbyawards.com, 2001
26 Oliver R.L., Satisfaction: A behavioral Perspective on the Consumer, New York, New York: McGraw Hill, 1997
27 Flanders, V., Willis, M., Web Pages that suck. San Francisco, CA: SYBEX Inc, 1998
28 Ingwer Borg and Patrick Groenen, Modern Multidimensional Scaling Theory and Applications, New York, Springer 1997
29 Instone, K, Usability heuristics for the Web, http://www.webreview.com/1997/10_10/strategists/10_10_97_1.shtml, 1997
30 Anna Bouch, Allan Kuchinsky and Nina Bhatti, 'Quality is in the Eye of the Beholder: Meeting User's Requirements for Internet Quality of Service,' ACM CHI, 2000, Vol. 21 No. 1, 2000
31 Huang, K, Lee, Y. and Wang, R, Quality Information and Knowledge, Upper Saddle River, NJ: Prentice Hall, 1999
32 Gonzales, M., Fernandez, C and Cameselle, J., 'Empirical Validation of a Model of User Satisfaction with Buildings and Their Environments as Workplaces,' Journal of Environmental Psychology, 17, 1997, pp. 69-74   DOI   ScienceOn
33 Ravi Dhar and Klaus Wertembroch, 'Consumer Choice Between Hedonic and Utilitarian Goods,' Journal of Marketing Research, 37, 2000
34 Keeker, K, Improving Web site usability and appeal: Guidelines compiled by MSN Usability Research, July 1997
35 Simon M. Kaplan, Willian J. Tolone, Douglas P.B. and Celsing B, 'Flexible, Active Support For Collaborative Work with Conversation Builder,' In the Proceeding of CSCW'92, 1992
36 Cardozo R.N., 'An Experimental Study of Consumer Effort, Expectation and Satisfaction,' Journal of Marketing Research, 1965, pp. 244-249
37 Kruskal, Multidimensional scaling, Beverly Hills, CA: Sage Publications, 1978
38 Landlow, G.P., 'Relationally Encoded Links and the Rhetoric of Hypertext, Proc. Hypertext,' ACM'87, Baltimore, MD, 1987, pp. 331-44
39 Carroll, J. and Mack, R, 'Metaphors and the Cognitive Representation of Computing Systems,' IEEE Transaction on System, Man and Cybernetics, Vol. 12, No.2, 1982, pp. 107-116   DOI   ScienceOn
40 Oliver R.L., 'Whence Consumer Loyalty?,' Journal of Marketing, Special Issue, 1999, pp. 33-44
41 Nielsen, J. Usability engineering. New York: AP Professional, 1993a
42 Smith, A, 'Testing the surf: Criteria for evaluating Internet information resources,' The Public-Access Computer Systems Review, Vol.8, No.3, 1997
43 Mitchell, T., City of bits : Space, Place and the Infobahn, Cambridge, MIT Press, 1995
44 Baecker, R., Grudin, L Buxton, W. and Greenberg, S., Readings in human-computer interaction: Toward the year 2000 (2nd ed), SanFrancisco, CA: Morgan Kaufmann Publishers, 1995
45 Karpor, M., 'Software design manifesto,' ACM'91, 3, 1991
46 Margaret Phillips, UC Berkeley Library, http://www.lib.berkeley.edu/TeachingLib/Guides/Evaluation.html
47 William J. Mitchell, City of Bits, MIT Press
48 Borges, J., Morales, 1.1 Rodriguez, N., 'Page design guidelines developed through us-ability testing,' Human Factors for World Wide Web Development, 1998, pp. 137-152
49 Lewin K, Principles of Topological Psychology, New York, McGraw Hill, 1936
50 Nielsen, J., 'Reliability of Severity Estimates for Usability Problems Found by Heuristic Evaluation Short Talks: In Search of a Method,' ACM CHI'92 Conference on Human Factors in Computing Systems, 1992
51 Anderson, A, Fomell, C. and Lehmann, D., 'Customer satisfaction, market share and profitability: Findings from Sweden,' Journal of Marketing, 1994, pp. 53-66
52 irmring, CM. and Reizenstein, J., 'Post-Occupancy Evaluation: An Overview,' Environment and Behavior, Vol. 12, No.4, 1980, pp. 429-450   DOI   ScienceOn
53 Karen D., http://www.people.vcu.edu/jcsouth/library/online/validate/content.html, 1996
54 Wilson, E., Morrison, J. and Napier, A., 'Perceived Effectiveness of Computer Mediated Communications and Face-to-Face Communications in Student Software Development Teams,' Journal of Computer Information Systems, 1997, pp. 2-7
55 Shneiderman B., Designing the user interface strategies for effective human computer interaction (3rd ed.). Reading, MA: Addison-Wesley, 1998
56 정보현, '인터넷 웹 사이트 평가 모델에 관한 연구', 중앙대학교 국제경영대학교 석사논문, 1999
57 Spool, J., Scanlon, T., Schroeder, W., Snyder, C and DeAngelo, T., Web site usability? A designer's guide, San Francisco, CA: Morgan Kaufmann Publishers, Inc, 1999
58 Anderson Dieberger, Jay Bolter, 'On the Design of Hyper Spaces,' ACM, Vol. 38, No.8, 1995
59 Nielsen, J., http://www.useit.com/alertbox/20000723.html, 2000
60 Tomoharu Yamaguchi, Itaru Hosomi and Toshiaki Miyashita; 'WebStage: An Active Media Enhanced World Wide Web Browser,'In the Proceeding of CHI'97, ACM Press, 1997
61 Nielsen, J., 'Usability Evaluation and Inspection Methods Tutorials,' ACM INTERCHI'93 Conference on Human Factors in Computing Systems, 1993b
62 Alexander, J. and Tate, M.A., 'Web wisdom: How to evaluate and create information quality on the Web. Hillsdale,' Mahwah: Lawrence Erlbaum Associates, 1999
63 Preiser, W., Rabinowitz, H, Post-Occupancy Evaluation, New York, Van Nostrand Reinhold, 1988