Browse > Article
http://dx.doi.org/10.5143/JESK.2012.31.1.63

A Usability Assessment Metric for Ubiquitous Services: Quantification of the Interactivity Attribute in Inter-personal Services  

Lee, Joo-Hwan (Samsung S1 Corportation)
Song, Joo-Bong (Department of Industrial Engineering, Seoul National University)
Yun, Myung-Hwan (Department of Industrial Engineering, Seoul National University)
Publication Information
Journal of the Ergonomics Society of Korea / v.31, no.1, 2012 , pp. 63-76 More about this Journal
Abstract
Objective: The main objective of this study is to propose a user-centered assessment metric for ubiquitous services. Background: As the ubiquitous era took off, the interactions between ubiquitous services and users have come to take an important position. It is essential to conceptualize a new assessment model that considers human-system interaction capability with a user-centered design perspective. Method: The evaluation model for the interactivity of ubiquitous service was approached from the concept of usability and inter-personality of services. As a validation study, suggested assessment metric was utilized to evaluate the u-Home service. Priority weighting of each assessment metric was derived using the quantification type-I analysis. Results: To evaluate interactivity, this study suggested a quantitative metric for user testing performed after classifying the interactivity characteristics to contextualization; ubiquity; user experience; and service capability. Conclusion: This study suggest the metric for the ubiquitous service that are experienced in real life, and introduced the concept of ubiquitous service interactivity. Application: The suggested evaluation metric can be used to evaluate interactivity level of ubiquitous service and identify the potential problem and usability requirements at the early stage of service development.
Keywords
Ubiquitous service; Interactivity; User-Centered design; Usability evaluation method;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Sweeney, M., Maguire, M. and Shackel, B., Evaluating user-computer interaction: a framework, International Journal of Man-Machine Studies, 38, 689-711, 1993.   DOI   ScienceOn
2 UbiComp01, Evaluation methodologies for ubiquitous computing, Workshop on Evaluation Methodologies for Ubiquitous Computing, 2001.
3 UbiComp02, User-Centered Evaluation of Ubiquitous Computing Application, Workshop on User-Centered Evaluation of Ubiquitous Computing Application, 2002.
4 Williams, J. R., Developing Performance Support for Computer Systems: a Strategy for Maximizing Usability and Learnability, CRC Press, 2004.
5 Parasuraman, A. and Zeithaml, V. A., Alternative scales for measuring service quality: A comparative assessment based on psychometric, Journal of Retailing, 70(3), 201-230, 1994.   DOI   ScienceOn
6 Peter, T., Christopher, S. C., Tian, X. and Myra, D., Evaluation of Visual Notification Cues for Ubiquitous Computing, UbiComp03, Lecture Notes in Computer Science(LNCS), 2864, 349-366, 2003.
7 Rafaeli, S., Interactivity: From new media to communication, in R. P. Hawkins, J. M. Wieman and S. Pingree(eds.), Advancing Communication Science: Merging Mass and Interpersonal Processes, Newbury Park. CA. 110-134, 1998.
8 Resnick, P., Beyond Bowling Together; SocioTechnical Capital, in John M. Carroll(eds.), Human-Computer Interaction in the New Millennium, Addison-Wesley, ACM Press, NY. 2001.
9 Ryu, H., Hong, G. Y. and James, H., Quality assessment technique for ubiquitous software and middleware, Res. Lett. Inf. Math. Sci.(Research Letters Information Mathematics Science), 9, 13-87, 2006.
10 Riekki, J., Isomursu, P. and Isomursu, M., Evaluating the calmness of ubiquitous applications, Proceedings of Production focused Software Process Improvement, 5th International Conference, PROFES 2004, Kansei Science City, Japan. 2004.
11 Scholtz, J., Metrics for Evaluating Human Information Interaction Systems, Interacting With Computers, 18, 507-527, 2006.   DOI   ScienceOn
12 Scholtz, J. and Consolvo, S., Toward a framework for evaluating ubiquitous computing applications, Pervasive Computing, 3(2), 82-89, 2004.
13 Seffah, A., Donyaee, M., Kline, R. B. and Padda, H. K., Usability measurement and metrics: A consolidated model, Software Quality Journal, 14, 159-178, 2006.   DOI   ScienceOn
14 Steitz, N. A., Tandler, P., Muller-Tomfelde, C. and Konomi, S., Roomware: Toward the Next Generation of Human-Computer Interaction Based on an Integrated Design of Real and Virtual Worlds, in John M. Carroll(eds.), Human-Computer Interaction in the New Millennium, Addison-Wesley, ACM Press, NY. 2001.
15 Leonard, M., Jessup, and Robey, D., The relevance of social issues in ubiquitous computing environments, Communications of the ACM, 45(12), 2002.
16 Lin, H. X., Choong, Y. and Salvendy, G., A proposed index of usability: A method for comparing the relative usability of different software systems, Behavior and Information Technology, 16, 267-277, 1997.   DOI   ScienceOn
17 Lindenberg, J., Pasman, W., Kranenborg, K., Stegeman, J. and Neerincx, M. A., Improving service matching and selection in ubiquitous computing environments: a user study, Personal and Ubiquitous Computing, 11, 59-68, 2007.   DOI
18 Lyytinen, K. and Yoo, Y. Issues and challenges in Ubiquitous Computing, Communications of the ACM, 45(12), 63-65, 2002.
19 Loiacono, E. T., Watson, R. T. and Goodhue, D. L., WebQual: A website quality instrument, Working paper 2000-126-0, University of Georgia, 2000.
20 Lombard, M. and Snyder-Dutch, J., Interactive Advertising and Presence: A Framework, Journal of Interactive Advertising, 1(2), 2001.
21 Markett, C., Arnedillo, I., Weber, S. and Tangney, B., Using short message service to encourage interactivity in the classroom, Computers & Education, 46(3), 280-293, 2006.   DOI   ScienceOn
22 McMillan, S. J., Four models of cyber-interactivity: Individual perceptions of interactivity in computer-mediated environments, International Communication Association Annual Conference, SF. CA. 1999.
23 Morikawa, H. and Aoyama, T., Realizing the ubiquitous network: the internet and beyond, Telecommunication Systems, 25, 449-468, 2004.   DOI
24 Newman, W. M. and Lamming, M. G., Interactive System Design, Addison- Wesley. Wokingham. 1995.
25 Norman, D. A., Invisible Computing; Why Good Products Can Fail, the Personal Computer Is So Complex and Information Appliances Are the Solution, MIT Press, 1999.
26 ISO/IEC 25000, Software Engineering - Software Product Quality Requirements and Evaluation(SQuaRE) - Guide to SQuaRE, International Standards Organization, Geneva, Switzerland. 2005.
27 Jo, W. D., Lee, K. J., Lee, H. K., Kwon, O. B., Kim, K. G. and Lee, E. J., Ubiquitous Paradigm and u-Society, Jinhan M&B Inc., Korea. 2006.
28 Jokela, T., Koivumaa, J., Pirkola, J., Salminen, P. and Kantola, N., Methods for quantitative usability requirements: a case study on the development of the user interface of a mobile phone, Personal and Ubiquitous Computing, 10, 345-355, 2006.   DOI   ScienceOn
29 Kim, C. R., MDS & Conjoint analysis using SAS, Freedom Academy, Korea. 2003.
30 Junglas, I. A. and Watson, R. T., u-Commerce: An experimental investigation of ubiquity and uniqueness, Proceedings of 24th International Conference on Information Systems(ICIS), (pp.414-426), 2003.
31 Kristen, K. G., Michael, D. B. and Sarah, P. E., A comparison of Usability between Voting Methods, Proceedings of USENIX/Accurate EVT (Electronic Voting Technology) workshop, Vancouver. Canada. 2006.
32 Kwon, O. B. and Kim, J. H., Ubi-SERVQUAL: An Amended SERVQUAL Model for Assessing the Quality of Ubiquitous Computing Services, Conference of the Korea Society of Management Information Systems, Seoul. Korea. 2005.
33 Kwon, O., Yoo, K. and Suh, E., ubiES: Applying ubiquitous computing technologies to an expert system for context-aware proactive services, Electronic Commerce Research and Applications, 5, 209-219, 2006.   DOI   ScienceOn
34 Lattin, J., Carroll, J. D. and Green, P. E., Analyzing Multivariate Data, Brooks/Cole-Thomson Learning Inc., Canada. 2003.
35 Lee, S. H., The effects of ubiquitous attributes of mobile contents on perceived interactivity and behavioral outcome, Ph.D. Dissertation, Seoul National University, Korea. 2006.
36 Lee, W. J., The effects of Ubiquitous interactivity characteristic of new product on adoption and diffusion, Ph.D. Dissertation, Seoul National University, Korea. 2005.
37 Constantine, L. L. and Lockwood, L. A. D., Software for Use: A Practical Guide to the Models and Methods of Usage-Centered Design, Addison-Wesley, NY, USA. 1999.
38 Cronin, J. J. and Taylor, S. A., Measuring service quality: A reexamination and extension, Journal of Marketing, 56(3), 55-68, 1992.   DOI   ScienceOn
39 Edwards, W. K., Bellotti, V., Dey, A. K. and Newman, M. W., The challenges of user-centered design and evaluation for infrastructure, Proceedings of the SIGCHI conference on Human factors in computing systems, 2003.
40 CUCN(National Center of Excellence for Ubiquitous Computing and Networking), Ubiquitous Computing System technology, Center for Advanced RFID/USN Technology(CARUT) workshop, Korea. 2005.
41 Fleisch, E. and Tellkamp, C., The challenge of identifying value creating ubiquitous computing applications, Workshop on Ubiquitous Commerce, UbiComp03, 2003.
42 Greenfield, A., Everyware: The dawning age of ubiquitous computing, New Riders, Berkeley, CA, USA. 2006.
43 Ham, J. J., A study on deriving killer application and developing evaluation model of ubiquitous computing, M.S. Thesis, Yonsei University, Korea. 2006.
44 Heckmann, D., Ubiquitous User Modeling, Ph.D Dissertation, Universität des Saarlandes, Deuch. 2005.
45 Heeter, C., Implications of new interactive technologies for conceptualizing communication, in Salvaggio, J. L. and Bryant, J. (eds.), Media use in the information age: Emerging patterns of adoption and consumer use, Lawrence Erlbaum Associates: 217-235, NJ, USA. 1989.
46 Iqbal, R., Sturm, J., Kulyk, O., Wang, J. and Terken, J., User-Centered Design and Evaluation of Ubiquitous Services, 23rd Annual International Conference on Design of Communication(SIGDOC 2005), (pp.138 -145), 2005.
47 ISO 20282, Ease of operation of everyday products, International Standards Organization, Geneva, Switzerland. 2006.
48 Barkhuus, L. and Dey, A., Is context-aware computing taking control away from the user three levels of interactivity examined, Proceeding of the 5th International Conference on Ubiquitous Computing, (pp.149 -156), 2003.
49 Barton, J. J. and Kindberg, T., The cooltown user experience, Proceedings of CHI200, Seattle. USA. 2001.
50 Barki, H. and Hartwick, J., Measuring User Participation, User Involvement, and User Attitude, MIS Quarterly, 18(1), 59-82, 1994.   DOI   ScienceOn
51 Bartram, L. and Czerwinski, M., Design and evaluation of notification interfaces for ubiquitous computing, UbiComp02 Workshop 9, 2002.
52 BenMoussa, C., Supporting Salespersons through Location Based Mobile Applications and Services, Proceedings of 4th International Conference on E-Commerce, E-Business, E-Government(I3E), (pp.149-167), 2004.
53 Blaine, A. P., Karim, A. and Bashar, N., Keeping ubiquitous computing to yourself: A practical model for user control of privacy, International Journal of Human-Computer Studies, 63, 228-253, 2005.   DOI   ScienceOn
54 Burnett, M., and Rainsford, C. P., A hybrid evaluation approach for ubiquitous computing environments, Workshop on Evaluation Methodologies for Ubiquitous Computing 2001, Atlanta. USA. 2001.
55 Burrell, J., Gay, G. K., Kubo, K. and Farina, N., Context-Aware Computing: A Test Case, Proceedings 4th International Conference Ubiquitous Computing, (pp.1-15), 2002.
56 Christensen, G. L. and Olson, J. C., Mapping consumers' mental models with ZMET, Psychology & Marketing, 19(6), 477-502, 2002.   DOI   ScienceOn
57 Chun, H. M. and Pyun, J. S., The Impact of Ubiquitous factors on Buyers' Purchase Intentions, Proceedings of the Korea Society of Management Information Systems(KMIS) 2004, (pp.605-612), 2004.
58 Chung, D. B., A study on the evaluation framework development for business model commercialization strategy in ubiquitous environment, M.S. Thesis, Yonsei University, Korea. 2005.
59 Arnstein, L., Kang, J. H. and Borriello, G., Evaluation Scope for Ubiquitous Computing, Intel Research Lab., Seattle. USA. 2006.
60 Abowd, G. D., Software design issues for ubiquitous computing, Proceedings of VLSI(Very Large Scale Integration) System Level Design, IEEE Computer Society Workshop 1998, USA. 1998.