Browse > Article
http://dx.doi.org/10.5143/JESK.2007.26.3.067

Interruption in Digital Convergence: Focused on Multi-Modality and Multi-Tasking  

Lee, Ki-Ho (HCI Lab, Yonsei University)
Jung, Seung-Ki (Searching Planning Team, Empas)
Kim, Hye-Jin (Department of Mobile Communication, LG Electronics)
Lee, In-Seong (HCI Lab, Yonsei University)
Kim, Jin-Woo (HCI Lab, Yonsei University)
Publication Information
Journal of the Ergonomics Society of Korea / v.26, no.3, 2007 , pp. 67-80 More about this Journal
Abstract
Digital convergence, defined as the creative fusion of once-independent technologies and service, is getting more attention recently. Interruptions among internal functions happen frequently in digital convergence products because many functions that were in separate products are merged into a single product. Multi-tasking and multi-modality are two distinctive features of interruption in digital convergence products, but their impacts to the user have not been investigated yet. This study conducted a controlled experiment to investigate the impacts of multi-tasking and multi-modality on the subjective satisfaction and objective performance of digital convergent products. The study results indicate that multi-tasking and multi-modality have substantial effects individually as well as together. The paper ends with practical and theoretical implications of study results as well as research limits and future research.
Keywords
Interruption; Multitasking; Modality; Mobile; HCI;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Baddeley, A. D., The concept of working memory: a view of its current state and probable future development, Cognition, 10, 17-23, 1981   DOI   ScienceOn
2 Baddeley, A. D., Working memory, Oxford University Press, Oxford, UK, 1986
3 Baddeley, A. D., Working memory, Philosophical Transactions of the Royal Society of London, 302, 311-324, 1983   DOI   ScienceOn
4 Baddeley, A. D., Working memory, Science, 255, 556-559, 1992   DOI
5 Bailey, T. J., The road safety implications of mobile phone use whilst driving: A short literature review, Office of Road Safety Series, 4/94, South Australian Department of Transport, 1994
6 Broadbent, D. E., Perception and communication, Pergamon Press, Elmsford, NY, 1958
7 Horrey, W. J. and Wickens, C. D., Driving and side task performance: The effects of display clutter, separation, and modality, Human Factors, 46(4), 611-624, 2004   DOI   ScienceOn
8 St. John, M., Smallman, H. S. and Manes, D. I., 'Recovery from interruptions to a dynamic monitoring task: The beguiling utility of Instant Replay,' Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, pp. 473-477, Santa Monica, CA, 2005
9 Kahneman, D., Attention and effort, Prentice Hall, Engelwood Cliffs. NJ, 1973
10 Karlin, L. and Kestenbaum, R., Effects of number of alternatives on the psychological refractory period, Quarterly Journal of Experimental Psychology, 20, 67-178, 1968
11 Keele, S. W., Attention and human performance, Goodyear, Pacific Palisades, CA, 1973
12 Allport, D. A., Attention and performance. In G. L. Claxton (Ed.), Cognitive psychology: New directions, 112-153, Routledge & Kegan Paul, London, UK, 1980
13 Smith, M. C., Theories of the psychological refractory period, Psychological Bulletin, 67, 202-211, 1967   DOI   ScienceOn
14 Allport, D. A., Selection for action: Some behavioral and neuropsychological considerations of attention and action. In H. Heuer and A. F. Sanders (Eds.), Perspectives on perception and action, 395-419, Lawrence Erlbaum, Hillsdale, NJ, 1987
15 Arons, B., A Review of the Cocktail Party Effect, Journal of the American Voice I/O Society, 12, 35-50, 1992
16 Rubinstein, J. S., Meyer, D. E. and Evans, J. E., Executive control of cognitive process in task switching, Journal of Experimental Psychology, 27, 763-797, 2001
17 Chandler, P. and Sweller, J., The spli-attention effect as a factor in the design of instruction, British Journal of Educational Psychology, 62, 233-246, 1992   DOI
18 Cutrell, E. B., Czerwinski, M. and Horvitz, E., 'Effects of instant messaging interruptions on computing tasks,' Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 99-100, New York, NY, 2000
19 Duncan, J., Disorganization of behavior after frontal-lobe damage, Cognitive Neuropsychology, 3, 271-290, 1986   DOI
20 Gaver, W. W., The SonicFinder: An interface that user auditory icons, Human-Computer Interaction, 4, 67-94, 1989   DOI   ScienceOn
21 Allport, D. A., Attention and control: Have we been asking the wrong questions? A critical review of 25 years. In D. E. Meyer and S. Kornblum (Eds.), Attention and performance XIV: Synergies in experimental psychology, artificial intelligence, and cognitive neuroscience, 183-218, MIT Press, Cambridge, MA, 1993
22 Haigney, D. E., Mobile phones and driving: A literature review, RoSPA, Birmingham, 1997
23 Haigney, D. and Westerman, S. J., Mobile (cellular) phone use and driving: A critical review of research methodology, Ergonomics, 44(2), 132 -143, 2001   DOI   ScienceOn
24 Moray, N., Where is attention limited?: A survey and a model, Acta psychologica, 27, 84-92, 1967   DOI   ScienceOn
25 Pashler, H., Dual-task interference and elementary mental mechanisms, In D. E. Meyer and S. Kornblum (Eds.), Attention and performance XIV: Synergies in experimental psychology, artificial intelligence, and cognitive neuroscience, 183-218, MIT Press, Cambridge, MA, 1993
26 Pashler, H., Dual-task interference in simple tasks: Data and theory, Psychological Bulletin, 116, 220-244, 1994   DOI   ScienceOn
27 Milewski, A. E., Interruption management and telephone call screening, International Journal of Human-Computer Interaction, 20(1), 19-33, 2006   DOI   ScienceOn
28 Moreno, R. and Mayer, R. E., Cognitive principles of multimedia learning: The role of modality and contiguity, Journal of Educational Psychology, 91(2), 358-368, 1999   DOI
29 Logan, G. and Zbrodoff, N. J., Constraints on strategy construction in a speeded discrimination task, Journal of Experimental Psychology:Human Perception and Performance, 8, 502-520, 1982   DOI   ScienceOn
30 Kristoffersent, Steinar and Fredrik Ljungberg, 'Representing Modalities in Mobile Computing: A Model of IT Use in Mobile Settings,' Proceedings of the Interactive Applications of Mobile Computing (IMC'98), Rostock, Germany, 1998
31 Latorella, K. A., 'Effects of modality on interrupted flight deck performance: Implications for data link,' Proceedings of the 42nd Annual Meeting of the Human Factors and Ergonomics Society, pp. 87-91, Chicago, IL, 1998
32 Guhe, M., Liao, W., Zhu, Z., Ji, Q., Gray, W. D. and Schoelles, M. J., 'Non-intrusive measurement of workload in real-time' Proceedings of the 49th Annual Conference of the Human Factors and Ergonomics Society, pp. 1157-1161, Orlando, FL, 2005
33 Paivio, A., Mental representation: A dual coding approach, Oxford University Press, Oxford, UK, 1986
34 Wickens, C. D., Processing resources and attention, In D. L. Damos (Ed.), Multiple-task performance, 3-34, Taylor & Francis, London, 1991
35 Pashler, H., Processing stages in overlapping tasks: Evidence for a central bottleneck, Journal of Experimental Psychology: Human Perception and Performance, 10, 358-377, 1984   DOI   ScienceOn
36 Pashler, H., Do response modality effects support multiprocessor models of divided attention?, Journal of Experimental Psychology: Human perception and performance, 16, 826-842, 1990   DOI   ScienceOn
37 Welford, A. T., Single channel operation in the brain, Acta Psychologica, 27, 5-22, 1967   DOI   ScienceOn
38 Wickens, C. D., Multiple resources and performance prediction, Theoretical Issues in Ergonomics Science, 3, 159-177, 2002   DOI   ScienceOn
39 Spreng, R. A., MacKenzie, S. B. and Olshavsky, R. W., A Reexamination of the determinants of customer satisfaction, Journal of Marketing, 60, 3, 15-32, 1996   DOI   ScienceOn
40 Stipp, H., Convergence now?, International Journal on Media Management, 1, 10-13, 1999   DOI   ScienceOn
41 Iqbal, S. T. and Horvitz, E., 'Disruption and recovery of computing tasks: Field Study, analysis, and directions,' Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 677-686, San Jose, CA, 2
42 Oulasvirta, A., Tammonen, S., Roto, V. and Kuorelahti, J., 'Interaction in 4-second bursts: The fragmented nature of attentional resources in mobile HCI,' Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 919-928, Portland, OR, 2005
43 Massaro, D. W. and Warner, D. S., Dividing attention between auditory and visual perception, Perception and Psychophysics, 21, 569-574, 1977   DOI
44 Milanesi, C., Liang, A., Nguyen, T. H. and Mitsuyama, N., Forecast: Camera Phones, Worldwide, 2004-2009, G00136399, Gartner, 21 November, 2005
45 Mayer, R. E. and Moreno, R., A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory, Journal of Educational Psychology, 90(2), 312-320, 1998   DOI   ScienceOn
46 McFarlane, D. C., 'Coordinating the interruption of people,' Proceedings of the INTERACT, pp. 295-303, Amsterdam, The Netherlands, 1999
47 Meyer, D. E. and Kieras, D. E., A Computational theory of executive cognitive processes and multiple-task performance, Psychological Review, 104, 3-65, 1997   DOI   ScienceOn
48 Navon, D. and Gopher, D., On the economy of the human-processing system, Psychological Review, 86, 214-255, 1979   DOI
49 Neerincx, M. A., van Doorne, H. and Ruijsendaal, M., 'Attuning computersupported work to human knowledge and processing capacities in ship control centers,' Proceedings of the Cognitive Task Analysis, pp. 341-361, Mahwah, NJ, 2000
50 Neumann, O., Beyond capacity: A functional view of attention, In H. Heuer and A. F. Sanders (Eds.), Perspectives on perception and action, 361-394, Lawrence Erlbaum, Hillsdale, NJ, 1987
51 Lu, Willie W., Compact Multidimensional broadband wireless: The convergence of wireless mobile and access, IEEE Communication Magazine, 38, 119-123, 2000   DOI   ScienceOn
52 Telford, C. W., The refractory phase of voluntary and associative response, Journal of Experimental Psychology, 14, 1-35, 1931   DOI
53 Welford, A. T., The 'psychological refractory period' and the timing of high speed performance: A review and theory, British journal of psychology, 43, 2-19, 1952
54 Treisman, A. and Davies, A., Divided attention to eye and ear, In S. Kornblum (Ed.), Attention and Performance, Academic Press, New York, NY, 1973
55 Wada, F. and Tano, S., 'Basic system architecture for adaptive information presentation in high cognitive load environment,' Proceedings of the 26th Annual Conference of the IEEE Industrial Electronics Society (IECON 2000), pp. 515-520, Nagoya, Japan, 2000
56 Wasinger, R., Krüger, A. and Jacobs, O., 'Integrating Intra and Extra Gestures into a mobile and multimodal shopping assistant' Proceedings of the 3rd International Conference on Pervasive Computing, pp. 297-314, Munich, Germany 2005
57 Wickens, C. D., The structure of attentional resources, In R. S. Nickerson (Ed.), Attention and Performance VIII, 239-257, Lawrence Erlbaum, Hillsdale, NJ, 1980
58 Wickens, C. D., Mountford, S. J. and Schreiner, W., Multiple resources, task-hemispheric integrity, and individual differences in time-sharing, Human Factors, 12, 211-229, 1981a
59 Wiese, E. E. and Lee, J. D., Auditory alerts for in-vehicle information systems: The effects of temporal conflict and sound parameters on driver attitudes and performance, Ergonomics, 47, 9, 965-986, 2004   DOI   ScienceOn
60 Xia, L. and Sudharshan, D., Effects of interruptions on consumer online decision processes, Journal of Consumer Psychology, 12, 3, 265-280, 2002   DOI   ScienceOn
61 Craik, K. J. W., Theory of the human operator in control systems: II. Man as an element in a control system, British Journal of Psychology, 38, 142-148, 1948
62 Rollins, H. A. and Hendricks, R., Processing of words presented simultaneously to eye and ear, Journal of Experimental Psychology:Human Perception & Performance, 6, 99-109, 1980   DOI   ScienceOn