Browse > Article
http://dx.doi.org/10.7746/jkros.2013.8.3.217

Effects of Multi-modal Guidance for the Acquisition of Sight Reading Skills: A Case Study with Simple Drum Sequences  

Lee, In (Computer Science and Engineering, Pohang University of Science and Technology)
Choi, Seungmoon (Computer Science and Engineering, Pohang University of Science and Technology)
Publication Information
The Journal of Korea Robotics Society / v.8, no.3, 2013 , pp. 217-227 More about this Journal
Abstract
We introduce a learning system for the sight reading of simple drum sequences. Sight reading is a cognitive-motor skill that requires reading of music symbols and actions of multiple limbs for playing the music. The system provides knowledge of results (KR) pertaining to the learner's performance by color-coding music symbols, and guides the learner by indicating the corresponding action for a given music symbol using additional auditory or vibrotactile cues. To evaluate the effects of KR and guidance cues, three learning methods were experimentally compared: KR only, KR with auditory cues, and KR with vibrotactile cues. The task was to play a random 16-note-long drum sequence displayed on a screen. Thirty university students learned the task using one of the learning methods in a between-subjects design. The experimental results did not show statistically significant differences between the methods in terms of task accuracy and completion time.
Keywords
Multi-modal Guidance; Haptic Cueing; Motor Learning; Sight Reading; Drum music;
Citations & Related Records
연도 인용수 순위
  • Reference
1 G. Park and S. Choi, "Perceptual Space of Amplitude-Modulated Vibrotactile Stimuli", In Proc. of the IEEE World Haptics Conference, pp. 59-64, 2011.
2 L. J. Post, I. C. Zompa, and C. E. Chapman, "Perception of Vibrotactile Stimuli During Motor Activity in Human Subjects", Experimental Brain Research, vol. 100, no. 1, pp. 107-120, 1994.
3 E. C. Lechelt, "Temporal Numerosity Discrimination: Intermodal Comparisons Revisited", British Journal of Psychology, vol. 66, no. 1, pp. 101-108, 1975.   DOI   ScienceOn
4 H. R. Gudmundsdottir, "Advances in Music-reading Research", Music Education Research, vol. 12, no. 2, pp. 331-338, 2010.   DOI   ScienceOn
5 R. Kopiez and J. I. Lee, "Towards a General Model of Skills Involved in Sight Reading Music", Music Education Research, vol. 10, no. 1, pp. 41-62, 2008.   DOI   ScienceOn
6 C. J. Winstein and R. A. Schmidt, "Reduced Frequency of Knowledge of Results Enhances Motor Skill Learning", Journal of Experimental Psychology, vol. 16, no. 4, pp. 677-691, 1990.
7 P. Shull, K. Lurie, M. Shin, T. Besier, and M. Cutkosky, "Haptic Gait Retraining for Knee Osteoarthritis Treatment", In Proc. of the IEEE Haptics Symposium, pp. 409-416, 2010.
8 D. Feygin, M. Keehner, and F. Tendick, "Haptic Guidance: Experimental Evaluation of a Haptic Training Method for a Perceptual Motor Skill", In Proc. of the IEEE Haptics Symposium, pp. 40-47, 2002.
9 J. van der Linden, R. Johnson, J. Bird, Y. Rogers, and E. Schoonderwaldt, "Buzzing to Play: Lessons Learned From an In the Wild Study of Real-time Vibrotactile Feedback", In Proc. of the ACM Conference on Human Factors in Computing Systems, pp. 533-542, 2011.
10 D. Powell and M. K. O'Mally, "The Task-Dependent Efficacy of Shared-Control Haptic Guidance Paradigms", IEEE Transactions on Haptics, vol. 5, no. 3, pp. 208-219, 2012.   DOI   ScienceOn
11 G. Grindlay, "Haptic Guidance Benefits Musical Motor Learning", In Proc. of the IEEE Haptics Symposium, pp. 397-404, 2008.
12 J. C. Huegel and M. K. O'Malley, "Progressive Haptic and Visual Guidance for Training in a Virtual Dynamic Task", In Proc. of the IEEE Haptics Symposium, pp. 343-349, 2010.
13 J. Lee and S. Choi, "Effects of Haptic Guidance and Disturbance on Motor Learning: Potential Advantage of Haptic Disturbance", In Proc. of the IEEE Haptics Symposium, pp. 335-342, 2010.
14 A. Bloomfield and N. I. Badler, "Virtual Training via Vibrotactile Arrays", Presence: Teleoperators and Virtual Environments, vol. 17, no. 2, pp. 103-120, 2008.   DOI   ScienceOn
15 R. A. Magill, Motor Learning: Concepts and Applications, McGraw-Hill, 2001.
16 K. Huang, T. Starner, E. Do, G. Weiberg, D. Kohlsdorf, C. Ahlrichs, and L. Ruediger, "Mobile Music Touch: Mobile Tactile Stimulation for Passive Learning", In Proc. of the ACM Conference on Human Factors in Computing Systems, pp. 791-800, 2010.
17 L. Marchal-Crespo and D. J. Reinkensmeyer, "Review of Control Strategies for Robotic Movement Training after Neurologic Injury", Journal of NeuroEngineering and Rehabilitation, vol. 6, no. 20, 2009.
18 A. D. Baddeley, Human Memory: Theory and Practice, Psychology Press, 1997.
19 E. Todorov, R. Shadmehr, and E. Bizzi, "Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task", Journal of Motor Behavior, vol. 29, no. 2, pp. 147-158, 1997.   DOI   ScienceOn
20 S. Holland, A. J. Bouwer, M. Dalgleish, and T. M. Hurtig, "Feeling the Beat Where it Counts: Fostering Multi-Limb Rhythm Skills with the Haptic Drum Kit", In Proc. of the ACM International Conference on Tangible, Embedded and Embodied Interaction, pp. 21-28, 2010.
21 I. Lee, K. Hong, and S. Choi, "Guidance Methods for Bimanual Timing Tasks", In Proc. of the IEEE Haptics Symposium, pp. 297-300, 2012.
22 J. Watanabe and H. Ando, "Pace-sync Shoes: Intuitive Walking-pace Guidance Based on Cyclic Vibro-tactile Stimulation for the Foot", Virtual Reality, vol. 14, no. 3, pp. 213-219, 2010.   DOI
23 K. Bark, P. Khanna, R. Irwin, P. Kapur, S. A. Jax, L. J. Buxbaum, and K. J. Kuchenbecker, "Lessons in Using Vibrotactile Feedback to Guide Fast Arm Motions", In Proc. of the IEEE World Haptics Conference, pp. 355-360, 2011.
24 D. Spelmezan, M. Jacobs, A. Hilgers, and J. Borchers, "Tactile Motion Instructions for Physical Activities", In Proc. of the ACM Conference on Human Factors in Computing Systems, pp. 2243-2252, 2009.
25 J. Lieberman and C. Breazeal, "TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning", IEEE Transactions on Robotics, vol. 23, no. 5, pp. 919-926, 2007.   DOI   ScienceOn
26 R. A. Schmidt, "Frequent Augmented Feedback Can Degrade Learning: Evidence and Interpretations", Tutorials in Motor Neuroscience, pp. 59-75, 1991.