The Journal of Korea Robotics Society (로봇학회논문지)

Korea Robotics Society (한국로봇학회)
권호 표지
DOI QR코드

DOI QR Code

Effects of Multi-modal Guidance for the Acquisition of Sight Reading Skills: A Case Study with Simple Drum Sequences

멀티모달 가이던스가 독보 기능 습득에 미치는 영향: 드럼 타격 시퀀스에서의 사례 연구

  • Lee, In (Computer Science and Engineering, Pohang University of Science and Technology) ;
  • Choi, Seungmoon (Computer Science and Engineering, Pohang University of Science and Technology)
  • Received : 2013.05.31
  • Accepted : 2013.07.25
  • Published : 2013.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

We introduce a learning system for the sight reading of simple drum sequences. Sight reading is a cognitive-motor skill that requires reading of music symbols and actions of multiple limbs for playing the music. The system provides knowledge of results (KR) pertaining to the learner's performance by color-coding music symbols, and guides the learner by indicating the corresponding action for a given music symbol using additional auditory or vibrotactile cues. To evaluate the effects of KR and guidance cues, three learning methods were experimentally compared: KR only, KR with auditory cues, and KR with vibrotactile cues. The task was to play a random 16-note-long drum sequence displayed on a screen. Thirty university students learned the task using one of the learning methods in a between-subjects design. The experimental results did not show statistically significant differences between the methods in terms of task accuracy and completion time.

Keywords

References

  1. R. A. Magill, Motor Learning: Concepts and Applications, McGraw-Hill, 2001.
  2. A. D. Baddeley, Human Memory: Theory and Practice, Psychology Press, 1997.
  3. E. Todorov, R. Shadmehr, and E. Bizzi, "Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task", Journal of Motor Behavior, vol. 29, no. 2, pp. 147-158, 1997. https://doi.org/10.1080/00222899709600829
  4. S. Holland, A. J. Bouwer, M. Dalgleish, and T. M. Hurtig, "Feeling the Beat Where it Counts: Fostering Multi-Limb Rhythm Skills with the Haptic Drum Kit", In Proc. of the ACM International Conference on Tangible, Embedded and Embodied Interaction, pp. 21-28, 2010.
  5. K. Huang, T. Starner, E. Do, G. Weiberg, D. Kohlsdorf, C. Ahlrichs, and L. Ruediger, "Mobile Music Touch: Mobile Tactile Stimulation for Passive Learning", In Proc. of the ACM Conference on Human Factors in Computing Systems, pp. 791-800, 2010.
  6. I. Lee, K. Hong, and S. Choi, "Guidance Methods for Bimanual Timing Tasks", In Proc. of the IEEE Haptics Symposium, pp. 297-300, 2012.
  7. J. Watanabe and H. Ando, "Pace-sync Shoes: Intuitive Walking-pace Guidance Based on Cyclic Vibro-tactile Stimulation for the Foot", Virtual Reality, vol. 14, no. 3, pp. 213-219, 2010. https://doi.org/10.1007/s10055-009-0137-y
  8. D. Spelmezan, M. Jacobs, A. Hilgers, and J. Borchers, "Tactile Motion Instructions for Physical Activities", In Proc. of the ACM Conference on Human Factors in Computing Systems, pp. 2243-2252, 2009.
  9. K. Bark, P. Khanna, R. Irwin, P. Kapur, S. A. Jax, L. J. Buxbaum, and K. J. Kuchenbecker, "Lessons in Using Vibrotactile Feedback to Guide Fast Arm Motions", In Proc. of the IEEE World Haptics Conference, pp. 355-360, 2011.
  10. A. Bloomfield and N. I. Badler, "Virtual Training via Vibrotactile Arrays", Presence: Teleoperators and Virtual Environments, vol. 17, no. 2, pp. 103-120, 2008. https://doi.org/10.1162/pres.17.2.103
  11. P. Shull, K. Lurie, M. Shin, T. Besier, and M. Cutkosky, "Haptic Gait Retraining for Knee Osteoarthritis Treatment", In Proc. of the IEEE Haptics Symposium, pp. 409-416, 2010.
  12. J. van der Linden, R. Johnson, J. Bird, Y. Rogers, and E. Schoonderwaldt, "Buzzing to Play: Lessons Learned From an In the Wild Study of Real-time Vibrotactile Feedback", In Proc. of the ACM Conference on Human Factors in Computing Systems, pp. 533-542, 2011.
  13. L. Marchal-Crespo and D. J. Reinkensmeyer, "Review of Control Strategies for Robotic Movement Training after Neurologic Injury", Journal of NeuroEngineering and Rehabilitation, vol. 6, no. 20, 2009.
  14. D. Powell and M. K. O'Mally, "The Task-Dependent Efficacy of Shared-Control Haptic Guidance Paradigms", IEEE Transactions on Haptics, vol. 5, no. 3, pp. 208-219, 2012. https://doi.org/10.1109/TOH.2012.40
  15. D. Feygin, M. Keehner, and F. Tendick, "Haptic Guidance: Experimental Evaluation of a Haptic Training Method for a Perceptual Motor Skill", In Proc. of the IEEE Haptics Symposium, pp. 40-47, 2002.
  16. G. Grindlay, "Haptic Guidance Benefits Musical Motor Learning", In Proc. of the IEEE Haptics Symposium, pp. 397-404, 2008.
  17. J. C. Huegel and M. K. O'Malley, "Progressive Haptic and Visual Guidance for Training in a Virtual Dynamic Task", In Proc. of the IEEE Haptics Symposium, pp. 343-349, 2010.
  18. J. Lee and S. Choi, "Effects of Haptic Guidance and Disturbance on Motor Learning: Potential Advantage of Haptic Disturbance", In Proc. of the IEEE Haptics Symposium, pp. 335-342, 2010.
  19. J. Lieberman and C. Breazeal, "TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning", IEEE Transactions on Robotics, vol. 23, no. 5, pp. 919-926, 2007. https://doi.org/10.1109/TRO.2007.907481
  20. G. Park and S. Choi, "Perceptual Space of Amplitude-Modulated Vibrotactile Stimuli", In Proc. of the IEEE World Haptics Conference, pp. 59-64, 2011.
  21. L. J. Post, I. C. Zompa, and C. E. Chapman, "Perception of Vibrotactile Stimuli During Motor Activity in Human Subjects", Experimental Brain Research, vol. 100, no. 1, pp. 107-120, 1994.
  22. E. C. Lechelt, "Temporal Numerosity Discrimination: Intermodal Comparisons Revisited", British Journal of Psychology, vol. 66, no. 1, pp. 101-108, 1975. https://doi.org/10.1111/j.2044-8295.1975.tb01444.x
  23. H. R. Gudmundsdottir, "Advances in Music-reading Research", Music Education Research, vol. 12, no. 2, pp. 331-338, 2010. https://doi.org/10.1080/14613808.2010.504809
  24. R. A. Schmidt, "Frequent Augmented Feedback Can Degrade Learning: Evidence and Interpretations", Tutorials in Motor Neuroscience, pp. 59-75, 1991.
  25. R. Kopiez and J. I. Lee, "Towards a General Model of Skills Involved in Sight Reading Music", Music Education Research, vol. 10, no. 1, pp. 41-62, 2008. https://doi.org/10.1080/14613800701871363
  26. C. J. Winstein and R. A. Schmidt, "Reduced Frequency of Knowledge of Results Enhances Motor Skill Learning", Journal of Experimental Psychology, vol. 16, no. 4, pp. 677-691, 1990.

Cited by

  1. Continuous Movement Tracking Performance for Predictable and Unpredictable Tasks with Vibrotactile Feedback vol.10, pp.4, 2017, https://doi.org/10.1109/TOH.2017.2689023