Abstract Matthew Rodger 9 March 2017
Skilful sonification: Mapping movement to sound for enhancing skill learning
Matthew Rodger, Queen's University Belfast
An important question for skill acquisition research is whether and how augmented feedback can be designed to improve the learning of complex skills. Research on learning movement-based skills has largely focussed on the use of visual feedback. However, auditory feedback in the form of ‘movement sonification’ can also be effective. A series of experiments was carried out in which participants had to learn a novel coordination task. During training, some participants heard sounds that were triggered or modified by their own movements, and post-training performance was compared between different motion-to-sound mappings, as well as to controls who did not receive additional auditory feedback. Differences between the groups showed that the way motion was mapped to sound impacted on the effectiveness of movement sonification as feedback for skill learning. Results are interpreted in terms of how perceptual information is structured in relation to the intrinsic dynamics of the task-to-be-learned, with implications for real-world training or rehabilitation applications.
Back to Cognitive Science Seminar Series