Movement Sonification Types and Triggers: A Systematic Review

Movement sonification (i.e., translating kinematic measures into sound, providing auditory feedback), can enhance motor performance and (re)learning across both clinical and sports contexts. However, existing sonification systems vary widely, potentially affecting efficacy. Here, we categorize sonification systems based on the utilized sound (type) and onset (trigger) to elucidate potential differences in movement-, intuitiveness-, and motivation-related outcomes. Movement sonification systems as described in 107 included studies were classified into six sound types (specifically parameter mapping; PMs, musically informed; MIs, single tone; STs, rhythm; Rs, music-based; MBs, and environmental; Es) and four trigger types (event-, error-, trajectory-based, and continuous), and effects on outcomes were compared. Overall, positive effects on all outcomes were reported for all system types and triggers, with no clear pattern of advantages for any, except that learning retention is more consistently reported for triggers involving explicit learning strategies. In general, more subtle movement learning may benefit from more direct movement-sound coupling, implicit learning, and multi-component mappings. Additionally, systems providing rhythmic sounds (MIs, STs, Rs, and MBs) were more commonly used for periodic movements. Intuitiveness is rated highest for PMs and Rs, and motivation strongest for MIs, although all systems increase autonomous motivation, compared to no sonification. In conclusion, movement sonification systems generally improve performance but arguably work differently for different movements. Accordingly, MIs may be preferable for rehabilitation settings where motivation is crucial, while PMs that inform users about subtle kinematic aspects may especially support learning highly skilled movements. Standardizing terminology in future work will facilitate systematic cross-system comparisons.