Abstract
The dynamic features of sounds make them particularly appropriate for assessing the spatiotemporal characteristics of movements. Furthermore, sounds can inform about the correctness of an ongoing movement without directly interfering with the visual and proprioceptive feedback. Finally, because of their playful characteristics, sounds are potentially effective for motivating writers in particular need of any writing assistance. By associating relevant sounds to the specific variables of handwriting movement, the present chapter aimed at reporting how supplementary auditory information allows an examiner (teacher or therapist) to assess the movement quality from his/her hearing. Furthermore, a writer could also improve his/her movement from this real-time auditory feedback. Sonification of some movement characteristics would be a relevant tool for the diagnosis and the rehabilitation of some developmental disabilities (e.g. dysgraphia) or acquired disorders (e.g. Parkinson’s disease).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Aramaki, M., Besson, M., Kronland-Martinet, R., Ystad, S.: Controlling the perceived material in an impact sound synthesizer. IEEE Trans. Audio Speech Lang. Process. 19(2), 301–314 (2011)
Bangert, M., Häusler, U., Altenmüller, E.: On Practice: how the brain connects piano keys and piano sounds. Ann. N.Y. Acad. Sci. 930, 425–428 (2001)
Baur, B., Fürholzer, W., Marquart, C., Hermsdörfer, J.: Auditory grip force feedback in the treatment of writer’s cramp. J. Hand Ther. 22, 163–171 (2009)
Charles, M., Soppelsa, R., Albaret, J.M.: BHK - Échelle d’Evaluation Rapide de l’Ecriture chez l’Enfant. Editions et Applications Psychologiques, Paris (2003)
Chen, J.L., Penhume, V.B., Zatorre, R.J.: Listening to musical rhythms recruits motor regions of the brain. Cereb. Cortex 18(12), 2844–2854 (2008)
Chin, J., Diehl, V., Norman, K.: Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of ACM CHI ’88, ACM Press, New York (1988)
Danna, J., Eusebio, A., Azulay, J.P., Witjas, T., Pinto, S., Velay, J.L.: Computerized analysis of spiral drawing in Parkinson’s disease. Mov. Disord. 29(Suppl. 1), 313 (2014)
Danna, J., Fontaine, M., Paz-Villagrán, V., Gondre, C., Thoret, E., Aramaki, M., Kronland-Martinet, R., Ystad, S., Velay, J.L.: The effect of real-time auditory feedback on learning new characters. Hum. Mov. Sci. (in revision)
Danna, J., Paz-Villagrán, V., Gondre, C., Aramaki, M., Kronland-Martinet, R., Ystad, S., Velay, J.L.: Handwriting sonification for the diagnosis of dysgraphia. In: Nakagawa, M., Liwicki, M., Zhu, B. (eds.) Recent Progress in Graphonomics: Learn from the Past – Proceedings of the 16th Conference of the International Graphonomics Society, pp. 123–126. Tokyo University of Agriculture and Technology Press, Tokyo, Japan (2013)
Danna, J., Paz-Villagrán, V., Velay, J.L.: Signal-to-noise velocity peak difference: a new method for evaluating the handwriting movement fluency in children with dysgraphia. Res. Dev. Disabil. 34, 4384–4675 (2013)
Effenberg, A.O.: Movement sonification: effects on perception and action. IEEE Multim. 12, 53–59 (2005)
Hamstra-Bletz, L., DeBie, J., den Brinker, B.: Concise Evaluation Scale for Children’s Handwriting. Swets & Zeitlinger, Lisse (1987)
Hommel, B.: Event files: feature binding in and across perception and action. Trends Cogn. Sci. 8(11), 494–500 (2004)
Jankovic, J.: Parkinson’s disease: clinical features and diagnosis. J. Neurol. Neurosur. Psychiatry 79, 368–376 (2008)
McLennan, J.E., Nakano, K., Tyler, H.R., Schwab, R.S.: Micrographia in Parkinson’s disease. J. Neurol. Sci. 15(2), 141–152 (1972)
Parkinson, J.: An Essay on the Shaking Palsy. Whittingham and Rowland for Sherwood, Neely & Jones, London (1817)
Paz-Villagrán, V., Danna, J., Velay, J.L.: Lifts and stops in proficient and dysgraphic handwriting. Hum. Mov. Sci. 33, 381–394 (2014)
Plimmer, B., Reid, P., Blagojevic, R., Crossan, A., Brewster, S.: Signing on the tactile line: a multimodal system for teaching handwriting to blind children. ACM T. Comput.-Hum. Interact. 18(3), Article 17, 1–29 (2011)
Reavley, W.: The Use of biofeedback in the treatment of writer’s cramp. J. Behav. Ther. Exp. Psychiatry 6, 335–338 (1975)
Ronsse, R., Puttemans, V., Coxon, J.P., Goble, D.J., Wagemans, J., Wenderoth, N., Swinnen, S.P.: Motor learning with augmented feedback: modality dependent behavioral and neural consequences. Cereb. Cortex 21, 1283–1294 (2011)
Rosenblum, S., Samuel, M., Zlotnik, S., Erikh, I., Schlesinger, I.: Handwriting as an objective tool for Parkinson’s disease diagnosis. J. Neurol. 260(9), 2357–2361 (2013)
Sigrist, R., Rauter, G., Riener, R., Wolf, P.: Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychon. Bull. Rev. 20(1), 21–53 (2013)
Søvik, N., Arntzen, O.: A Comparative study of the writing/spelling performances of “normal”, dyslexic and dysgraphic children. Eur. J. Spec. Needs Educ. 1(2), 85–101 (1986)
Thoret, E., Aramaki, M., Gondre, C., Kronland-Martinet, R., Ystad, S.: Controlling a non linear friction model for evocative sound synthesis applications. In: Proceedings of 16th International Conference on Digital Audio Effects (DAFx), Maynooth, Ireland, pp. 1–7 (2013)
Thoret, E., Aramaki, M., Kronland-Martinet, R., Velay, J.L., Ystad, S.: From sound to shape: auditory perception of drawing movements. J. Exp. Psychol. Hum. Percept. Perform. 40, 983–994 (2014)
Van den Doel, K., Kry, P.G., Pai, D.K.: Foleyautomatic: physically-based sound effects for interactive simulation and animation. In: Proceedings of SIGGRAPH ‘01, pp. 537–544. ACM Press, New York (2001)
Young, W., Rodger, M., Craig, C.M.: Perceiving and reenacting spatiotemporal characteristics of walking sounds. J. Exp. Psychol. Hum. 39(2), 464–476 (2013)
Acknowledgements
This work, carried out within the Labex BLRI (ANR-11-LABX-0036), has benefited from support from the French government, managed by the French National Agency for Research (ANR), under the project title Investments of the Future A*MIDEX (ANR-11-IDEX-0001-02) and by the ANR project METASON (CONTINT 2010: ANR-10-CORD-0003).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Danna, J. et al. (2014). Movement Sonification for the Diagnosis and the Rehabilitation of Graphomotor Disorders. In: Aramaki, M., Derrien, O., Kronland-Martinet, R., Ystad, S. (eds) Sound, Music, and Motion. CMMR 2013. Lecture Notes in Computer Science(), vol 8905. Springer, Cham. https://doi.org/10.1007/978-3-319-12976-1_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-12976-1_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12975-4
Online ISBN: 978-3-319-12976-1
eBook Packages: Computer ScienceComputer Science (R0)