Abstract
Synesthesia gave rise to an important debate in nineteenth-century Europe that was influenced by the Symbolist movement and research into the physiology of perception. Yet, efforts to understand sensory modalities and to pictorially translate musical effects, or vice versa, are very ancient in origin. For example, the ability to coordinate colors and sounds was well known in the ancient cultures of India and China. Similarly, in sixth-century Greece, Pythagoras (570 BC–495 BC) assigned numbers as well as colors to musical notes. There was also interest in how the various sensory modalities were able to reveal the distinctive properties of an object and if these experiences could be translated or shared with others. This chapter examines the foundations of the nineteenth-century debate, the importance of the cultural aspect of synesthesia, and the subsequent search for a neurological explanation. As we show, the lively European debate included Italian, French, English, Swiss, and German scientists who were stimulated to study the relationship between color and sound, music and painting, and the creativity associated with synesthetes. Among the researchers discussed are Carlo Botta (1766–1837), Alfred Vulpian (1826–1887), Filippo Lussana (1820–1897), and Eugene Bleuler (1857–1939). The paper also looks at the three forms of synesthesia related to the debate (metaphoric, constitutional, and pathological) from both historical and contemporary perspectives. Finally, we examine the role of emotion in the various forms of musical synesthesia and possible neuronal well-being.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Marcovecchio E. Dizionario etimologico storico dei termini medici. Festina Lente: Impruneta; 1993. p. 839.
Cytowic RE. Synesthesia. In: A Union of the Senses. Cambridge: MIT Press; 2002.
Day SA. Types of synaesthesia; 2021. http://www.daysyn.com/types-of-syn.html. Accessed 21 Dec 2021.
Cytowic RE, Eagleman DM. Wednesday is indigo blue: discovering the brain of synesthesia. Cambridge: MIT Press; 2009.
Day SA. Synesthesia. In: Demographic aspects of synesthesia; 2021. http://www.daysyn.com/types-of-syn.html. Accessed 21 Dec 2021.
Hubbard EM, Ramachandran VS. Neurocognitive mechanisms of synesthesia. Neuron. 2005;48:509–20.
Day S. Some demographic and socio-cultural aspects of synesthesia. In: Robertson LC, Sagiv N, editors. Synesthesia: perspective from cognitive neuroscience. New York: Oxford University Press; 2005. p. 11–3.
Harrison J. Synaesthesia. The strangest thing. Oxford: Oxford University Press; 2007.
Rogowska A. Categorization of synaesthesia. Rev Gen Psychol. 2011;15:213–27.
Schweizer TA, Li Z, Fischer CE, Alexander MP, Smith SD, Graham SJ, Fornazzarri L. From the thalamus with love, a rare window into the locus of emotional synesthesia. Neurology. 2013;81:509–10.
Perry A, Henik A. The emotional valence of a conflict: implications from synesthesia. Front Psychol. 2013;4:978.
Safran AB, Sanda N. Color synaesthesia. Insight into perception, emotion, and consciousness. Curr Opin Neurol. 2015;28:36–44.
Bragança GFF, Fonseca JGM, Caramelli P. Synesthesia and music perception. Dement Neuropsychol. 2015;9:16–23.
Tornitore T. Storia delle sinestesie. Le origini dell’audizione colorata. Genova: Brigati-Carucci; 1986.
Manzoni T. Aristotele e il cervello. Le teorie del più grande biologo dell’antichità nella storia del pensiero scientifico. Roma: Carocci; 2007.
Day SA. Synesthesia resources; 2021. http://www.daysyn.com/types-of-syn.html. Accessed 07 Jan 2022.
Ione A, Tyler CW. Neuroscience, history and the arts. Synesthesia: is F-sharp colored violet? J Hist Neurosci. 2004;13:58–65.
Locke J. An essay concerning human understanding. London: Printed [by Elizabeth Holt] for Tho. Basset, and sold by Edw. Mory at the sign of the three bibles in St. Paul’s Church-yard; 1690.
Mazzeo M. Storia naturale della sinestesia. Dalla questione Molyneux a Jakobson. Macerata: Quodlibet; 2005.
Morgan M. Molyneux’s question: vision, touch and the philosophy of perception. Cambridge: Cambridge University Press; 1977.
Descartes R. Géométrie. Leyde: De L’imprimeterie de Ian Marie; 1637.
Newton I. New theory about light and colours. Phil Trans R S. 1671–1672;80:3075–87.
Descartes R. Discours de la méthode. Leyde: De L’imprimeterie de Ian Marie; 1637.
Judd DB. Introduction. In: Goethe JG, editor. Goethe’s theory of colours. Translated from the German with notes by Charles Locke Eastlake. Cambridge, Massachusetts and London: The MIT Press; 1970. p. vii–viii.
Goethe W. Beiträge zur Optik. Zur Farbenlehre. Weimar: Industrie-Comptoir; 1791–1792.
Haigh A, Brown DJ, Meijer P, Proulx MJ. How well do you see what you hear? The acuity of visual-to-auditory sensory substitution. Front Psychol. 2013; https://doi.org/10.3389/fpysg.2013.00330.
Harvey JP. Sensory perception: lessons from synesthesia. Using synesthesia to inform the understanding of sensory perception. Yale J Biol Med. 2013;86:203–16.
Larner AJ. A possible account of synaesthesia dating from the seventeenth century. J Hist Neurosci. 2006;15:245–9.
Jewanski J, Simner J, Day SA, Ward J. The development of a scientific understanding of synesthesia from early case studies (1849-1873). J Hist Neurosci. 2011;20:284–305.
Jewanski J. Synesthesia in the nineteenth century: scientific origins. In: Simner J, Hubbard EM, editors. Oxford handbook of synesthesia. Oxford: Oxford University Press; 2014. p. 369–98.
Clarke E, Jacyna LS. Nineteenth-century origins of neuroscientific concepts. Berkeley: University of California Press; 1987.
Ione A. Art and the brain: embodiment, plasticity, and the unclosed circle. Amsterdam: Rodopi Brill; 2016.
Jewanski J, Simner J, Day SA, Rothen N, Ward J. The evolution of the concept of synesthesia in the nineteenth century as revealed through the history of its name. J Hist Neurosc. 2019; https://doi.org/10.1080/0964704X.2019.1675422.
Sachs GTL. Historia naturalis duorum leucaetiopum auctoris ipsius et sororis eius. Solisbaci: Sumptibus Bibliopolii Seideliani; 1812.
Lima ESC. Cross-sensory experiences and the enlightenment: music synesthesia in context. Música Hodie. 2019;19:e54919.
Jewanski J, Simner J, Day SA, Rothen N, Ward J. The “golden age” of synesthesia inquiry in the late nineteenth century (1876–1895). J Hist Neurosci. 2020;29(2):175–202. https://doi.org/10.1080/0964704X.2019.1636348.
Lorusso L, Porro A. Coloured-synaesthesia in 19th century Italy. In: Clifford Rose F, editor. Neurology of music. London: Imperial College; 2010. p. 239–56.
Botta C. Memoire sur la nature des tons et des sons. Mémoires de l'Académie des Sciences, Littérature et Beaux-Arts de Turin pour les années X et XI. 1801;12:191–214.
Botta C. Scritti minori. Biella: Amosso; 1860. p. 17–39.
Jewanski J, Day SA, Simner J, Ward J. The beginnings of an interdisciplinary study of synaesthesia: discussions about the Nussbaumer brothers (1873). Theoria et Historia Scientiarum. 2013;10:149–76.
Verga A. La pseudocromestesia. Gazzetta Medica Italiana-Lombardia. 1864;49:426–7.
Zago S, Randazzo C. Antonio Berti and early history of aphasia in Italy. Neurol Sci. 2006;27:449–52.
Berti A. Della pseudocromestesia. Archivio Italiano per le malattie Nervose. 1865;2:22–8.
Zanchin G, Lisotto C, Maggioni F. Filippo Lussana (1820-1897), a physiologist of the Paduan medical faculty and his contribution to neurology. Italian J Neurol Sci (Suppl) Cogito. 1992;23:79–84.
Bock G. Lussana Filippo. In: Dizionario Biografico degli Italiani, vol. 61. Roma: Istituto dell’Enciclopedia Italiana; 2006. p. 269–72.
Berbenni G, Lorusso L. Filippo Lussana (1820–1897) da Cenate alle neuroscienze. Atti dell’incontro di studio, Cenate di Sopra, 26 maggio 2007. Bergamo: Fondazione per la storia economica e sociale di Bergamo; 2008.
Lorusso L, Bravi GO, Buzzetti S, Porro A. Filippo Lussana (1820–1897): from medical practitioner to neuroscience. Neurol Sci. 2012;33:703–8.
Lussana F. Lettera seconda. Fisiologia morale dei colori. Archivio Italiano per le malattie nervose. 1865;2:141–8.
Lussana F. Fisiologia dei colori. Padova: Sacchetto; 1873.
Lussana F. Sull’udizione colorata. Archivio Italiano per le malattie Nervose. 1884;21:371–7.
Fechner GT. Vorschule der Aesthetik. Leipzig: Bretkopf & Härtel; 1876.
Bleuler E, Lehmann K. Zwangsmässige Lichtempfindungen durch Schall und verwandte Erscheinungen auf dem Gebiete der andern Sinnesempfindungen. Leipzig: Fues; 1881.
Bleuler E. Zur Theorie der Sekundärempfindungen. Z Psychol. 1913;65:1–39.
Lombroso C. L’uomo di genio. Torino: Fratelli Bocca; 1894.
Galton F, Gruber E. L’audition colorée et les phenomenes similaires. In: Congrès international de psychologie expérimentale de Londres 1892. Londres: Eberchard et Jacot; 1893.
Lombroso C. L’uomo di genio. Roma: Napoleone; 1971.
Jewanski J, Simner J, Day SA, Rother N, Ward J. Recognizing synesthesia on the international stage: the first scientific symposium on synesthesia (at the international conference of physiological psychology, Paris, 1889). J Hist Neurosci. 2020;29(4):357–84.
Clavière J. L'audition colorée. Annee Psychol. 1898;5:161–78.
Luria AR. Malen’kaja knizka o bol’soj pamjati. Moskwa: Izdatel’stvo Moskowskogo Universiteta; 1968.
Luria AR. The mind of a mnemonist, a little book about a vast memory. New York & London: Basic Books; 1968.
Critchley M. In memoriam. In: Luria AR, editor. Brain and language, vol. 5; 1978. p. v–vi.
Mills CB, Innis J, Westendorf T, Owsianiecki L, McDonald A. Influence of a synesthete’s photisms on name recall. Cortex. 2006;42:155–63.
Ward J, Mattingley JB. Synaestesia: an overwiev of contemporary findings and controversies. Cortex. 2006;42:129–36.
Luria AR. Romantic science: unimagined portraits. In: Luria AR, editor. (1979) Viaggio nella mente di un uomo che non dimenticava nulla. In appendice due scritti inediti. Roma: Armando; 1976. p. 108–16.
Plassart A, White RB. Theodore Flournoy on synesthetic personification. J Hist Neurosci. 2017;26:1–14. https://doi.org/10.1080/0964704x.2015.1077542.
Baudelaire C. Ecrits sur l’Art. Paris: Flammarion; 1863.
O’Malley G. Literature synaesthesia. J Aesthet Art Critic. 1957;15:391–411.
Ione A. Neurology, synaesthesia, and painting. Intern Rev Neurobiol. 2006;74:69–78.
Pearce JMS. Synaesthesia. Eur Neurol. 2007;57:120–4.
Triarhou LC. Neuromusicology or musiconeurology? “Omni-art” in Alexander Scriabin as a fount of ideas. Front Psychol. 2016; https://doi.org/10.3389/fpsyg.2016.00364.
Day SA. Regarding types of Synesthesia and color music art. In: Galeyev BM, editor. Synesthesia: common wealth of senses and synthesis of arts. Kazan’, Russia: Izdatel’stvo KGTU; 2008. p. 282–8.
Kuo-Ying L. Cross-cultural perspectives of synesthesia in contemporary musical compositions. Int J Hum Art Soc Stud. 2020;1(1) https://doi.org/10.5121/ijhas.2020.01102.
Jewanski J, Day SA, Siddiq S, Haverkamp M, Reuter C, editors. Music and synesthesia. Abstracts from a conference in Vienna, scheduled for July 3–5, 2020. Münster: Wissenschaf tliche Schriften der WWU Münster; 2020.
Tedeschi F, Bolpagni P. Visioni musicali. Rapporti tra musica e arti visive nel novecento. Milano: Vita e Pensiero; 2009.
Vergo P. The music of painting. Music, modernism and the visual arts from the romantics to John cage. London: Phaidon Press Limited; 2010.
Merriam AP. Synestehsia and intersense modalities. In: Merriam AP, editor. The anthropology of music. Chicago: Northwestern University Press; 1964.
Moseley I. Crossed wires. Synaesthetic responses to music. In: Clifford Rose F, editor. Neurology of music. London: Imperial College; 2010. p. 257–75.
Neufeld J, Roy M, Zapf A, Sinker C, Emrich HM, Prox-Vagedes V, Dillo W, Zedler M. Is synesthesia more common in patients with Asperger syndrome? Front Hum Neurosci. 2013;7:847. https://doi.org/10.3389/fnhum.2013.00847.
Thornoton-Wells T, Cannistraci CJ, Anderson A, Kim C, Eapen M, Gore JC, Blake R, Dykens EM. Auditory attraction: activation of visual cortex by music and sound in Williams syndrome. Am J Intellect Dev Disabil. 2010;115:172–89. https://doi.org/10.1352/1944-7588-115.172.
Gowers WR. Epilepsy and other chronic convulsive diseases: their causes, symptoms and treatment. London: Churchill; 1881.
Critchley M. Neurological aspect of visual and auditory hallucinations. BMJ. 1939;2:634–9.
Sacks O. Hallucinations. New York: First Vintage Books Edition; 2013.
Jackson HJ. Epileptiform seizures— aura from the thumb—attacks of coloured vision. Med Times Gaz. 1863;1:589.
Jackson HJ. On right or left-side spasm at the onset of epileptic paroxysms, and on crude sensation warnings and elaborate mental states. Brain. 1880;3:192–206.
Jackson HJ, Stewart P. Epileptic attack with a warning of a crude sensation of smell and with the intellectual aura (dreamy state) in a patient who had symptoms pointing to gross organic disease of the right temporo-sphenoidal lobe. Brain. 1899;22:534–43.
Daly D. Uncinate fits. Neurology. 1958;8:250–60.
Neckar M, Bob P. Synesthetic association and psychosensory symptoms of temporal epilepsy. Neuropsychiatr Dis Treat. 2016;12:109–12.
Podoll K, Robinson D. Auditory-visual synaesthesia in a patient with basilar migraine. J Neurol. 2002;249:476–7.
Alstadhaug KB, Benjsminsen E. Synesthesia and migrane. BMC Neurol. 2010;10:121. https://doi.org/10.1186/1471-2377-10-121.
Sacks OW. Migraine. Revised and expanded. Berkeley-Los Angeles-Oxford: University of California Press; 1972.
Sacks O. An anthropologist on Mars. New York: Vintage Books Edition; 1995.
Podoll K, Robinson D. Cenesthetic pain sensations illustrated by an art teacher suffering from basilar migraine. Neurol Psychiat Brain Res. 2000;8:159–64.
Morrison DP. Abnormal perceptual experiences in migraine. Cephalalgia. 1990;10:273–7.
Ro T, Farnè A, Johnson RM, Wedeen V, Chu Z, Wang ZJ, Hunter JV, Beauchamp MS. Feeling sound after a thalamic lesion. Ann Neurol. 2007;62:433–41.
Beauchamp MS, Ro T. Neural substrates of sound-touch synesthesia after a thalamic lesion. J Neurosci. 2008;28:13696–702.
Afra P, Funke M, Matsuo F. Acquired auditory synesthesia: a window to early cross-modal sensory interactions. Psychol Res Behav Manag. 2009;2:31–7. Epub. 2009 Jan 15.
Armel KC, Ramachandran VS. Acquired synesthesia in retinitis pigmentosa. Neurocase. 1999;5:293–6.
Vike J, Jabbari B, Maitland CG. Auditory-visual synesthesia. Report of a case with intact visual pathways. Arch Neurol. 1984;41:680–1.
Trapp BD, Nave KA. Multiple sclerosis: an immune or neurodegenerative disorders? Annu Rev Neurosci. 2008;31:247–69. https://doi.org/10.1146/annure.neuro.30.0516.094313.
Camichael DA, Simner J. The immune hypothesis of synesthesia. Front Hum Neurosci. 2013;7:563. https://doi.org/10.3389/fnhum.2013.00563.
Carruthers HR, Miller V, Tarrier N, Whorwell PJ. Synesthesia, pseudo-synethesia, and irritable bowel syndrome. Dig Dis Sci. 2012;57:1629–35.
Banissy MJ, Cassell JE, Fitzpatrick S, Ward J, Walsh VX, Muggleton NG. Increased positive and disorganised schizotypy in synaesthetes who experience colour from letters and tones. Cortex. 2012;48:1085–7.
Ellis H. Mescal: a new artificial paradise. Contemp Rev. 1898;73:130–41.
Luke DP, Terhune DB. The induction of synaesthesia with chemical agents: a systematic review. Front Psychol. 2013;4:753. https://doi.org/10.3389/fpsyg.2013.00753.
Sinke C, Halpern JH, Zedler M, Neufeld J, Emrich HM, Passie T. Genuine and drug-induced synesthesia: a comparison. Conscious Cogn. 2012;21:1419–34.
Elkoshi R. Is music “colorful”? A study of the effects of age and musical literacy on children's notational color expressions. Int J Edu Arts. 2004;5(2) http://ijea.asu.edu/v5n2
Holm J, Aaltonen A, Siirtola H. Associating colours with musical genres. J N Music Res. 2009;38(1):87–100.
Palmer SE, Schloss KB, Xu Z, Prado-León R. Music–color associations are mediated by emotion. Proc Natl Acad Sci. 2013;110(22):8836–41.
Geoffrey L. Collier affective synesthesia: extracting emotion space from simple perceptual stimuli. Motiv Emot. 1996;20(1):1–30.
Barbiere JM, Vidal A, Zellner DA. The color of music: correspondence through emotion. Empir Stud Arts. 2007;25(2):193–208.
Day SA. Regarding types of synesthesia and color music art; 2008. http://www.daysyn.com/day2008.pdf.
Day SA. What is synesthesia? In: Jewanski J, Day SA, Siddiq S, Haverkamp M, Reuter C, editors. Music and synesthesia. Abstracts from a conference in Vienna, scheduled for July 3–5, 2020. Wissenschaftliche Schriften der WWU Münster: Münster; 2020. p. 17–23.
Cutietta RA, Haggerty KJ. A comparative study of color association with music at various age levels. J Res Music Educ. 1987;35(2):78–91.
Marks LE. On colored-hearing synesthesia: cross-modal translations of sensory dimensions. Psychol Bull 1975. 1975;83:303–31.
Simner J, Ipser A, Smees R, Alvares J. Does synaesthesia age? Changes in the quality and consistency of synaesthetic associations. Neuropsychologia. 2017;106(2017):407–17.
Carmicha DA, Smees R, Shillcock RC, Simner J. Is there a burden attached to synaesthesia? Health screening of synaesthetes in the general population. Br J Psychol. 2019;110:530–48.
Odbert HS, Karwoski TF, Eckerson AB. Studies in synesthetic thinking: I. musical and verbal association of color and mood. J Gen Psychol. 1942;26:153–73.
Simner J, Smees R, Rinaldi LJ, Carmicha DA. Wellbeing differences in children with synaesthesia: anxiety and mood regulation. Front Biosci Elite. 2021;13:195–215.
Rouw R, Scholte HS. Personality and cognitive profiles of a general synesthetic trait. Neuropsychologia. 2016;88:35–48.
Isbilen ES, Krumhansl CL. The color of music: emotion-mediated associations to Bach’s well-tempered clavier. Psychomusicol Music Mind Brain. 2016;26(2):149–61.
Mills CB, Boteler EH, Larcombe GK. “Seeing things in my head”: a synesthete's images for music and notes. Perception. 2003;32(119):1359–76.
Mesz B, Sigman M, Trevisan M. A composition algorithm based on crossmodal taste-music correspondences. Front Psychol. 2012;7:636.
Santos N & Pulido MT. Investigation of sound-gustatory syneshesia in coffeehouse setting. Proceeding of the 4th International Conference on Internet if Things, Big Data and Security, (IoTBDS 2019). p. 294–298; 2019.
Crisinel AS, Spence C. As bitter as a trombone: synesthetic correspondence in non synesthetes between taste/flavors and musical notes. Atten Percept Psychophys. 2010;72(7):1994–2002.
Malika Auvray M, Spence C. The multisensory perception of flavor. Conscious Cogn. 2008;17:1016–31.
Dael N, Sierro G, Mohr C. Affect-related synesthesias: a prospective view on their existence, expression and underlying mechanisms. Front Psychol. 2013;4:754.
Craig AD. How do you feel – now ? The anterior insula and human awareness. Nat Rev Neurosci. 2009;10:59–70.
Demaree HA, Everhart DE, Youngstrom EA, Harrison DW. Brain lateralization of emotional processing: historical roots and a future incorporating dominance. Behav Cogn Neurosci Rev. 2005;4:3–20.
McGeoch PD, Rouw R. How everydays sounds can trigger strong emotions: ASMR, misophonia ad the feeling wellbeing. BioEssay. 2020:e2000099. https://doi.org/10.1002/bies.202000099.
Elkoshi R. When sound and color meet: mapping chromesthetic experiences among school children who encounter classical music. In: Forrest D, Godwin L, editors. Proceedings of the International Society for Music Education 32nd World Conference on Music Education Glasgow, Scotland 25–29 July 2016; 2016. p. 85–94.
Lima ESC. Developmental synesthesia, perception, and performance: challenges and new directions in music education and research. XXV Congresso da Associação Nacional de Pesquisa e Pós-Graduação em Música – Vitória – 2015;2015.
Bodo PPR, Schiavoni LF. Web Sonification with synesthesia tools. Música Hodie, Goiânia. 2018;18(1):74–91.
Konanchuk SV, Grigorenko AY. Synesthesia and virtual communication: aesthetic approaches to research. IEEE communication strategies in digital society workshop (ComSDS); 2018. p. 29–32. https://doi.org/10.1109/COMSDS.2018.8354959.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Lorusso, L., Ione, A., Franchini, A.F., Porro, A. (2022). Synesthesia and Emotional Sound. In: Colombo, B. (eds) The Musical Neurons. Neurocultural Health and Wellbeing. Springer, Cham. https://doi.org/10.1007/978-3-031-08132-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-08132-3_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08131-6
Online ISBN: 978-3-031-08132-3
eBook Packages: MedicineMedicine (R0)