Cross-modal Correspondence Between Acoustic Feature and Shape

@article{ART002372456},
author={ 곽유나 and 김채연 },
title={Cross-modal Correspondence Between Acoustic Feature and Shape},
journal={한국심리학회지: 인지 및 생물},
issn={1226-9654},
year={2018},
volume={30},
number={3},
pages={269-275},
doi={10.22172/cogbio.2018.30.3.005},
url={http://dx.doi.org/10.22172/cogbio.2018.30.3.005}

TY - JOUR
AU - 곽유나
AU - 김채연
TI - Cross-modal Correspondence Between Acoustic Feature and Shape
T2 - 한국심리학회지: 인지 및 생물
PY - 2018
VL - 30
IS - 3
PB - 한국인지및생물심리학회
SP - 269-275
SN - 1226-9654
AB - Our brain tends to associate stimulus features across the senses in a non-random manner. For example, people show consistency in labelling a rounded shape ‘maluma’/‘bouba’ and a spiky shape ‘takete’/‘kiki’. Previous studies have attributed this phenomenon to the correspondence between sound and shape, but without controlling for other potential factors (i.e., linguistic/orthographical factors). The present study examines the role of acoustic aspect per se by manipulating articulatory gestures to generate synthetic speech sounds not confined to a specific language. Participants were asked to choose either a rounded or spiky shape to indicate the shape that better matched each synthetic speech sound. The results demonstrate that shape choice was systematically mapped on to the dimensions manipulated to generate the sounds. These results indicate that acoustic features indeed drive the association between sound and visual shape.
KW - cross-modal correspondence, sound, articulatory synthesis, shape
DO - 10.22172/cogbio.2018.30.3.005
UR - http://dx.doi.org/10.22172/cogbio.2018.30.3.005
ER -

곽유나 and 김채연 (2018). Cross-modal Correspondence Between Acoustic Feature and Shape. 한국심리학회지: 인지 및 생물, 30( 3), 269- 275.

곽유나 and 김채연 . 2018, “Cross-modal Correspondence Between Acoustic Feature and Shape”, 한국심리학회지: 인지 및 생물, vol. 30, no. 3, pp. 269-275. Available from: doi:10.22172/cogbio.2018.30.3.005

곽유나 김채연 et al. “Cross-modal Correspondence Between Acoustic Feature and Shape” 한국심리학회지: 인지 및 생물 30.3 pp. 269-275 (2018): 269.

곽유나 , 김채연 . Cross-modal Correspondence Between Acoustic Feature and Shape 한국심리학회지: 인지 및 생물 [Internet]. 2018; 30( 3), : 269-275. Available from: doi:10.22172/cogbio.2018.30.3.005

곽유나 and 김채연 . “Cross-modal Correspondence Between Acoustic Feature and Shape” 한국심리학회지: 인지 및 생물 30, no.3 (2018): 269-275. doi: 10.22172/cogbio.2018.30.3.005

홈 권호 목록 논문 목록 논문 상세

Cross-modal Correspondence Between Acoustic Feature and Shape

한국심리학회지: 인지 및 생물

약어 : 심리인생

2018, vol.30, no.3, pp.269 - 275

DOI : 10.22172/cogbio.2018.30.3.005

발행기관 : 한국인지및생물심리학회

연구분야 : 심리과학

곽유나¹ , 김채연²

¹고려대학교 심리학과

²고려대학교

인용한 논문 수 : 2 서지 간략 보기

초록

Our brain tends to associate stimulus features across the senses in a non-random manner. For example, people show consistency in labelling a rounded shape ‘maluma’/‘bouba’ and a spiky shape ‘takete’/‘kiki’. Previous studies have attributed this phenomenon to the correspondence between sound and shape, but without controlling for other potential factors (i.e., linguistic/orthographical factors). The present study examines the role of acoustic aspect per se by manipulating articulatory gestures to generate synthetic speech sounds not confined to a specific language. Participants were asked to choose either a rounded or spiky shape to indicate the shape that better matched each synthetic speech sound. The results demonstrate that shape choice was systematically mapped on to the dimensions manipulated to generate the sounds. These results indicate that acoustic features indeed drive the association between sound and visual shape.

키워드

cross-modal correspondence, sound, articulatory synthesis, shape

참고문헌(28)

[학술지] Ahlner, F. / 2010 / Cross-modal iconicity: A cognitive semiotic approach to sound symbolism / Sign Systems Studies 38 (1/4) : 298 ~ 348
[학술지] Ashby, F. G. / 1994 / On the dangers of averaging across subjects when using multidimensional scaling or the similarity-choice model / Psychological Science 5 : 144 ~ 151
[학술지] Brainard, D. H. / 1997 / The psychophysics toolbox / Spatial Vision 10 : 433 ~ 436
[학술지] Bremner, A. J. / 2013 / "Bouba"and"Kiki"in Namibia? A remote culture make similar shape-sound matches, but different shape-taste matches to Westerners / Cognition 126 : 165 ~ 172
[단행본] Cox, T. F. / 2001 / Multidimensional scaling / Chapman & Hall
[학술지] Cuskley, C. / 2017 / Phonological and orthographic influences in the bouba-kiki effect / Psychological Research 81 : 119 ~ 130
[학술지] Davis, R. / 1961 / The fitness of names to drawings. A cross-cultural study in Tanganyika / British Journal of Psychology 52 : 259 ~ 268
[학술지] Donaldson, G. S. / 2006 / Effects of vowel context on the recognition of initial and medial consonants by cochlear implant users / Ear and Hearing 27 : 658 ~ 677
[학술지] D’Onofrio, A. / 2014 / Phonetic detail and dimensionality in sound-shape correspondences : Refining the Bouba-Kiki paradigm / Language and Speech 57 : 367 ~ 393
[학술지] Fort, M. / 2015 / Consonants are more important than vowels in the Bouba-kiki Effect / Language and Speech 58 : 247 ~ 266
[학술대회] Fort, M. / 2013 / Looking for the bouba-kiki effect in pre-lexical infants / Proceedings of the 12th international conference on auditory-visual speech processing : 71 ~ 76
[학술지] Gaißert, N. / 2010 / Visual and haptic perceptual spaces show high similarity in humans / Journal of Vision 10 : 1 ~ 20
[단행본] Hinton, L. / 1994 / Sound Symbolism / Cambridge University Press
[단행본] Köhler, W. / 1929 / Gestalt psychology / Liveright
[단행본] Köhler, W. / 1947 / Gestalt psychology / Liveright
[학술지] Lee Masson, H. / 2016 / Visual and haptic shape processing in the human brain : Unisensory processing, multisensory convergence, and top-down influences / Cerebral Cortex 26 : 3402 ~ 3412
[학술지] Maurer, D. / 2006 / The shape of boubas : Sound-shape correspondences in toddlers and adults / Developmental Science 9 : 316 ~ 322
[학술지] Nam, H. / 2013 / Computational simulation of CV combination preferences in babbling / Journal of Phonetics 41 : 63 ~ 77
[학술지] Nam, H. / 2004 / TADA : An enhanced, portable Task Dynamics model in MATLAB / The Journal of the Acoustical Society of America 115 : 2430 ~ 2430
[학술지] Nielsen, A. / 2011 / The sound of round : Evaluating the sound-symbolic role of consonants in the classic Takete-Maluma phenomenon / Canadian Journal of Experimental Psychology 65 : 115 ~ 124
[학술지] Nielsen, A. / 2013 / Parsing the role of consonants versus vowels in the classic Takete-Maluma phenomenon / Canadian Journal of Experimental Psychology 67 : 153 ~ 163
[학술지] Ozturk, O. / 2013 / Sound symbolism in infancy : Evidence for sound-shape cross-modal correspondences in 4-month-olds / Journal of Experimental Child Psychology 114 : 173 ~ 186
[학술지] Pelli, D. G. / 1997 / The VideoToolbox software for visual psychophysics : Transforming numbers into movies / Spatial Vision 10 : 437 ~ 442
[학술지] Ramachandran, V. S. / 2001 / Synaesthesia-a window into perception, thought and language / Journal of Consciousness Studies 8 : 3 ~ 34
[학술지] Spence, C. / 2011 / Crossmodal correspondences: A tutorial review / Attention, Perception, & Psychophysics 73 : 971 ~ 995
[학술지] Styles, S. J. / 2017 / When does Maluma/Takete fail? Two key failures and a meta-analysis suggest that phonology and phonotactics matter / i-Perception 8 : 1 ~ 17
[학술지] Taitz, A. / 2018 / The audiovisual structure of onomatopoeias: An intrusion of real-world physics in lexical creation / PLoS ONE 13 : e0193466
[학술지] Tarte, R. / 1974 / Phonetic symbolism in adult native speakers of Czech / Language and Speech 17 : 87 ~ 94