Abstract
We report three experiments designed to investigate the nature of any crossmodal links between audition and touch in sustained endogenous covert spatial attention, using the orthogonal spatial cuing paradigm. Participants discriminated the elevation (up vs. down) of auditory and tactile targets presented to either the left or the right of fixation. In Experiment 1, targets were expected on a particular side in just one modality; the results demonstrated that the participants could spatially shift their attention independently in both audition and touch. Experiment 2 demonstrated that when the participants were informed that targets were more likely to be on one side for both modalities, elevation judgments were faster on that side in both audition and touch. The participants were also able to “split” their auditory and tactile attention, albeit at some cost, when targets in the two modalities were expected on opposite sides. Similar results were also reported in Experiment 3 when participants adopted a crossedhands posture, thus revealing that crossmodal links in audiotactile attention operate on a representation of space that is updated following posture change. These results are discussed in relation to previous findings regarding crossmodal links in audiovisual and visuotactile covert spatial attentional orienting.
Article PDF
Similar content being viewed by others
References
Bertelson, P., & de Gelder, B. (in press). The psychology of multimodal perception. In C. Spence & J. Driver (Eds.),Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
Briand, K. A. (1998). Feature integration and spatial attention: More evidence of a dissociation between endogenous and exogenous ori enting.Journal of Experimental Psychology: Human Perception & Performance,24, 1243–1256.
Bushara, K. O., Weeks, R. A., Ishii, K., Catalan, M.-J., Tian, B., Rauschecker, J. P., &Hallett, M. (1999). Modality-specif ic frontal and parietal areas for auditory and visual spatial localization in humans.Nature NeuroScience,2, 759–765.
Butter, C. M. (1987). Varieties of attention and disturbances of attention: A neuropsychological analysis. In M. Jeannerod (Ed.),Neurophysiological and neuropsychological aspects of spatial neglect (pp. 1–23). Amsterdam: Elsevier, North-Holland.
Butter, C. M., Butchel, H. A., &Santucci, R. (1989). Spatial attentional shifts: Further evidence for the role of polysensory mechanisms using visual and tactile stimuli.Neuropsychologia,27, 1231–1240.
Caclin, A., Soto-Faraco, S., Kingstone, A., &Spence, C. (2002). Tactile “capture” of audition.Perception & Psychophysics,64, 616–630.
Calvert, G.A., Brammer, M. J., &Iversen, S.D. (1998). Crossmodal identification.Trends in Cognitive Sciences,2, 247–253.
Dai, H., Scharf, B., &Buus, S. (1991). Effective attenuation of signals in noise under focused attention.Journal of the Acoustical Society of America,98, 798–806.
Di, S., Brett, B., &Barth, D. S. (1994). Polysensory evoked potentials in rat parietotemporal cortex: Combined auditory and somatosensory responses.Brain Research,642, 267–280.
di Pellegrino, G., Làdavas, E., &Farné, A. (1997). Seeing where your hands are.Nature,388, 730.
Driver, J., &Spence, C. J. (1994). Spatial synergies between auditory and visual attention. In C. Umiltà & M. Moscovitch (Eds.),Attention and performance XV: Conscious and nonconscious processing (pp. 311–331). Cambridge, MA: MIT Press.
Driver, J., &Spence, C. [J.] (1998a). Attention and the crossmodal construction of space.Trends in Cognitive Sciences,2, 254–262.
Driver, J., &Spence, C. [J.] (1998b). Crossmodal attention.Current Opinion in Neurobiology,8, 245–253.
Driver, J., &Spence, C. [J.] (1998c). Crossmodal links in spatial attention.Philosophical Transactions of the Royal Society of London: Series B,353, 1319–1331.
Duncan, J. (1980). The demonstration of capacity limitation.Cognitive Psychology,12, 75–96.
Duncan, J., Martens, S., &Ward, R. (1997). Restricted attentional capacity within but not between sensory modalities.Nature,387, 808–810.
Eimer, M. (1996). ERP modulations indicate the selective processing of visual stimuli as a result of transient and sustained spatial attention.Psychophysiology,33, 13–21.
Eimer, M. (1998). Mechanisms of visuospatial attention: Evidence from event-related brain potentials.Visual Cognition,5, 257–286.
Eimer, M. (1999). Can attention be directed to opposite directions in different modalities? An ERP study.Clinical Neurophysiology,110, 1252–1259.
Eimer, M. (in press). Electrophysiology of human crossmodal spatial attention. In C. Spence & J. Driver (Eds.),Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
Eimer, M., Cockburn, D., Smedley, B., &Driver, J. (2001). Crossmodal links in endogenous spatial attention are mediated by common external locations: Evidence from event-related brain potentials.Experimental Brain Research,139, 398–411.
Eimer, M., &Driver, J. (2000). An event-related brain potential study of cross-modal links in spatial attention between vision and touch.Psychophysiology,37, 697–705.
Eimer, M., &Schröger, E. (1998). ERP effects of intermodal attention and cross-modal links in spatial attention.Psychophysiology,35, 313–327.
Eimer, M., Van Velzen, J., &Driver, J. (2002). Crossmodal interactions between audition, touch and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations.Journal of Cognitive NeuroScience,14, 254–271.
Farah, M. J., Wong, A.B., Monheit, M.A., &Morrow, L.A. (1989). Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal?Neuropsychologia,27, 461–470.
Foxe, J. J., Morocz, I.A., Murray, M.M., Higgins, B.A., Javitt, D.C., &Schroeder, C. E. (2000). Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping.Cognitive Brain Research,10, 77–83.
Gawryszewski, L. de G., Riggio, L., Rizzolatti, G., &Umiltà, C. (1987). Movements of attention in the three spatial dimensions and the meaning of “neutral” cues.Neuropsychologia,25, 19–29.
Graziano, M. S.A., &Gross, C.G. (1996). Multiple pathways for processing visual space. In T. Inui & J. L. McClelland (Eds.),Attention and performance XVI: Information integration in perception and communication (pp. 181–207). Cambridge, MA: MIT Press.
Graziano, M. S. A., &Gross, C. G. (1998). Spatial maps for the control of movement.Current Opinion in Neurobiology,8, 195–201.
Graziano, M. S. A., Gross, C. G., Taylor, C. S. R., & Moore, T. (in press). A system of multimodal areas in the primate brain. In C. Spence & J. Driver,Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
Graziano, M. S. A., Hu, X. T., &Gross, C. G. (1997). Coding the locations of objects in the dark.Science,277, 239–241.
Guest, S., Catmur, C., Lloyd, D., &Spence, C. (2002). Audiotactile interactions in roughness perception.Experimental Brain Research,146, 161–171.
Hillyard, S. A., Simpson, G. V., Woods, D. L., Van Voorhis, S., &Münte, T. F. (1984). Event-related brain potentials and selective attention to different modalities. In F. Reinoso-Suarez & C. Ajmone-Marson (Eds.),Cortical integration (pp. 395–414). New York: Raven.
Hötting, K., Rösler, F., &Röder, B. (2002). Crossmodal and intermodal attention modulates event-related brain potentials to tactile and auditory stimuli.Experimental Brain Research,148, 26–37.
Huerta, M. F., &Harting, J. K. (1984). The mammalian superior colliculus: Studies of its morphology and connections. In H. Vanagas (Ed.),Comparative neurology of the optic tectum (pp. 687–769). New York: Plenum.
Jonides, J. (1981). Voluntary versus automatic control over the mind’s eye’s movement. In J. Long & A. Baddeley (Eds.),Attention and performance (Vol. 9, pp. 187–203). Hillsdale, NJ: Erlbaum.
Jordan, T. R., Patching, G. R., &Milner, D. A. (1998). Central fixations are inadequately controlled by instructions alone: Implications for studying cerebral asymmetry.Quarterly Journal of Experimental Psychology,51A, 371–391.
Jousmäki, V., &Hari, R. (1998). Parchment-skin illusion: Sound-biased touch.Current Biology,8, 869–872.
Kelly, J. P. (1991). Hearing. In E. R. Kandel, J. H. Schwartz, & T. M. Jessell (Eds.),Principles of neural science (3rd ed., pp. 481–511). Amsterdam: Elsevier.
Kennett, S., Eimer, M., Spence, C., &Driver, J. (2001). Tactile-visual links in exogenous spatial attention under different postures: Convergent evidence from psychophysics and ERPs.Journal of Cognitive NeuroScience,13, 462–478.
Kennett, S., Spence, C., &Driver, J. (2002). Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture.Perception & Psychophysics,64, 1083–1094.
King, A. (in press). Development of multisensory spatial integration. In C. Spence & J. Driver (Eds.),Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
Klein, R.M., &Shore, D. I. (2000). Relationships among modes of visual orienting. In S. Monsell & J. Driver (Eds.),Control of cognitive processes: Attention and performance XVIII (pp. 195–208). Cambridge, MA: MIT Press.
Làdavas, E. (1993). Spatial dimensions of automatic and voluntary orienting components of attention. In I. H. Robinson & J. C. Marshall (Eds.),Unilateral neglect: Clinical and experimental studies (pp. 193–209). East Hove, U.K.: Erlbaum.
Làdavas, E., Pavani, F., &Farnè, A. (2001). Auditory peripersonal space in humans: A case of auditory-tactile extinction.Neurocase,7, 97–103.
Macaluso, E., Frith, C. D., &Driver, J. (2001). A reply to J. J. Mc-Donald, W. A. Teder-Sälejärvi, & L.M. Ward: Multisensory integration and crossmodal attention effects in the human brain.Science,292, 1791.
Mattingley, J. B., Driver, J., Beschin, N., &Robertson, I.H. (1997). Attentional competition between modalities: Extinction between touch and vision after right hemisphere damage.Neuropsychologia,35, 867–880.
McDonald, J. J., Teder-Sälejärvi, W. A., Heraldez, D., &Hillyard, S. A. (2001). Electrophysiological evidence for the “missing link” in crossmodal attention.Canadian Journal of Experimental Psychology,55, 141–149.
McDonald, J. J., Teder-Sälejärvi, W.A., &Hillyard, S.A. (2000). Involuntary orienting to sound improves visual perception.Nature,407, 906–908.
McDonald, J. J., &Ward, L.M. (1999). Spatial relevance determines facilitatory and inhibitory effects of auditory covert spatial orienting.Journal of Experimental Psychology: Human Perception & Performance,25, 1234–1252.
McDonald, J. J., &Ward, L. M. (2000a). Involuntary listening aids seeing: Evidence from human electrophysiology.Psychological Science,11, 167–171.
McDonald, J. J., & Ward, L.M. (2000b).On the modality specificity of stimulus-driven spatial attention orienting and inhibition of return. Unpublished manuscript.
Merat, N., Spence, C., Lloyd, D. M., Withington, D. J., &Mc-Glone, F. (1999). Audiotactile links in focused and divided spatial attention.Society for Neuroscience Abstracts,25, 1417.
Meredith, M. A., Wallace, M. T., &Stein, B. E. (1992). Visual, auditory and somatosensory convergence in output neurons of the cat superior colliculus: Multisensory properties of the tecto-reticulospinal projection.Experimental Brain Research,88, 181–186.
Miller, J. O. (1988). A warning about median reaction time.Journal of Experimental Psychology: Human Perception & Performance,14, 539–543.
Mondor, T.A., &Amirault, K. J. (1998). Effect of same- and differentmodality spatial cues on auditory and visual target identification.Journal of Experimental Psychology: Human Perception & Performance,24, 745–755.
Müller, H. J., &Rabbitt, P. M. A. (1989). Reflexive and voluntary orienting of visual attention: Time course of activation and resistance to interruption.Journal of Experimental Psychology: Human Perception & Performance,15, 315–330.
Pavani, F., Spence, C., &Driver, J. (2000). Visual capture of touch: Out-of-the-body experiences with rubber gloves.Psychological Science,11, 353–359.
Posner, M. I. (1978).Chronometric explorations of mind. Hillsdale, NJ: Erlbaum.
Posner, M. I., Nissen, M. J., &Klein, R.M. (1976). Visual dominance: An information-processing account of its origins and significance.Psychological Review,83, 157–171.
Posner, M. I., Nissen, M. J., &Ogden, W.C. (1978). Attended and unattended processing modes: The role of set for spatial location. In H. I. Pick & I. J. Saltzman (Eds.),Modes of perceiving and processing information (pp. 137–157). Hillsdale, NJ: Erlbaum.
Posner, M. I., Snyder, C. R., &Davidson, B. J. (1980). Attention and the detection of signals.Journal of Experimental Psychology,2, 160–174.
Rafal, R., Henik, A., &Smith, J. (1991). Extrageniculate contributions to reflex visual orienting in normal humans: A temporal hemifield advantage.Journal of Cognitive NeuroScience,3, 322–328.
Rizzolatti, G., Riggio, L., &Sheliga, B. M. (1994). Space and selective attention. In C.Umiltà & M.Moscovitch (Eds.),Attention and performance: Conscious and nonconscious information processing (Vol. 15, pp. 231–265). Cambridge, MA: MIT Press.
Robin, D. A., &Rizzo, M. (1989). The effect of focal cerebral lesions on intramodal and cross-modal orienting of attention. In T. E. Prescott (Ed.),Clinical aphasiology (Vol. 18, pp. 61–74). Boston: College-Hill.
Schroeder, C. E., Lindsley, R.W., Specht, C., Marcovici, A., Smiley, J. F., &Javitt, D. C. (2001). Somatosensory input to auditory association cortex in the macaque monkey.Journal of Neurophysiology,85, 1322–1327.
Schröger, E. (1993). Event-related potentials to auditory stimuli following transient shifts of spatial attention in a go/nogo task.Biological Psychology,36, 183–207.
Schröger, E., &Eimer, M. (1993). Effects of transient spatial attention on auditory event-related potentials.NeuroReport,4, 588–590.
Shiu, L.-P., &Pashler, H. (1994). Negligible effect of spatial precuing on identification of single digits.Journal of Experimental Psychology: Human Perception & Performance,20, 1037–1054.
Simon, J. R., Hinrichs, J.V., &Craft, J. L. (1970). Auditory S-R compatibility: Reaction time as a function of ear-hand correspondence and ear-response location correspondence.Journal of Experimental Psychology,86, 97–102.
Spence, C. [J.] (2001). Crossmodal attentional capture: A controversy resolved? In C. Folk & B. Gibson (Eds.),Attention, distraction and action: Multiple perspectives on attentional capture (pp. 231–262). Amsterdam: Elsevier.
Spence, C. J., &Driver, J. (1994). Covert spatial orienting in audition: Exogenous and endogenous mechanisms facilitate sound localization.Journal of Experimental Psychology: Human Perception & Performance,20, 555–574.
Spence, C. [J.], &Driver, J. (1996). Audiovisual links in endogenous covert spatial attention.Journal of Experimental Psychology: Human Perception & Performance,22, 1005–1030.
Spence, C. [J.], &Driver, J. (1997a). Audiovisual links in exogenous covert spatial orienting.Perception & Psychophysics,59, 1–22.
Spence, C. [J.], &Driver, J. (1997b). Cross-modal links in attention between audition, vision, and touch: Implications for interface design.International Journal of Cognitive Ergonomics,1, 351–373.
Spence, C. [J.], &Driver, J. (1997c). On measuring selective attention to an expected sensory modality.Perception & Psychophysics,59, 389–403.
Spence, C. [J.], &Driver, J. (1998). Crossmodal links between auditory and visual attention. In P. K. Kuhl & L. A. Crum (Eds.),Proceedings of the 16th International Congress on Acoustics and the 135th Meeting of the Acoustical Society of America (Vol. 3, pp. 1569–1570). New York: Acoustical Society of America.
Spence, C. [J.], & Driver, J. (Eds.) (in press).Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
Spence, C. [J.], Kingstone, A., Shore, D. I., &Gazzaniga, M. S. (2001). Representation of visuotactile space in the split brain.Psychological Science,12, 90–93.
Spence, C. [J.], Nicholls, M. E. R., Gillespie, N., &Driver, J. (1998). Cross-modal links in exogenous covert spatial orienting between touch, audition and vision.Perception & Psychophysics,60, 544–557.
Spence, C. [J.], Pavani, F., &Driver, J. (2000). Crossmodal links between vision and touch in covert endogenous spatial attention.Journal of Experimental Psychology: Human Perception & Performance,26, 1298–1319.
Spence, C. [J.], Ranson, J., &Driver, J. (2000). Cross-modal selective attention: On the difficulty of ignoring sounds at the locus of visual attention.Perception & Psychophysics,62, 410–424.
Spence, C. [J.], Shore, D. I., &Klein, R. M. (2001). Multisensory prior entry.Journal of Experimental Psychology: General,130, 799–832.
Stein, B. E., &Meredith, M. A. (1993).The merging of the senses. Cambridge, MA: MIT Press.
Teder-Sälejärvi, W. A., Münte, T. F., Sperlich, F.-J., &Hillyard, S. A. (1999). Intra-modal and cross-modal spatial attention to auditory and visual stimuli: An event-related brain potential (ERP) study.Cognitive Brain Research,8, 327–343.
Townsend, J. T., &Ashby, F. G. (1983).Stochastic modelling of elementary psychological processes. New York: Cambridge University Press.
Ward, L. M. (1994). Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention.Canadian Journal of Experimental Psychology,48, 242–259.
Ward, L.M., McDonald, J. J., &Golestani, N. (1998). Cross-modal control of attention shifts. In R. Wright (Ed.),Visual attention (pp. 232–268). New York: Oxford University Press.
Ward, L. M., McDonald, J. J., &Lin, D. (2000). On asymmetries in cross-modal spatial attention orienting.Perception & Psychophysics,62, 1258–1264.
Ward, L.M., Prime, D.A., &McDonald, J. J. (2002). Converging operations revisited: The case of attention.Abstracts of the Psychonomic Society,7, 56.
Wickens, C. D. (1980). The structure of attentional resources. In R. S. Nickerson (Ed.),Attention and performance VIII (pp. 239–257). Hillsdale, NJ: Erlbaum.
Wickens, C. D. (1984). Processing resources in attention. In R. Parasuraman & D. R. Davies (Eds.),Varieties of attention (pp. 63–102). San Diego: Academic Press.
Wickens, C. D. (1992).Engineering psychology and human performance (2nd ed.). New York: Harper Collins.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lloyd, D.M., Merat, N., Mcglone, F. et al. Crossmodal links between audition and touch in covert endogenous spatial attention. Perception & Psychophysics 65, 901–924 (2003). https://doi.org/10.3758/BF03194823
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03194823