Abstract
Recent research has reported that spatial modulation effects of audiotactile interactions tend to be limited to the space and body parts around the head. The present study investigated the generality of this finding by manipulating body parts stimulated and spatial relationships between the body parts and sounds. In Experiment 1, tactile stimuli were presented randomly to either left or right cheek, hand (palm or back) placed near the head, and knee while auditory stimuli were presented to either the same or opposite side from loudspeakers close to the head. Participants made speeded spatial discrimination responses regarding the side (left versus right) of the tactile stimulation. For any body part stimulated, the performance was worse when the auditory stimuli were presented from the opposite side rather than from the same side. Experiment 2 demonstrated that the spatial modulation effects for the palm or the back of the hand occurred irrespective of hand position (near or far from the head) and sound position (near or far from the head). The sounds delivered from near the head exerted a greater influence on tactile spatial discrimination performance as compared with the sound delivered from far from the head. Furthermore, the back of the hand was more influenced by the auditory stimuli than the palm when the hands were placed near the sounds. These results suggest that the spatial modulation effects of audiotactile interactions can occur beyond the space and body surface around the head.
Similar content being viewed by others
References
Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14(3):257–262
Colavita FB (1974) Human sensory dominance. Percept Psychophys 16(2):409–412
Colavita FB (1982) Visual dominance and attention in space. Bull Psychon Soc 19:261–262
Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870):429–433
Farnè A, Làdavas E (2002) Auditory peripersonal space in humans. J Cogn Neurosci 14(7):1030–1043
Forss N, Salmelin R, Hari R (1994) Comparison of somatosensory evoked fields to airpuff and electric stimuli. Electroencephalogr Clin Neurophysiol 92(6):510–517
Fu KG, Johnston TA, Shah AS, Arnold L, Smiley J, Hackett TA, Garraghty PE, Schroeder CE (2003) Auditory cortical neurons respond to somatosensory stimulation. J Neurosci 23(20):7510–7515
Gardner EP, Hämäläinen HA, Warren S, Davis J, Young W (1984) Somatosensory evoked potentials (SEPs) and cortical single unit responses elicited by mechanical tactile stimuli in awake monkeys. Electroencephalogr Clin Neurophysiol 58(6):537–552
Graziano MS, Reiss LA, Gross CG (1999) A neuronal representation of the location of nearby sounds. Nature 397(6718):428–430
Hashimoto I, Yoshikawa K, Sasaki M (1988) Somatosensory evoked potential correlates of psychophysical magnitude estimations for tactile air-puff stimulation in man. Exp Brain Res 73(3):459–469
Howard IP, Templeton WB (1966) Human spatial orientation. New York, Wiley
Igarashi Y, Kitagawa N, Ichihara S (2010) Influence of the body on crossmodal interference effects between tactile and two-dimensional visual stimuli. Exp Brain Res 204(3):419–430
Jackson CV (1953) Visual factors in auditory localization. Q J Exp Psychol 5:52–65
Johansson RS, Vallbo AB (1979) Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. J Physiol 286:283–300
Kitagawa N, Spence C (2006) Audiotactile multisensory interactions in human information processing. Jpn Psychol Res 48(3):158–173
Kitagawa N, Zampini M, Spence C (2005) Audiotactile interactions in near and far space. Exp Brain Res 166(3–4):528–537
Lloyd DM, Merat N, McGlone F, Spence C (2003) Crossmodal links between audition and touch in covert endogenous spatial attention. Percep Psychophys 65(6):901–924
Macefield V (1998) The signaling of touch, finger movements and manipulation forces by mechanoreceptors in human skin. In: Morley J (ed) Neural aspects of tactile stimulation. Elsevier Science BV, The Netherlands, pp 89–130
Menning H, Ackermann H, Hertrich I, Mathiak K (2005) Spatial auditory attention is modulated by tactile priming. Exp Brain Res 164(1):41–47
Meredith MA, Stein BE (1986) Visual, auditory, and somatosensory convergence on cells in superior colliculus result in multisensory integration. J Neurophysiol 56(3):640–662
Meyer GF, Wuerger SM, Röhrbein F, Zetzsche C (2005) Low-level integration of auditory and visual motion signals requires spatial colocalisation. Exp Brain Res 166(3–4):538–547
Moore DR, King AJ (1999) Auditory perception: the near and far of sound localization. Curr Biol 9(10):R361–R363
Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ (2005) Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 15(7):963–974
Occelli V, O’Brien JH, Spence C, Zampini M (2010) Assessing the audiotactile Colavita effect in near and rear space. Exp Brain Res 203(3):517–532
Occelli V, Spence C, Zampini M (2011) Audiotactile interactions in front and rear space. Neurosci Biobehav Rev 35(3):589–598
Penfield W, Boldrey E (1937) Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation. Brain 60(4):389–443
Rolke R, Magerl W, Campbell KA, Schalber C, Caspari S, Birklein F, Treede RD (2006) Quantitative sensory testing: a comprehensive protocol for clinical trials. Eur J Pain 10(1):77–88
Schieppati M, Ducati A (1984) Short-latency cortical potentials evoked by tactile air-jet stimulation of body and face in man. Electroencephalogr Clin Neurophysiol 58(5):418–425
Sekiyama K, Hashimoto K, Sugita Y (2012) Visuo-somatosensory reorganization in perceptual adaptation to reversed vision. Acta Psychol 141(2):231–242
Serino A, Bassolino M, Farnè A, Làdavas E (2007) Extended multisensory space in blind cane users. Psychol Sci 18(7):642–648
Shore DI, Barnes ME, Spence C (2006) Temporal aspects of the visuotactile congruency effect. Neurosci Lett 392(1–2):96–100
Simon JR (1990) The effects of an irrelevant directional cue on human information processing. In: Proctor RW, Reeve TG (eds) Stimulus-response compatibility. Elsevier Science, Amsterdam, pp 31–86
Simon JR, Hinrichs JV, Craft JL (1970) Auditory S-R compatability: reaction time as a function of ear-hand correspondence and ear-response location correspondence. J Exp Psychol 86(1):97–102
Slutsky DA, Recanzone GH (2001) Temporal and spatial dependency of the ventriloquism effect. NeuroReport 12(22):7–10
Spence C, Nicholls ME, Gillespie N, Driver J (1998) Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Percept Psychophys 60(4):544–557
Spence C, Shore DI, Klein RM (2001) Multisensory prior entry. J Exp Psychol Gen 130(4):799–832
Stein BE, Meredith MA (1993) The merging of the senses. MIT Press, Cambridge
Tajadura-Jiménez A, Kitagawa N, Väljamäe A, Zampini M, Murray MM, Spence C (2009) Auditory-somatosensory multisensory interactions are spatially modulated by stimulated body surface and acoustic spectra. Neuropsychologia 47(1):195–203
Yamamoto S, Kitazawa S (2001) Reversal of subjective temporal order due to arm crossing. Nat Neurosci 4(7):759–765
Zampini M, Brown T, Shore DI, Maravita A, Röder B, Spence C (2005a) Audiotactile temporal order judgments. Acta Psychol 118(3):277–291
Zampini M, Harris C, Spence C (2005b) Effect of posture change on tactile perception: impaired direction discrimination performance with interleaved fingers. Exp Brain Res 166(3–4):498–508
Zampini M, Torresan D, Spence C, Murray MM (2007) Auditory–somatosensory multisensory interactions in front and rear space. Neuropsychologia 45:1869–1877
Acknowledgments
This research is based on the Master’s thesis of the second author, submitted to Kumamoto University. This research was supported by Grants-in-Aid for Scientific Research (A) (No. 21243040) to KS from the Japan Society for the Promotion of Science. We would like to thank Carlo Alberto Marzi and anonymous reviewers for helpful comments on an earlier draft of this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Teramoto, W., Nozoe, Y. & Sekiyama, K. Audiotactile interactions beyond the space and body parts around the head. Exp Brain Res 228, 427–436 (2013). https://doi.org/10.1007/s00221-013-3574-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-013-3574-5