Neural audiovisual representations of space in sensory and higher multisensory 
cortices

Rohe, T; Noppeney, U

Item

ITEM ACTIONSEXPORT

Add to Basket

Local TagsRelease HistoryDetailsSummary

Released

Poster

Neural audiovisual representations of space in sensory and higher multisensory cortices

MPS-Authors

/persons/resource/persons84450

Rohe, T
Research Group Cognitive Neuroimaging, Max Planck Institute for Biological Cybernetics, Max Planck Society;
Max Planck Institute for Biological Cybernetics, Max Planck Society;

/persons/resource/persons84112

Noppeney, U
Research Group Cognitive Neuroimaging, Max Planck Institute for Biological Cybernetics, Max Planck Society;
Max Planck Institute for Biological Cybernetics, Max Planck Society;

External Resource

http://www.abstractsonline.com/Plan/ViewAbstract.aspx?sKey=34e7b831-d352-4852-a1ed-800cacae4eba&cKey=ffc383d5-0410-4855-bcbb-88c13e130cff&mKey=70007181-01c9-4de9-a0a2-eebfa14cd9f1
(Abstract)

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

Fulltext (public)

There are no public fulltexts stored in PuRe

Supplementary Material (public)

There is no public supplementary material available

Citation

Rohe, T., & Noppeney, U. (2012). Neural audiovisual representations of space in sensory and higher multisensory cortices. Poster presented at 42nd Annual Meeting of the Society for Neuroscience (Neuroscience 2012), New Orleans, LA, USA.

Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-B5E2-2

Abstract

Previous research has demonstrated that human observers locate audiovisual signals in space by averaging auditory (A) and visual (V) spatial signals according to their relative sensory reliabilities (=inverse of variance) (Ernst Banks, 2002; Alais Burr, 2004). This form of audiovisual integration is optimal in that it provides the most reliable percept.Yet, the neural systems mediating integration of spatial inputs remain unclear. Multisensory integration of spatial signals has previously been related to higher order association areas such as intraparietal sulcus (IPS) as well as the planum temporale (PT; Bonath et al., 2007). In the current fMRI study, we investigated whether and how early sensory (auditory cortex (A1), PT; visual regions V1-V3) and higher association (IPS) areas represent A and V spatial information. Subjects were presented with synchronous audiovisual signals, at spatially congruent or discrepant locations along the azimuth and at two levels of sensory reliability. Hence, the experimental design factorially manipulated: (1) V location, (2) A location, (3) V reliability. Subjects’ task was to localize the A signal. At the behavioral level, the perceived location of the A input was shifted towards the location of the V input depending on the relative A and V reliabilities. Likewise, at the neural level, the spatial location decoded with linear support vector machines from fMRI signals in brain areas along the A and V processing hierarchies was determined by the relative sensory reliabilities. The spatial location decoded from A1/PT was determined primarily by A spatial information with a stronger influence from V spatial information when the V reliability was high. Conversely, the spatial location decoded from visual areas (V1, V2, V3) and IPS was determined primarily by V spatial information with a stronger A influence when the V information was less reliable. In conclusion, our results suggest that the brain represents audiovisual spatial location in qualitative agreement with reliability-weighted multisensory integration at multiple levels of the cortical processing hierarchy.