10.6084/m9.figshare.5048524.v1
Yaseen Jamal
Yaseen
Jamal
Simon Lacey
Simon
Lacey
Lynne Nygaard
Lynne
Nygaard
K. Sathian
K.
Sathian
Interactions Between Auditory Elevation, Auditory Pitch and Visual Elevation During Multisensory Perception. Supplementary Material
Brill Online
2017
Cross-modal correspondence
audiovisual
spatial
congruency effect
Neurosciences not elsewhere classified
Sensory Systems
2017-05-30 09:38:46
Journal contribution
https://brill.figshare.com/articles/journal_contribution/Interactions_Between_Auditory_Elevation_Auditory_Pitch_and_Visual_Elevation_During_Multisensory_Perception_Supplementary_Material/5048524
<p>Cross-modal correspondences refer to associations between apparently
unrelated stimulus features in different senses. For example, high and low
auditory pitches are associated with high and low visual elevations,
respectively. Here we examined how this crossmodal correspondence between
visual elevation and auditory pitch relates to auditory elevation. We used
audiovisual combinations of highor low-frequency bursts of white noise and a
visual stimulus comprising a white circle. Auditory and visual stimuli could
each occur at high or low elevations. These multisensory stimuli could be
congruent or incongruent for three correspondence types: cross-modal featural
(auditory pitch/visual elevation), within-modal featural (auditory
pitch/auditory elevation) and cross-modal spatial (auditory and visual
elevation). Participants performed a 2AFC speeded classification (high or low) task
while attending to auditory pitch, auditory elevation, or visual elevation. We
tested for modulatory interactions between the three correspondence types.
Modulatory interactions were absent when discriminating visual elevation.
However, the within-modal featural correspondence affected the cross-modal
featural correspondence during discrimination of auditory elevation and pitch,
while the reverse modulation was observed only during discrimination of
auditory pitch. The cross-modal spatial correspondence modulated the other two
correspondences only when auditory elevation was being attended, was modulated
by the cross-modal featural correspondence only during attention to auditory
pitch, and was modulated by the within-modal featural correspondence while
performing discrimination of either auditory elevation or pitch. We conclude
that the cross-modal correspondence between auditory pitch and visual elevation
interacts strongly with auditory elevation. </p>