|
The unity effect and its role in the temporal perception of complex audiovisual stimuli| old_uid | 8996 |
|---|
| title | The unity effect and its role in the temporal perception of complex audiovisual stimuli |
|---|
| start_date | 2010/06/28 |
|---|
| schedule | 14h30 |
|---|
| online | no |
|---|
| location_info | amphithéâtre |
|---|
| summary | The unity effect pertains to the assumption that a perceiver has as to whether he/she is observing a single multisensory event versus multiple separate unimodal events, a decision that is based, at least in part, on the consistency of the information available to each sensory modality (e.g., Welch & Warren, 1980). In order to investigate the impact of the unity effect on the temporal perception of complex
audiovisual stimuli, matching and mismatching auditory and visual speech streams consisting of speech and nonspeech stimuli were presented (Vatakis & Spence, 2007-a, -b, 2008-a; Vatakis et al., 2008). The results of 11 TOJ experiments provided psychophysical evidence in support of the conclusion that the unity effect can modulate the crossmodal binding of multisensory information at a perceptual level of information processing. This modulation was shown to be robust in the case of audiovisual speech events, while no such effect was reported for audiovisual nonspeech events (but see Petrini et al., 2009; Schutz & Kubovy, 2009, for musicians).
References
Petrini K, Russell M, Pollick F (2009) When knowing can replace seeing in audiovisual integration of actions. Cognition 110:432–439
Schutz M, Kubovy (2009) Causality in audio-visual sensory integration. J Exp Psychol: Human Percept Perform 35:1791-1810
Vatakis A, Spence C (2007a) How ‘special’ is the human face? Evidence from an audiovisual temporal order judgment task. Neuroreport 18:1807–1811.
Vatakis A, Spence C (2007b) Crossmodal binding: evaluating the ‘unity assumption’ using audiovisual speech stimuli. Percept Psychophys 69:744–756.
Vatakis A, Spence C (2008a). Evaluating the influence of the ‘unity assumption’ on the temporal perception of realistic audiovisual stimuli. Acta Psychol 127:12–23.
Vatakis A, Ghazanfar AA, Spence C (2008) Facilitation of multisensory integration by the “unity effect” reveals that speech is special. J Vis 8(9):14:1–11.
Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88:638–667. |
|---|
| responsibles | Béranger |
|---|
| |
|