Skip to main content
Kent Academic Repository

Direct eye gaze enhances the ventriloquism effect

Lavan, Nadine, Chan, Wing Yue, Zhuang, Yongping, Mareschal, Isabelle, Shergill, Sukhwinder S. (2022) Direct eye gaze enhances the ventriloquism effect. Attention, perception & psychophysics, 84 . pp. 2293-2302. ISSN 1943-3921. (doi:10.3758/s13414-022-02468-5) (KAR id:96357)

Abstract

The “ventriloquism effect” describes an illusory phenomenon where the perceived location of an auditory stimulus is pulled toward the location of a visual stimulus. Ventriloquists use this phenomenon to create an illusion where an inanimate puppet is perceived to speak. Ventriloquists use the expression and suppression of their own and the puppet’s mouth movements as well the direction of their respective eye gaze to maximize the illusion. While the puppet’s often exaggerated mouth movements have been demonstrated to enhance the ventriloquism effect, the contribution of direct eye gaze remains unknown. In Experiment 1, participants viewed an image of a person’s face while hearing a temporally synchronous recording of a voice originating from different locations on the azimuthal plane. The eyes of the facial stimuli were either looking directly at participants or were closed. Participants were more likely to misperceive the location of a range of voice locations as coming from a central position when the eye gaze of the facial stimuli were directed toward them. Thus, direct gaze enhances the ventriloquist effect by attracting participants’ perception of the voice locations toward the location of the face. In an exploratory analysis, we furthermore found no evidence for an other-race effect between White vs Asian listeners. In Experiment 2, we replicated the effect of direct eye gaze on the ventriloquism effect, also showing that faces per se attract perceived sound locations compared with audio-only sound localization. Showing a modulation of the ventriloquism effect by socially-salient eye gaze information thus adds to previous findings reporting top-down influences on this effect.

Item Type: Article
DOI/Identification number: 10.3758/s13414-022-02468-5
Uncontrolled keywords: Direct gaze, Eye gaze, Sound localization, Ventriloquism effect, Voice
Subjects: R Medicine
Divisions: Divisions > Division of Natural Sciences > Kent and Medway Medical School
Funders: King's College London (https://ror.org/0220mzb33)
Depositing User: Rachael Heller
Date Deposited: 26 Sep 2022 12:54 UTC
Last Modified: 27 Sep 2022 09:29 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/96357 (The current URI for this page, for reference purposes)

University of Kent Author Information

Shergill, Sukhwinder S..

Creator's ORCID: https://orcid.org/0000-0003-4928-9100
CReDIT Contributor Roles:
  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.