What You See Is What You Hear: Sounds Alter the Contents of Visual Perception

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung

Beitragende

  • JR Williams - (Autor:in)
  • YA Markov - (Autor:in)
  • NA Tiurina - , École Polytechnique Fédérale de Lausanne (Autor:in)
  • VS Störmer - (Autor:in)

Abstract

Visual object recognition is not performed in isolation but depends on prior knowledge and context. Here, we found that auditory context plays a critical role in visual object perception. Using a psychophysical task in which naturalistic sounds were paired with noisy visual inputs, we demonstrated across two experiments (young adults; ns = 18–40 in Experiments 1 and 2, respectively) that the representations of ambiguous visual objects were shifted toward the visual features of an object that were related to the incidental sound. In a series of control experiments, we found that these effects were not driven by decision or response biases (ns = 40–85) nor were they due to top-down expectations (n = 40). Instead, these effects were driven by the continuous integration of audiovisual inputs during perception itself. Together, our results demonstrate that the perceptual experience of visual objects is directly shaped by naturalistic auditory context, which provides independent and diagnostic information about the visual world.

Details

OriginalspracheEnglisch
Seiten (von - bis)2109–2122
Seitenumfang14
FachzeitschriftPsychological Science
Jahrgang33
Ausgabenummer12
Frühes Online-Datum30 Sept. 2022
PublikationsstatusVeröffentlicht - Dez. 2022
Peer-Review-StatusJa
Extern publiziertJa

Externe IDs

PubMed 36179072
Scopus 85139205085

Schlagworte