Voice over: Audio-visual congruency and content recall in the gallery setting

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Merle T. Fairhurst - , Ludwig Maximilian University of Munich, University of London (Author)
  • Minnie Scott - , Tate Gallery (Author)
  • Ophelia Deroy - , School of Advanced Study, Ludwig Maximilian University of Munich (Author)

Abstract

Experimental research has shown that pairs of stimuli which are congruent and assumed to ‘go together’ are recalled more effectively than an item presented in isolation. Will this multisensory memory benefit occur when stimuli are richer and longer, in an ecological setting? In the present study, we focused on an everyday situation of audio-visual learning and manipulated the relationship between audio guide tracks and viewed portraits in the galleries of the Tate Britain. By varying the gender and narrative style of the voice-over, we examined how the perceived congruency and assumed unity of the audio guide track with painted portraits affected subsequent recall. We show that tracks perceived as best matching the viewed portraits led to greater recall of both sensory and linguistic content. We provide the first evidence that manipulating crossmodal congruence and unity assumptions can effectively impact memory in a multisensory ecological setting, even in the absence of precise temporal alignment between sensory cues.

Details

Original languageEnglish
Article numbere0177622
JournalPloS one
Volume12
Issue number6
Publication statusPublished - Jun 2017
Peer-reviewedYes
Externally publishedYes

External IDs

PubMed 28636667
ORCID /0000-0001-6540-5891/work/150883503

Keywords

ASJC Scopus subject areas