#EEGManyLabs: Investigating the replicability of influential EEG experiments

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Yuri G. Pavlov - , University of Tübingen, Ural Federal University (Author)
  • Nika Adamian - , University of Aberdeen (Author)
  • Stefan Appelhoff - , Max Planck Institute for Human Development (Author)
  • Mahnaz Arvaneh - , University of Sheffield (Author)
  • Christopher S.Y. Benwell - , University of Dundee (Author)
  • Christian Beste - , Department of Child and Adolescent Psychiatry and Psychotherapy (Author)
  • Amy R. Bland - , Manchester Metropolitan University (Author)
  • Daniel E. Bradford - , University of Miami (Author)
  • Florian Bublatzky - , Heidelberg University  (Author)
  • Niko A. Busch - , University of Münster (Author)
  • Peter E. Clayson - , University of South Florida (Author)
  • Damian Cruse - , University of Birmingham (Author)
  • Artur Czeszumski - , University Osnabruck (Author)
  • Anna Dreber - , Stockholm School of Economics (SSE), University of Innsbruck (Author)
  • Guillaume Dumas - , University of Montreal (Author)
  • Benedikt Ehinger - , University of Stuttgart (Author)
  • Giorgio Ganis - , University of Plymouth (Author)
  • Xun He - , Bournemouth University (Author)
  • José A. Hinojosa - , Complutense University, Antonio de Nebrija University (Author)
  • Christoph Huber-Huber - , Radboud University Nijmegen (Author)
  • Michael Inzlicht - , University of Toronto (Author)
  • Bradley N. Jack - , Australian National University (Author)
  • Magnus Johannesson - , Stockholm School of Economics (SSE) (Author)
  • Rhiannon Jones - , University of Winchester (Author)
  • Evgenii Kalenkovich - , Higher School of Economics (Author)
  • Laura Kaltwasser - , Humboldt University of Berlin (Author)
  • Hamid Karimi-Rouzbahani - , University of Cambridge, Macquarie University (Author)
  • Andreas Keil - , University of Florida (Author)
  • Peter König - , University Osnabruck, University of Hamburg (Author)
  • Layla Kouara - , University of Leeds (Author)
  • Louisa Kulke - , Friedrich-Alexander University Erlangen-Nürnberg (Author)
  • Cecile D. Ladouceur - , University of Pittsburgh (Author)
  • Nicolas Langer - , University of Zurich, ETH Zurich (Author)
  • Heinrich R. Liesefeld - , University of Bremen, Ludwig Maximilian University of Munich (Author)
  • David Luque - , Universidad Autónoma de Madrid, University of Málaga (Author)
  • Annmarie MacNamara - , Texas A&M University (Author)
  • Liad Mudrik - , Tel Aviv University (Author)
  • Muthuraman Muthuraman - , Johannes Gutenberg University Mainz (Author)
  • Lauren B. Neal - , University of Texas of the Permian Basin (Author)
  • Gustav Nilsonne - , Karolinska Institutet, Stockholm University (Author)
  • Guiomar Niso - , Indiana University Bloomington, Technical University of Madrid (Author)
  • Sebastian Ocklenburg - , Ruhr University Bochum (Author)
  • Robert Oostenveld - , Radboud University Nijmegen (Author)
  • Cyril R. Pernet - , University of Edinburgh (Author)
  • Gilles Pourtois - , Ghent University (Author)
  • Manuela Ruzzoli - , University of Glasgow (Author)
  • Sarah M. Sass - , University of Texas at Tyler (Author)
  • Alexandre Schaefer - , Monash University Malaysia (Author)
  • Magdalena Senderecka - , Jagiellonian University in Kraków (Author)
  • Joel S. Snyder - , University of Nevada, Reno (Author)
  • Christian K. Tamnes - , University of Oslo (Author)
  • Emmanuelle Tognoli - , Florida Atlantic University (Author)
  • Marieke K. van Vugt - , University of Groningen (Author)
  • Edelyn Verona - , University of South Florida (Author)
  • Robin Vloeberghs - , KU Leuven (Author)
  • Dominik Welke - , Max Planck Institute for Empirical Aesthetics (Author)
  • Jan R. Wessel - , University of Iowa (Author)
  • Ilya Zakharov - , Russian Academy of Education (Author)
  • Faisal Mushtaq - , University of Leeds (Author)

Abstract

There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

Details

Original languageEnglish
Pages (from-to)213-229
Number of pages17
JournalCortex
Volume144
Publication statusPublished - Nov 2021
Peer-reviewedYes

External IDs

PubMed 33965167
ORCID /0000-0002-2989-9561/work/160952442

Keywords

Keywords

  • Cognitive neuroscience, EEG, ERP, Many labs, Open science, Replication