ManyBeds

ManyBeds

Evaluating replicability of auditory targeted memory reactivation

About the project

What is the idea?
The ManyBeds project is a large-scale replication study of Rudoy et al. (2009), investigating the Targeted Memory Reactivation (TMR) effect. TMR is a technique used to selectively cue memories during sleep and is thought to induce memory replay which is criticial for memory consolidation (Feld & Born, 2017; see Hu et al. (2020) for a meta-analysis of TMR).

In a collaborative effort, EEG and behavioral data of 600 participants will be collected and analyzed at mutliple lab sites, providing a precise estimate of the TMR effect and novel insights into the robustness of analyses in memory and sleep research using a split-half dataset approach. The outcome of the replication will be tested in a many analysts approach, using preregistrations and round robin feedback between participating analysis teams. Analyses will be conducted on half the dataset, allowing to assess the robustness of chosen analysis paths on the withheld dataset. Additionally, having such a large, highly powered dataset allows for further exploratory analyses.

The ManyBeds project is a Big Team Science study (Baumgartner et al., 2023; Coles et al., 2022), utilizing multi-site data collection (Pavlov et al., 2021), a many analysts approach (Botvinik-Nezer et al., 2020) including round-robin feedback (Silberzahn et al., 2018; Hoogeven et al., 2022) and methods of open, transparent science practices (Gilmore et al., 2017; Koch & Jones, 2016).

Check out the recording of our information event to learn more!
Here is the link to the recording, the password to access the file is ManyBeds1234 .
The slides you can find here.

You already know you want to be a part of ManyBeds?
Application for the data collection track closed on 31st of August 2024. Registration for the analysis track is still possible here.

Learn more about how to contribute

Track: Data collection Track: Analysis team

People of ManyBeds

Lead Lab

Avatar

Julia Beitner

Project Coordinator

Central Institute of Mental Health, Germany

Avatar

Gordon B. Feld

Principal Investigator

Central Institute of Mental Health, Germany

Advisory Board

Avatar

Jan Born

University of Tübingen, Germany

Avatar

Niko Busch

University of Münster, Germany

Avatar

Tina Lonsdorf

University of Bielefeld, Germany

Avatar

Ken Paller

Northwestern University, USA

Avatar

Russell Poldrack

Stanford University, USA

Timeline (preliminary)

 
 
 
 
 
Open call for participation
June 2024
Interested labs and analysts can now sign up here!
Application closes on 31st of August 2024.
 
 
 
 
 
Planning of analyses
September 2024
Analysis teams start the early phase of planning their analyses in fall 2024.
 
 
 
 
 
Begin of data collection
January 2025 –
The first data collection labs start.
 
 
 
 
 
Round-robin feedback and preregistration of analyses
July 2025 – October 2025
Analysis teams finalize their planned analyses, receive and provide feedback, and preregister.
 
 
 
 
 
Analysis teams receive data and submit their results
June 2026 – September 2026
Upon successful preregistration and finished data collection, analyses teams receive the exploration dataset, run their analyses, and submit their findings.

References

Baumgartner, H. A., Alessandroni, N., Byers-Heinlein, K., Frank, M. C., Hamlin, J. K., Soderstrom, M., … & Coles, N. A. (2023). How to build up big team science: A practical guide for large-scale collaborations. Royal Society Open Science, 10(6), 230235. https://doi.org/10.1098/rsos.230235

Botvinik-Nezer, R., Holzmeister, F., Camerer, C. F., Dreber, A., Huber, J., Johannesson, M., … & Schonberg, T. (2020). Variability in the analysis of a single neuroimaging dataset by many teams. Nature, 582(7810), 84-88. https://doi.org/10.1038/s41586-020-2314-9

Coles, N. A., Hamlin, J. K., Sullivan, L. L., Parker, T. H., & Altschul, D. (2022). Build up big-team science. Nature, 601(7894), 505-507. https://doi.org/10.1038/d41586-022-00150-2

Feld, G. B., & Born, J. (2017). Sculpting memory during sleep: Concurrent consolidation and forgetting. Current Opinion in Neurobiology, 44, 20-27. https://doi.org/10.1016/j.conb.2017.02.012

Gilmore, R. O., Diaz, M. T., Wyble, B. A., & Yarkoni, T. (2017). Progress toward openness, transparency, and reproducibility in cognitive neuroscience. Annals of the New York Academy of Sciences, 1396(1), 5-18. https://doi.org/10.1111/nyas.13325

Hoogeveen, S., Sarafoglou, A., Aczel, B., Aditya, Y., Alayan, A. J., Allen, P. J., … & Wagenmakers, E.-J. (2023). A many-analysts approach to the relation between religiosity and well-being. Religion, Brain & Behavior, 13(3), 237-283. https://doi.org/10.1080/2153599X.2022.2070255

Hu, X., Cheng, L. Y., Chiu, M. H., & Paller, K. A. (2020). Promoting memory consolidation during sleep: A meta-analysis of targeted memory reactivation. Psychological Bulletin, 146(3), 218-244. https://doi.org/10.1037/bul0000223

Koch, C., & Jones, A. (2016). Big science, team science, and open science for neuroscience. Neuron, 92(3), 612-616. http://dx.doi.org/10.1016/j.neuron.2016.10.019

Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., … & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013

Rudoy, J. D., Voss, J. L., Westerberg, C. E., & Paller, K. A. (2009). Strengthening individual memories by reactivating them during sleep. Science, 326(5956), 1079. https://doi.org/10.1126/science.1179013

Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., … & Nosek, B. A. (2018). Many analysts, one data set: Making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science, 1(3), 337-356. https://doi.org/10.1177/2515245917747646

Contact

If you have any questions, feedback or ideas, please don’t hesitate to contact us!

  • ManyBeds@zi-mannheim.de
  • RG Psychology and Neurobiology of Sleep and Memory, Department of Clinical Psychology, Central Institute of Mental Health, J5, 94305 Mannheim, Germany