What is the idea?
The ManyBeds project is a large-scale replication study of Rudoy et al. (2009), investigating the Targeted Memory Reactivation (TMR) effect. TMR is a technique used to selectively cue memories during sleep and is thought to induce memory replay which is criticial for memory consolidation (Feld & Born, 2017; see Hu et al. (2020) for a meta-analysis of TMR).
In a collaborative effort, EEG and behavioral data of 600 participants will be collected and analyzed at mutliple lab sites, providing a precise estimate of the TMR effect and novel insights into the robustness of analyses in memory and sleep research using a split-half dataset approach. The outcome of the replication will be tested in a many analysts approach, using preregistrations and round robin feedback between participating analysis teams. Analyses will be conducted on half the dataset, allowing to assess the robustness of chosen analysis paths on the withheld dataset. Additionally, having such a large, highly powered dataset allows for further exploratory analyses.
The ManyBeds project is a Big Team Science study (Baumgartner et al., 2023; Coles et al., 2022), utilizing multi-site data collection (Pavlov et al., 2021), a many analysts approach (Botvinik-Nezer et al., 2020) including round-robin feedback (Silberzahn et al., 2018; Hoogeven et al., 2022) and methods of open, transparent science practices (Gilmore et al., 2017; Koch & Jones, 2016).
Check out the recording of our information event to learn more!
Here is the link to the recording, the password to access the file is ManyBeds1234 .
The slides you can find here.
You already know you want to be a part of ManyBeds?
Application for the data collection track closed on 31st of August 2024.
Registration for the analysis track is still possible here.
Baumgartner, H. A., Alessandroni, N., Byers-Heinlein, K., Frank, M. C., Hamlin, J. K., Soderstrom, M., … & Coles, N. A. (2023). How to build up big team science: A practical guide for large-scale collaborations. Royal Society Open Science, 10(6), 230235. https://doi.org/10.1098/rsos.230235
Botvinik-Nezer, R., Holzmeister, F., Camerer, C. F., Dreber, A., Huber, J., Johannesson, M., … & Schonberg, T. (2020). Variability in the analysis of a single neuroimaging dataset by many teams. Nature, 582(7810), 84-88. https://doi.org/10.1038/s41586-020-2314-9
Coles, N. A., Hamlin, J. K., Sullivan, L. L., Parker, T. H., & Altschul, D. (2022). Build up big-team science. Nature, 601(7894), 505-507. https://doi.org/10.1038/d41586-022-00150-2
Feld, G. B., & Born, J. (2017). Sculpting memory during sleep: Concurrent consolidation and forgetting. Current Opinion in Neurobiology, 44, 20-27. https://doi.org/10.1016/j.conb.2017.02.012
Gilmore, R. O., Diaz, M. T., Wyble, B. A., & Yarkoni, T. (2017). Progress toward openness, transparency, and reproducibility in cognitive neuroscience. Annals of the New York Academy of Sciences, 1396(1), 5-18. https://doi.org/10.1111/nyas.13325
Hoogeveen, S., Sarafoglou, A., Aczel, B., Aditya, Y., Alayan, A. J., Allen, P. J., … & Wagenmakers, E.-J. (2023). A many-analysts approach to the relation between religiosity and well-being. Religion, Brain & Behavior, 13(3), 237-283. https://doi.org/10.1080/2153599X.2022.2070255
Hu, X., Cheng, L. Y., Chiu, M. H., & Paller, K. A. (2020). Promoting memory consolidation during sleep: A meta-analysis of targeted memory reactivation. Psychological Bulletin, 146(3), 218-244. https://doi.org/10.1037/bul0000223
Koch, C., & Jones, A. (2016). Big science, team science, and open science for neuroscience. Neuron, 92(3), 612-616. http://dx.doi.org/10.1016/j.neuron.2016.10.019
Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S., Beste, C., … & Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013
Rudoy, J. D., Voss, J. L., Westerberg, C. E., & Paller, K. A. (2009). Strengthening individual memories by reactivating them during sleep. Science, 326(5956), 1079. https://doi.org/10.1126/science.1179013
Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., … & Nosek, B. A. (2018). Many analysts, one data set: Making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science, 1(3), 337-356. https://doi.org/10.1177/2515245917747646
If you have any questions, feedback or ideas, please don’t hesitate to contact us!