Editorial Communication
A Community Model for Rigorous and Inclusive Scholarship
Inaugural Editorial of Replication Research (R2)
Abstract
Reproducibility and replicability are vital for trustworthy, cumulative research, yet remain undervalued in most areas of academic publishing. Replication Research (R2) is a Diamond Open Access journal dedicated to publishing high-quality reproductions, replications, and related methodological work across disciplines. With robust standards for transparency, open peer review, and social responsibility, R2 offers practical guidance and support for authors. We aim to rebalance research culture by valuing diligence and robustness alongside innovation, thereby increasing confidence in research findings. We invite researchers to contribute to and benefit from an open, community-driven journal designed to elevate the status and impact of replications (repeated studies of published findings with different data) and reproductions (repeated tests of published findings with the same data). In this editorial, we introduce the aims, policies, and scope of Replication Research, outlining how the journal will operate and the values that guide it.
Lay Summary
This editorial introduces Replication Research, an open-access journal dedicated to publishing studies that check whether previous scientific findings hold up when reanalyzed or repeated. The authors argue that science becomes more trustworthy when researchers value careful verification of previous discoveries as much as novel discoveries, but unfortunately replication studies still receive too little recognition. To address this, the journal aims to make replication research a more visible and respected part of the scientific process.
Keywords: reproduction, replication, metascience, open science, open access
Some of these options may not have a visible effect on small screens.
Building a Community Infrastructure for Rigorous and Inclusive Scholarship
With R2, our goal is to foster a culture of rigor and transparency in all disciplines and methodological traditions. Our journal provides a platform for researchers conducting replications, reproductions, and other forms of repetitive or confirmatory inquiry. R2’s tenets include:
Providing an interdisciplinary dedicated outlet for repetitive research: Despite growing recognition of the importance of reassessing existing findings, few journals explicitly welcome such work. A dedicated venue focused on rigor—irrespective of novelty—facilitates the visibility and accessibility of replication and reproduction studies (Reed et al., 2025Reed, W. R., Röseler, L., Saam, M., & Wallrich, L. (2025). No room at the inn? the case for specialized replication journals (tech. rep. No. 88). WiSo-HH Working Paper Series. https://www.econstor.eu/handle/10419/319083). Existing outlets that do support this type of work (e.g., the Journal of Comments and Replications in Economics) are often domain-specific. As an interdisciplinary journal, R2 offers a home for scholars from any field to publish rigorous re-examinations of prior research.
Increasing the number of replications: The proportion of replication studies in published research remains very low (e.g., Perry et al., 2022Perry, T., Morris, R., & Lea, R. (2022). A decade of replication study in education? a mapping review (2011--2020). Educational Research and Evaluation, 27(1--2), 12–34. https://doi.org/10.1080/13803611.2021.2022315; Pridemore et al., 2018Pridemore, W. A., Makel, M. C., & Plucker, J. A. (2018). Replication in criminology and the social sciences. Annual Review of Criminology, 1, 19–38. https://doi.org/10.1146/annurev-criminol-032317-091849), and only recently have structured methods for evaluating replicability and reproducibility been developed (e.g., Heyard et al., 2025Heyard, R., Pawel, S., Frese, J., Voelkl, B., Würbel, H., McCann, S., et al. (2025). A scoping review on metrics to quantify reproducibility: A multitude of questions leads to a multitude of metrics. Royal Society Open Science, 12(7), 242076. https://doi.org/10.1098/rsos.242076). Nevertheless, replication rates are rising (Clarke et al., 2023Clarke, B., Lee, P. Y., Schiavone, S. R., Rhemtulla, M., & Vazire, S. (2023). The prevalence of direct replication articles in top-ranking psychology journals. https://doi.org/10.1037/amp0001385; Reed et al., 2025Reed, W. R., Röseler, L., Saam, M., & Wallrich, L. (2025). No room at the inn? the case for specialized replication journals (tech. rep. No. 88). WiSo-HH Working Paper Series. https://www.econstor.eu/handle/10419/319083). R2 aims to accelerate this mainstreaming trend by increasing the recognition, visibility, and credibility of repetitive research across disciplines.
Incentivizing high-quality replications and reproductions: Publications remain the primary currency of academic recognition, yet the criteria for what counts as publishable often privilege novelty over rigor. R2 seeks to balance these incentives by rewarding diligence, transparency, and methodological integrity, regardless of the approach or outcome. We invite contributions that exemplify careful reasoning, openness in design and analysis, and clarity in communicating methods and evidence. Authors are supported in meeting field-specific standards for transparency, whether this involves sharing data, materials, and code, or providing reflexive accounts of analytic and interpretive processes. Quantitative submissions undergo reproducibility checks, while qualitative and mixed-methods work is evaluated for coherence, transparency, and rigor in documenting analytic pathways. To foster accountability and learning, all accepted manuscripts are accompanied by openly published peer review reports. In line with DORA, R2 rejects journal-level metrics in evaluation and instead credits concrete research
contributions (e.g., data, code, reflexive analytic memos, reviews, replications).1The incentive to prioritize eye-catching novelty over verifiable claims is itself a by-product of institutional selection pressures; we design against that selection.
Supporting transparency: At R2, transparency is treated as a cornerstone of trustworthy scholarship, promoting openness at every stage of the research process. R2 requires preprints before submission and adopts open peer review, in which correspondence between authors, reviewers, and editors is publicly accessible. Moreover, R2 adopts a contributorship-first approach and requires a CRediT-based Author Contributions statement (Holcombe, 2019Holcombe, A. O. (2019). Contributorship, not authorship: Use credit to indicate who did what. Publications, 7(3), 48. https://doi.org/10.3390/publications7030048) (preferably exported from tenzing) and encourages authors to reflect on authorship rationale & equity, inviting authors to be transparent about their decision regarding authorship ordering and conventions used (e.g., contribution-based, alphabetical, joint first/last)
Sustainable Diamond Open Access: R2 operates as a Diamond Open Access journal—free to publish in, free to read, and with authors retaining full copyright to their work. All content is released under a CC-BY licence to ensure unrestricted reuse and dissemination. Sustained through institutional infrastructure rather than commercial models, R2 is designed for long-term accessibility, with all articles permanently archived. Our Diamond model is not only cost policy; it is an equity policy aligned with the UNESCO Recommendation on Open Science (UNESCO, 2021UNESCO. (2021). UNESCO recommendation on open science (tech. rep.). https://doi.org/10.54677/MNMH8546), which calls for fair, inclusive, capacity-building approaches across regions and methods. R2 lowers financial and prestige barriers that disproportionately exclude under-resourced scholars and qualitative traditions.2In 2021, UNESCO’s Member States adopted a non-binding Recommendation on Open Science that recognizes science as a global public good and urges states to advance open, equitable science. This Recommendation draws on UDHR Art. 27(1) and the binding obligations in ICESCR Art. 15, but only for the States that have ratified the ICESCR (currently 173), not all 193 UN Member States (i.e., the United States, Saudi Arabia, United Arab Emirates, and Cuba, for example, did not ratify ICESCR).
Community-governed journal: Conceived through open deliberation among a diverse group of scholars and practitioners, R2 embodies a model of participatory governance independent of commercial and institutional control. The journal’s constitution publicly delineates its ownership, decision-making, and review processes (R¨oseler, Wallrich, Adler, et al., 2025), reflecting our commitment to participatory governance, community, and shared responsibility (R¨oseler, Moser, et al., 2025). We have pledged to maintain R2 as a community-run service at least until early 2028, after which its continuation will be evaluated against pre-defined success criteria (R¨oseler, Wallrich, & Azevedo, 2025).
Contributing to the creation of a sustainable, non-commercial publishing ecosystem: Much of today’s scholarly publishing remains constrained by commercial imperatives that often conflict with scientific values. Indeed, global Article Processing Charge (APC) spending to six publishers alone is estimated at $8.97B (2019–2023), with hybrid fees exceeding gold, while median OA fees and long turnaround times persist (Haustein et al., 2024Haustein, S., Schares, E., Alperin, J. P., Hare, M., Butler, L. -A., & Schönfelder, N. (2024). Estimating global article processing charges paid to six publishers for open access between 2019 and 2023. https://arxiv.org/abs/2407.16551). Moreover, pressures to meet journal-level impact metrics irrespective of research quality (Brembs, 2018Brembs, B. (2018). Prestigious science journals struggle to reach even average reliability. Frontiers in human neuroscience, 12, 327726. https://doi.org/10.3389/fnhum.2018.00037), escalating costs for open-access publishing (Grossmann & Brembs, 2021Grossmann, A., & Brembs, B. (2021). Current market rates for scholarly publishing services. F1000Research, 10, 20. https://doi.org/10.12688/f1000research.27468.2), and the proliferation of predatory journals (Beall, 2017Beall, J. (2017). What I learned from predatory publishers. Biochemia medica, 27(2), 273–278. https://doi.org/10.11613/BM.2017.029) illustrate how profit motives can undermine equitable access to knowledge. In contrast, R2 is part of a growing movement to realign scholarly publishing with the public values that sustain it. Indeed, our constitution guarantees that R2 is—and will remain—a Diamond Open Access journal. R2 demonstrates that publishing can be community-owned, transparent about its processes and costs, and oriented toward service rather than competition. By prioritizing accessibility, accountability, social responsibility, epistemic inclusion, and equity over profit, we aim to contribute to a sustainable model of scholarly communication—one that treats knowledge as a shared global good and values diverse contributions to its creation.
Beyond publishing as a bottleneck: R2 treats publication as the outcome of open community
curation, not the precondition for scholarly legitimacy. A work is shared first (preprints) by the author and then evaluated transparently (open, field-appropriate review) by R2. By adopting these practices in a Diamond Open Access community-run venue, R2 centers scholarly discourse over publisher status.
Epistemic inclusion: R2 seeks to reduce structural barriers that exclude under-resourced scholars, methods, and geographies. We welcome submissions in all methodological traditions and encourage inclusive citation practices (Sauv´e et al., 2025) and accessibility-first materials. Aside from serving as a venue for rigorous research, R2 aspires to model a publishing ecosystem grounded in openness, community, and equity. We envision a future in which confirmatory and critical research receives the same recognition as novelty-driven studies; where transparency and reflexivity are integral to all methodological traditions; and where scientific communities (not markets) determine the values that guide scholarly communication. In this spirit, R2 invites researchers, reviewers, and institutions to join in building a culture of collective responsibility for the credibility and accumulation of knowledge.
What does R2 publish?
We envision R2 as a hub for researchers who are interested in rigorous and robust repetitive research. We welcome reproductions (repeated investigation of previous findings using the same data), replications (repeated investigation of previous findings using different data), and related contributions such as methods for replication research, meta-analyses and meta-syntheses of replications, multi- or many-analyst studies, tutorials, comments, or reviews of replications. Submitted articles may also consist of single studies that have been part of meta-articles (e.g., Open Science Collaboration, 2015) as long as they have not been published individually, meet our standards for openness, and declare transparently that they have been included in a meta-article. At launch, we accept submissions from numerous disciplines such as quantitative and qualitative social sciences (an up-to-date list is available at replicationresearch.org). Submissions from other disciplines are welcome and may be considered depending on the availability of an ad hoc editor.
Transparency is the norm
R2 has high standards for transparency and openness. Studies should report whether they were preregistered and should disclose and reflect all differences between preregistered and final report. In addition, for quantitative works, analysis plans, materials, study protocols, code, and data should be shared and complete per disciplinary best-practices (e.g., PRISMA for meta-analyses; Page et al., 2021Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71)3If sharing certain materials is not feasible (e.g., due to ethical, privacy, or legal considerations), authors should clearly state the reasons and, where possible, describe how access requests or alternatives can be handled. Our editorial team is committed to supporting authors in addressing any challenges with data sharing.. We badge Open Data/Code/Materials, Preregistration, Computational Reproducibility and perform link checks prior to sending articles for review. For qualitative and mixed-methods work, transparency includes, for example, reflexive accounts of positionality, sampling/access decisions, coding/interpretive pathways, and audit trails.
Guidance for authors
For reproductions and replications, we expect authors to justify their choice of the target study, explain their decision for the type of reproduction or replication, disclose deviations from (or adjustments to) the original study, provide readers with a differentiated judgment of success or
failure, and discuss possible reasons for consistencies and discrepancies between the original and repetition’s results in a constructive and factual manner. We recommend evaluation of reproduction or replication success based on a predetermined criterion (Heyard et al., 2025Heyard, R., Pawel, S., Frese, J., Voelkl, B., Würbel, H., McCann, S., et al. (2025). A scoping review on metrics to quantify reproducibility: A multitude of questions leads to a multitude of metrics. Royal Society Open Science, 12(7), 242076. https://doi.org/10.1098/rsos.242076). Editors judge the manuscript based on its potential to meet R2’s standards and see it as their and the reviewers’ task to help the authors achieve that potential. We acknowledge that many disciplines do not yet have clear standards on what constitutes a good replication, which is why we provide guidance in multiple ways.
1. We convened a team of researchers who have conducted numerous reproductions and replications as part of their research, in collaborations, and as student projects, who have published an open handbook on conducting reproductions and replications (R¨oseler, Wallrich, Hartmann, et al., 2025, forrt.org/replication guide). For robustness reproductions, we further recommend the protocol by Ankel-Peters et al. (2025)Ankel-Peters, J., Brodeur, A., Dreber, A., Johannesson, M., Neubauer, F., & Rose, J. (2025). A protocol for structured robustness reproductions and replicability assessments. Q Open, 5(3). https://doi.org/10.1093/qopen/qoaf004 and the Guide for Accelerating Computational Reproducibility in the Social Sciences (Berkeley Initiative for Transparency in the Social Sciences, 2020).
2. Based on multiple guides and our experience with the Framework for Open and Reproducible Research Training (FORRT) Replication Database (R¨oseler et al., 2024), we have created manuscript templates for reproduction and replication studies that authors can optionally use (R¨oseler, Hein, & Oppong Boakye, 2025; osf.io/brxtd).
3. Authors interested in replications from their field can use the FORRT Replication Database, with hundreds of replication studies, to search for examples from their field (forrt.org/apps/fred explorer).
Social Impact & Responsibility
We criticize the lack of rigor in the current academic system and argue that replication and reproduction rates are too low. Calls for scientific rigor or sound science have in the past been used to block policymakers from regulating industry (Baba et al., 2005Baba, A., Cook, D. M., McGarity, T. O., & Bero, L. A. (2005). Legislating “sound science”: The role of the tobacco industry. American Journal of Public Health, 95(S1), 20–27. https://doi.org/10.2105/AJPH.2004.050963). While we have created R2 to support repetitive research and motivate researchers to conduct high-quality reproduction and replication studies, we refute the call to disregard research findings that do not meet a high standard since ”demanding perfect evidence before action can be taken is often a way to avoid using evidence at all” (Center for Open Science, 2025, para. 9).
Conclusion
We invite researchers, students, and institutions to strengthen and revisit the foundations of scientific knowledge by submitting their replication and reproduction studies to R2. Together, we can reshape publishing practices and foster more robust and rigorous research. Looking ahead, we envision a research culture where confirmatory and critical work is valued alongside discovery; where transparency and reflexivity are routine across methods; and where communities (not markets or capital interests) set the standards of credibility.
Declarations
Author Contributions
✦LR, LW, FA: Writing - first draft
✦All authors: Writing - review and editing
Acknowledgments
R2 builds on community infrastructures such as the Framework for Open and Reproducible Research Training (FORRT), which provides openly licensed guides, templates, and the Replication Database that inform our author resources and educational track. We thank participants from the “Road to R2” online discussion sessions, contributors from the Replication Research Symposium,
members of the R2 Advisory Board, and contributors from our open community call.
Funding
This research was supported by the Landesinitiative openaccess.nrw (osf.io/a82fe) and the University of M¨unster Topical Program (osf.io/wqe7n). We gratefully acknowledge the financial support provided by both organizations.
Potential conflicts of interest
All members of the R2 editorial board are actively engaged in repetitive research in various professional capacities (e.g., conducting, publishing, or advocating for such work). As such, they have professional and intellectual interests in the visibility and uptake of related research, and several authors’ prior publications are cited in the reference list of this article. These relationships constitute non-financial competing interests that could be perceived as favoring the amplification of replication-related work. The authors declare no financial competing interests related to this editorial.
Declaration of AI use
Parts of the initial draft of the abstract had been AI generated from the text. Moreover, we used ChatGPT 5 to check for consistency of references, convert references from plain text to .bib format and to generate suggestions to improve the text.
Author Contact
Correspondence concerning this article should be addressed to: Lukas R¨oseler (lukas.roeseler@uni-muenster.de), Lukas Wallrich (l.wallrich@bbk.ac.uk), and Flavio Azevedo (f.azevedo@uu.nl).
- The incentive to prioritize eye-catching novelty over verifiable claims is itself a by-product of institutional selection pressures; we design against that selection. ↩
- In 2021, UNESCO’s Member States adopted a non-binding Recommendation on Open Science that recognizes science as a global public good and urges states to advance open, equitable science. This Recommendation draws on UDHR Art. 27(1) and the binding obligations in ICESCR Art. 15, but only for the States that have ratified the ICESCR (currently 173), not all 193 UN Member States (i.e., the United States, Saudi Arabia, United Arab Emirates, and Cuba, for example, did not ratify ICESCR). ↩
- If sharing certain materials is not feasible (e.g., due to ethical, privacy, or legal considerations), authors should clearly state the reasons and, where possible, describe how access requests or alternatives can be handled. Our editorial team is committed to supporting authors in addressing any challenges with data sharing. ↩
References
Ankel-Peters, J., Brodeur, A., Dreber, A., Johannesson, M., Neubauer, F., & Rose, J. (2025). A protocol for structured robustness reproductions and replicability assessments. Q Open, 5(3). https://doi.org/10.1093/qopen/qoaf004
Baba, A., Cook, D. M., McGarity, T. O., & Bero, L. A. (2005). Legislating “sound science”: The role of the tobacco industry. American Journal of Public Health, 95(S1), 20–27. https://doi.org/10.2105/AJPH.2004.050963
Beall, J. (2017). What I learned from predatory publishers. Biochemia medica, 27(2), 273–278. https://doi.org/10.11613/BM.2017.029
Berkeley Initiative for Transparency in the Social Sciences. (2020). Guide for accelerating computational reproducibility in the social sciences. Retrieved August 1, 2025, from https://bitss.github.io/ACRE
Brecht, B. (1974). Life of Galileo. Methuen Publishing.
Brembs, B. (2018). Prestigious science journals struggle to reach even average reliability. Frontiers in human neuroscience, 12, 327726. https://doi.org/10.3389/fnhum.2018.00037
Center for Open Science. (2025). COS statement on “restoring gold standard science” executive order. Center for Open Science. Retrieved October 8, 2025, from https://web.archive.org/web/20250818092037/https://www.cos.io/about/news/cos-statement-on-restoring-gold-standard-science-executive-order
Clarke, B., Lee, P. Y., Schiavone, S. R., Rhemtulla, M., & Vazire, S. (2023). The prevalence of direct replication articles in top-ranking psychology journals. https://doi.org/10.1037/amp0001385
Grossmann, A., & Brembs, B. (2021). Current market rates for scholarly publishing services. F1000Research, 10, 20. https://doi.org/10.12688/f1000research.27468.2
Grunow, M., Schneider, H., Wagner, G. G., & Wagner, J. (2018). Lack of reproducibility is seriously undermining the credibility of science as a whole [editorial]. International Journal for Re-Views in Empirical Economics, 2(2018-2), 1–6. https://doi.org/10.18718/81781.6
Haustein, S., Schares, E., Alperin, J. P., Hare, M., Butler, L. -A., & Schönfelder, N. (2024). Estimating global article processing charges paid to six publishers for open access between 2019 and 2023. https://arxiv.org/abs/2407.16551
Heyard, R., Pawel, S., Frese, J., Voelkl, B., Würbel, H., McCann, S., et al. (2025). A scoping review on metrics to quantify reproducibility: A multitude of questions leads to a multitude of metrics. Royal Society Open Science, 12(7), 242076. https://doi.org/10.1098/rsos.242076
Holcombe, A. O. (2019). Contributorship, not authorship: Use credit to indicate who did what. Publications, 7(3), 48. https://doi.org/10.3390/publications7030048
King, G. (1995). Replication, replication. PS: Political Science & Politics, 28(3), 444–452. https://doi.org/10.2307/420301
Makel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7(6), 537–542. https://doi.org/10.1177/1745691612460688
Munafò, M. R., Nosek, B. A., Bishop, D. V., Button, K. S., Chambers, C. D., Percie du Sert, N., & Ioannidis, J. P. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 0021. https://doi.org/10.1038/s41562-016-0021
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71
Perry, T., Morris, R., & Lea, R. (2022). A decade of replication study in education? a mapping review (2011--2020). Educational Research and Evaluation, 27(1--2), 12–34. https://doi.org/10.1080/13803611.2021.2022315
Pridemore, W. A., Makel, M. C., & Plucker, J. A. (2018). Replication in criminology and the social sciences. Annual Review of Criminology, 1, 19–38. https://doi.org/10.1146/annurev-criminol-032317-091849
Reed, W. R., Röseler, L., Saam, M., & Wallrich, L. (2025). No room at the inn? the case for specialized replication journals (tech. rep. No. 88). WiSo-HH Working Paper Series. https://www.econstor.eu/handle/10419/319083
Röseler, L., Hein, M., & Oppong Boakye, P. (2025). Standardized reproduction and replication templates (start). https://doi.org/10.17605/OSF.IO/BRXTD
Röseler, L., Moser, V., Schüller, S., & Förster, C. (2025). Replication research symposium: Book of abstracts. replication research symposium (R2S), Münster, Germany. https://doi.org/10.5281/zenodo.15487804
Röseler, L., Wallrich, L., Adler, S., Evans, T. R., Goltermann, J., Gut, U., Korbmacher, M., Oppong Boakye, P., Verheyen, S., Visser, I., & Azevedo, F. (2025). Replication research constitution (R2 launch). https://doi.org/10.5281/zenodo.17279413
Röseler, L., Wallrich, L., & Azevedo, F. (2025). Conditions under which R2 will be discontinued after a runtime of 26 months. https://doi.org/10.5281/zenodo.17206100
Röseler, L., Wallrich, L., Hartmann, H., Hüffmeier, J., Goltermann, J., Pennington, C. R., Boyce, V., Field, S. M., Pittelkow, M.-M., Silverstein, P., van Ravenzwaaij, D., & Azevedo, F. (2025). Handbook for reproduction and replication studies [*shared first authorship]. https://doi.org/10.5281/zenodo.16990114
Röseler, L., Kaiser, L., Doetsch, C., Klett, N., Seida, C., Schütz, A., Aczel, B., Adelina, N., Agostini, V., Alarie, S., et al. (2024). The replication database: Documenting the replicability of psychological science. Journal of Open Psychology Data, 12, 8. https://doi.org/10.5334/jopd.101
Sauvé, S. A., Middleton, S. L., Gellersen, H., & Azevedo, F. (2025). In pursuit of citational justice: A toolkit for equitable scholarship. https://doi.org/10.31222/osf.io/qjecy_v3
Schöch, C. (2023). Repetitive research: A conceptual space and terminology of replication, reproduction, revision, reanalysis, reinvestigation and reuse in digital humanities. International Journal of Digital Humanities, 5(2—3), 373–403. https://doi.org/10.1007/s42803-023-00073-y
UNESCO. (2021). UNESCO recommendation on open science (tech. rep.). https://doi.org/10.54677/MNMH8546