Registered report is a relatively new article type that involves a 2-stage submission process:
- Stage 1, pre-data collection, initial manuscript submission and review
- Stage 2, after study completion, full manuscript is submitted for re-review
The main benefits of this two-stage approach are as follows:
- Once the methods and proposed analyses are provisionally accepted in Stage 1, the journal will commit to publishing the results regardless of the outcome, provided the final study conforms to the initially approved proposal and meets all quality checks. This means that publication bias is reduced as negative results will not prevent publication.
- Peer review of the research proposal provides an opportunity for the authors to receive constructive critical feedback that may help them to fine-tune the study design prior to conducting the experiment.
- This process can help reduce researcher bias.
- This process may enhance the credibility of the work.
Stage 0: Initial Proposal
Authors are strongly encouraged to submit an initial proposal prior to submitting their stage 1 registered report. This proposal will be shared with the senior editors for registered reports for initial assessment. While optional, this extra step is beneficial for authors because it helps ensure the planned study is appropriate for the registered report format and that reviewers are available to expedite the peer review process upon submission of the Stage 1 manuscript.
The initial proposal should contain:
- A brief description of the planned study – background, research question, basic proposed methodology (1 paragraph).
- A justification for why a Registered Report (RR) is preferred over traditional submission types for the proposed study (1-3 sentences). Authors are encouraged to refer to the likely replication value of the research. High-value replication studies are welcomed in addition to novel studies.
- Sufficient detail to evaluate whether the proposed study is likely to be of high quality and appropriate for the RR format. Authors may want to consult the Stage 1 Development Checklist and upload a copy of the completed design planner as part of their initial proposal.
- Additional details, including a full list of potential authors, the estimated date when the stage 1 manuscript will be ready to be submitted, and the target date that data collections is expected to begin.
After receipt of the Stage 0 proposal, the senior editor writes back to invite the author to submit a Stage 1 manuscript, or to recommend the traditional publication route. Decision-making is based on whether the authors make a good case for the study to be conducted as a RR and whether the proposed manuscript is a good fit with the mission and scope of the journal. No commitments are made at this stage.
Stage 1: Initial Manuscript Submission and Review
At stage 1, the author submits
- Cover letter
- Introduction
- Preliminary data/studies
- Methods
- Disclosures
The Stage 1 cover letter should include the following:
- A brief scientific case for consideration. Authors are encouraged to refer to the likely replication value of the research. Replication studies are welcome in addition to novel studies.
- An anticipated timeline for completing the study if the initial submission is accepted.
During Stage 1 submission, authors will be asked to affirm the following:
- All necessary support (e.g. funding, facilities) and approvals (e.g. ethics) are in place for the proposed research. Note that manuscripts will be generally considered only for studies that are able to commence immediately; however, authors with alternative plans are encouraged to contact the journal office for advice.
- The authors agree to share their raw data, any digital study materials, and analysis code as appropriate.
- Following Stage 1 in principle acceptance, the authors agree to register their approved protocol on the Open Science Framework (https://osf.io/) or other recognized repository, either publicly or under private embargo until submission of the Stage 2 manuscript.
- If the authors later withdraw their paper, they agree to the Journal of Speech, Language, and Hearing Research publishing a short summary of the pre-registered study under a section “Withdrawn Registrations.”
Following initial screening, the Stage 1 submission will be sent for in-depth peer review. In considering papers at the registration stage, reviewers will be asked to assess:
- The importance of the research question(s).
- The logic, rationale, and plausibility of the proposed hypotheses.
- The soundness and feasibility of the methodology and analysis pipeline (including statistical power analysis where appropriate).
- Whether the clarity and degree of methodological detail is sufficient to exactly replicate the proposed experimental procedures and analysis pipeline.
- Whether the authors have pre-specified sufficient outcome-neutral tests for ensuring that the results obtained can test the stated hypotheses, including positive controls and quality checks.
To see the full instructions provided to reviewers, please see the Registered Reports Guide for Reviewers (PDF).
After Stage 1 peer review, manuscripts may be offered in principle acceptance (IPA). Following IPA, the authors will then proceed to conduct the study, adhering exactly to the peer-reviewed procedures. Once the study is complete, authors prepare and resubmit their manuscript for re-review (Stage 2). The review process is illustrated in the flow chart below.
Authors are reminded that any deviation from the stated experimental procedures, regardless of how minor it may seem to the authors, could lead to rejection of the manuscript at Stage 2. In cases where the pre-registered protocol is altered after IPA due to unforeseen circumstances (e.g. change of equipment or unanticipated technical error), the authors must consult the editorial board immediately for advice, and prior to the completion of data collection.
Stage 2: Full Manuscript Review
In stage 2, the author submits the completed manuscript, including results and discussion, which is then sent for an expedited peer review. Please note that no substantive changes can be made to the introduction and methods submitted in Stage 1. Pending quality checks, the journal will commit to publishing the results.
The resubmission will most likely be considered by the same reviewers as in Stage 1, but could also be assessed by new reviewers. In considering papers at Stage 2, reviewers will be asked to decide:
- Whether the data are able to test the authors’ proposed hypotheses by satisfying the approved outcome-neutral conditions (such as quality checks, positive controls)
- Whether the Introduction, rationale and stated hypotheses are the same as the approved Stage 1 submission (required)
- Whether the authors adhered precisely to the registered experimental procedures
- Whether any unregistered post hoc analyses added by the authors are justified, methodologically sound, and informative
- Whether the authors’ conclusions are justified given the data
Reviewers are informed that editorial decisions will not be based on the perceived importance, novelty or conclusiveness of the results. Thus, while reviewers are free to enter such comments on the record, they will not influence editorial decisions. Reviewers at Stage 2 may suggest that authors report additional post hoc tests on their data; however, authors are not obliged to do so unless such tests are necessary to satisfy one or more of the Stage 2 review criteria. To see the full instructions provided to reviewers, please see the Registered Reports Guide for Reviewers (PDF).
Once accepted at this stage, the full manuscript is published.
More details about Registered Reports is available from the Center for Open Science at https://www.cos.io/initiatives/registered-reports
The Review Process for Registered Reports
Additional Questions?
Find answers to questions about registered reports in the
ASHA Journals Academy Knowledge Base.
