Table 1 TOP Factor Rubric (https://osf.io/t2yu5/)
Standard | Level 1 | Level 2 | Level 3 |
|---|---|---|---|
Data citation | Journal describes citation of data in guidelines to authors with clear rules and examples. | Article requires appropriate citation for data used consistent with the journal’s author guidelines. | Article is not published until providing appropriate citation for data following journal’s author guidelines. |
Data transparency | Articles must state whether or not data are available. | Articles must have publicly available data, or explain why ethical/legal constraints prevent it. | Articles must have publicly available data and must be used to computationally reproduce or confirm results prior to publication. |
Analytical code transparency | Articles must state whether or not code is available. | Articles must have publicly available code, or explain why ethical/legal constraints prevent it. | Articles must have publicly available code and must be used to computationally reproduce or confirm results prior to publication. |
Materials transparency | Articles must state whether or not materials are available. | Articles must have publicly available materials, or explain why ethical/legal constraints prevent it. | Articles must have publicly available materials and must be used to computationally reproduce or confirm results prior to publication. |
Reporting guidelines | Journal articulates design transparency standards. | Journal requires adherence to design transparency standards for review and publication. | Journal requires and enforces adherence to design transparency standards for review and publication. |
Study preregistration | Articles will state if work was preregistered. | Article states whether work was preregistered and, if so, journal verifies adherence to preregistered plan. | Journal requires that confirmatory or inferential research must be preregistered. |
Analysis plan preregistration | Articles will state if work was preregistered with an analysis plan. | Article states whether work was preregistered with an analysis plan and, if so, journal verifies adherence to preregistered plan. | Journal requires that confirmatory or inferential research must be preregistered with an analysis plan. |
Replication | Journal encourages submission of replication studies. | Journal will review replication studies blinded to results. | Registered Reports for replications as a regular submission option. |
Publication bias | Journal states that significance or novelty are not criteria for publication decisions. | Journal will review (novel) studies blinded to results. | Journal accepts Registered Reports for novel studies as a regular submission option. |
Open science badges | Journal awards 1 or 2 open science badges | Journal awards all 3 open science badges |