Published in Science in 2015 (OA), the Transparency and Openness Promotion Guidelines (PDF and HTML) include eight modular standards, each with three levels of increasing stringency. Journals select which of the eight transparency standards they wish to implement and select a level of implementation for each. These features provide flexibility for adoption depending on disciplinary variation, but simultaneously establish community standards.
Standards: Data Citation | Data, Materials, and Code Transparency | Design and Analysis | Preregistration | Replication
Levels: Disclose, Require, or Verify
Journal policies can be evaluated based on the degree to which they comply with the TOP Guidelines. This TOP Factor is a metric that reports the steps that a journal is taking to implement open science practices, practices that are based on the core principles of the scientific community. It is an alternative way to assess journal qualities, and is an improvement over traditional metrics that measure mean citation rates. The TOP Factor is transparent (see underlying data and the evaluation rubric) and will be responsive to community feedback.
Read more about TOP Factor here.
For inquiries, please contact David Mellor or email top@cos.io.
Not Implemented | Level I | Level II | Level III | |
---|---|---|---|---|
Citation Standards | No mention of data citation. | Journal describes citation of data in guidelines to authors with clear rules and examples. | Article provides appropriate citation for data and materials used consistent with journal's author guidelines. | Article is not published until providing appropriate citation for data and materials following journal's author guidelines. |
Data Transparency | Journal encourages data sharing, or says nothing. | Article states whether data are available, and, if so, where to access them. | Data must be posted to a trusted repository. Exceptions must be identified at article submission. | Data must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication. |
Analytic Methods (Code) Transparency | Journal encourages code sharing, or says nothing. | Article states whether code is available, and, if so, where to access it. | Code must be posted to a trusted repository. Exceptions must be identified at article submission. | Code must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication. |
Research Materials Transparency | Journal encourages materials sharing, or says nothing. | Article states whether materials are available, and, if so, where to access them. | Materials must be posted to a trusted repository. Exceptions must be identified at article submission. | Materials must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication. |
Design and Analysis Transparency | Journal encourages design and analysis transparency, or says nothing. | Journal articulates design transparency standards. | Journal requires adherence to design transparency standards for review and publication. | Journal requires and enforces adherence to design transparency standards for review and publication. |
Study Preregistration | Journal says nothing. | Article states whether preregistration of study exists, and, if so, where to access it. | Article states whether preregistration of study exists, and, if so, allows journal access during peer review for verification. | Journal requires preregistration of studies and provides link and badge in article to meeting requirements. |
Analysis Plan Preregistration | Journal says nothing. | Article states whether preregistration of study exists, and, if so, where to access it. | Article states whether preregistration with analysis plan exists, and, if so, allows journal access during peer review for verification. | Journal requires preregistration of studies with analysis plans and provides link and badge in article to meeting requirements. |
Replication | Journal discourages submission of replication studies, or says nothing. | Journal encourages submission of replication studies. | Journal encourages submission of replication studies and conducts results blind review. | Journal uses Registered Reports as a submission option for replication studies with peer review prior to observing the study outcomes. |
Read the complete TOP Guidelines PDF or wiki
Download the summary table for journals or funders.
For inquiries, please contact David Mellor or email top@cos.io.
We know of over 1,100 journals or organizations that have implemented one or more TOP-compliant policy as of June 2019 (see osf.io/2sk9f/). We are working on tools to make this information more discoverable. In the meantime, please see examples of such policies below or contact us for more information.
Funders are also implementing open science policies around preregistration and Registered Reports, open data and materials, and preprints or open access.
With over 5,000 signatories, the TOP Guidelines are a widely used tool for implementing open science practices.
Journal signatories are expressing their support of the principles of openness, transparency, and reproducibility, expressing interest in the guidelines and commit to conducting a review within a year of the standards and levels of adoption.
Organization signatories are expressing their support of the principles of openness, transparency, and reproducibility and encouraging associated journals to conduct a review of the standards and levels of adoption.
For inquiries, please contact David Mellor or email top@cos.io.
The TOP Guidelines are a community-driven and evolving effort, changing to meet the needs of the community while pursuing the most transparent practices. The TOP Coordinating Committee is charged with the ongoing maintenance and outreach for the Guidelines. The TOP Coordinating Committee encourages adoption and implementation of the Guidelines through education, communication, and outreach. The Committee will evaluate adoption and effectiveness of the Guidelines and use this information, along with feedback from the stakeholder community, to improve them.
University of Ottawa
Center for Open Science
210 Ridge McIntire Road
Suite 500
Charlottesville, VA 22903-5083
Email: contact@cos.io
Current positions are here.
COS has consistently earned a Guidestar rating of Platinum for its financial transparency, the highest rating available. You can see our profile on Guidestar here.
We invite all of our sponsors, partners, and members of the community to learn more about how
our organization operates, our
impact, our financial performance,
and our nonprofit status.
Unless otherwise noted, this site is licensed under a Creative Commons Attribution 4.0 International License.
All images and logos are licensed under Creative Commons Attribution-NoDerivatives 4.0 International License.
Terms of Use | Privacy Policy