Guidelines for Transparency and Openness Promotion (TOP) in Journal Policies and Practices TOP Guidelines Committee TOPGC _c307532e-3e43-11e5-be54-6f775c6a2109 Center for Open Science _c30754be-3e43-11e5-be54-6f775c6a2109 To enhance the transparency in the science that journals publish. _c3075586-3e43-11e5-be54-6f775c6a2109 Citation Standards Make citation of articles routine and well-formulated. _c3075608-3e43-11e5-be54-6f775c6a2109 1 _c307568a-3e43-11e5-be54-6f775c6a2109 Citations 4-Level Rating Scale Level 0 -- Journal encourages citation of data, code, and materials, or says nothing. 0 Level 1 -- Journal describes citation of data in guidelines to authors with clear rules and examples. 1 Level 2 -- Article provides appropriate citation for data and materials used consistent with journal's author guidelines. 2 Level 3 -- Article is not published until providing appropriate citation for data and materials following journal's author guidelines. 3 TBD Data Transparency Share research data. _c3075716-3e43-11e5-be54-6f775c6a2109 2 _c3075798-3e43-11e5-be54-6f775c6a2109 Data Sharing 4-Level Rating Scale Level 0 -- Journal encourages data sharing, or says nothing. 0 Level 1 -- Article states whether data are available, and, if so, where to access them. 1 Level 2 -- Data must be posted to a trusted repository. Exceptions must be identified at article submission. 2 Level 3 -- Data must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication. 3 TBD Analytic Methods Transparency Share analytic code. _c307581a-3e43-11e5-be54-6f775c6a2109 3 _c307589c-3e43-11e5-be54-6f775c6a2109 Code Sharing 4-Level Rating Scale Level 0 -- Journal encourages code sharing, or says nothing. 0 Level 1 -- Article states whether code is available, and, if so, where to access them. 1 Level 2 -- Code must be posted to a trusted repository. Exceptions must be identified at article submission. 2 Level 3 -- Code must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication. 3 TBD Research Materials Transparency Share research materials. _c307591e-3e43-11e5-be54-6f775c6a2109 4 _c30759a0-3e43-11e5-be54-6f775c6a2109 Material Sharing 4-Level Rating Scale Level 0 -- Journal encourages materials sharing, or says nothing. 0 Level 1 -- Article states whether materials are available, and, if so, where to access them. 1 Level 2 -- Materials must be posted to a trusted repository. Exceptions must be identified at article submission. 2 Level 3 -- Materials must be posted to a trusted repository, and reported analyses will be reproduced independently prior to publication. 3 TBD Design and Analysis Transparency Maximize transparency about the research process and minimize potential for vague and incomplete reporting of the methodology . _c3075a2c-3e43-11e5-be54-6f775c6a2109 5 _c3075ab8-3e43-11e5-be54-6f775c6a2109 Transparency 4-Level Rating Scale Level 0 -- Journal encourages design and analysis transparency, or says nothing. 0 Level 1 -- Journal articulates design transparency standards. 1 Level 2 -- Journal requires adherence to design transparency standards for review and publication. 2 Level 3 -- Journal requires and enforces adherence to design transparency standards for review and publication. 3 TBD Preregistration of Studies Preregister studies to make research more discoverable even if it does not get published. _c3075b44-3e43-11e5-be54-6f775c6a2109 6 _c3075bda-3e43-11e5-be54-6f775c6a2109 Level 0 -- Journal says nothing. 0 Level 1 -- Journal encourages preregistration of studies and provides link in article to preregistration if it exists. 1 Level 2 -- Journal encourages preregistration of studies and provides link in article and certification of meeting preregistration badge requirements. 2 Level 3 -- Journal requires preregistration of studies and provides link and badge in article to meeting requirements. 3 TBD Preregistration of Analysis Plans Certify the distinction between confirmatory and exploratory research. _c3075c70-3e43-11e5-be54-6f775c6a2109 7 _c3075d06-3e43-11e5-be54-6f775c6a2109 Preregistration 4-Level Rating Scale Level 0 -- Journal says nothing. 0 Level 1 -- Journal encourages preanalysis plans and provides link in article to registered analysis plan if it exists. 1 Level 2 -- Journal encourages preanalysis plans and provides link in article and certification of meeting registered analysis plan badge requirements. 2 Level 3 -- Journal requires preregistration of studies with analysis plans and provides link and badge in article to meeting requirements. 3 TBD Replication Address journal guidelines for independent replication of research by authors. _c3075d9c-3e43-11e5-be54-6f775c6a2109 8 Authors of Scientific Research _c3075e28-3e43-11e5-be54-6f775c6a2109 Replicability 4-Level Rating Scale Level 0 -- Journal discourages submission of replication studies, or says nothing. 0 Level 1 -- Journal encourages submission of replication studies. 1 Level 2 -- Journal encourages submission of replication studies and conducts results blind review. 2 Level 3 -- Journal uses Registered Reports as a submission option for replication studies with peer review prior to observing the study outcomes. TBD 2015-08-09-04:00 https://docs.google.com/document/d/1Q_oLswxyKg-dQVkm7prgF0qryv3d1WroATRWvTqxHnE/edit?pli=1 Owen Ambur Owen.Ambur@verizon.net