Business PlanProjects -- COS develops and maintains infrastructure to support scientific practices, fosters open science communities of software developers and researchers, coordinates collaboration among stakeholders in the scientific process (journals, funders, IRBs, societies), conducts research on the scientific process (metascience), and creates incentives for replication and increasing reproducibility of scientific results.These projects promote open science, evaluate or improve reproducibility of scientific findings, and improve the alignment of scientific practices to scientific values. All projects are interdisciplinary or are models to replicate across disciplines.Center for Open ScienceCOS_f50a94vc-3f02-1e10-b991-79167a64bc2aCOS PersonnelPersonnel and Organizational StructureCOS DirectorInfrastructure architect, developing collaborations, promoting open science, communication, project leadership, fundingCOS Director of Business OperationsCOS Chief TechnologistLead of infrastructure team, lead developerCOS Infrastructure TeamProfessional software developers plus consultants and open source community contributors. Infrastructure development and maintenanceCOS Scientific Board.Senior leadership across scientific disciplines and interest groups - scientists, societies, journals. Advises center activities and facilitates connections and collaborations across the scientific community.COS Technology BoardSenior leadership in technology community, particularly open source, open practices, and start-up open science culture. Advises COS activities and facilitates connections and collaboration across infrastructure projects.COS Admin Team.Business managing, project coordination and support, conference organizing and support, administrative tasks for center and projectsCOS Project DirectorsAcademic researcher leads for metascience and replication projects. Postdoctoral researchers on staff and grantee academics with university positionsCOS ResearchersAcademic researchers contributing to metascience and replication projects. Faculty, postdocs, and graduate students at universities supported by COS grants, and post-undergrad staff research assistantsCOS FellowsAcademics, technologists, journalists, funders, society leadership. Short-term visits at Center for special projects.To increase the openness, integrity, and reproducibility of scientific researchTechnologyCOS is a technology start-up with a non-profit agenda. COS is dynamic, innovative,aspirational, high-energy, charitable, and service-oriented.Non-Profit AgendasDynamismAspirations High-Energy Charity Service-OrientationInclusivenessCOS is inclusive. COS serves the scientific community. COS staff are coordinatorsand contributors to the broader open science community.Coordination ContributionCollaborationCOS is collaborative. COS shares, reuses, and integrates. Products and projectsare open-source. COS seeks to link with other projects and infrastructure rather than reinvent them.Sharing Reuse IntegrationLinkageRespectCOS respects people. COS appreciates persons for their contributions, not their status.Hard WorkCOS is a work hard, love what you do atmosphere. Engagement is bolstered byinvesting in projects that can make a difference.EnjoymentEngagementInvestmentOpennessCOS aims to live up to the values it preaches - openness, strong communication,collaboration, dedication to mission and team, respect.CommunicationDedication TeamingScientific ValuesIncrease prevalence of scientific values - openness, reproducibility - in scientificpractice1Reproducibility ProjectExamine the rate and predictors of reproducibility in psychological science. 1.1Open Science Collaboration ProjectScienceNatureChronicle for Higher EducationReproducibility is a defining feature of science. However, because of strong incentives for innovation and weak incentives for verification, direct replication is rarely practiced or published. The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors ofreproducibility in psychological science. The results will provide the first empiricalestimate of reproducibility, and will identify predictors of reproducibility. The project’s inception and progress has been covered in Science, Nature, and the Chronicle for Higher Education. COS supports the administration of the project, provides targeted funds for replications, and will promote the project adaptation to other sciences Replication Value[Create a] statistic to guide resource allocation for replication efforts.1.2Daniel LakensOpen Science Collaboration project; Daniel Lakens, CoordinatorPresent publishing incentives value innovation almost exclusively at the expense of verification. Increasing incentives for verification will make replication more common. However, it is not feasible or desirable to replicate all research. Replication Value (RV) will be a statistic to guide resource allocation for replication efforts. It identifies which findings are having substantial impact, but are not yet estimated precisely. An effective statistic will guide researchers and journals in the selection and evaluation of replication projects. Metascience GrantsProvide small grants to scientific research about science.1.3Starter grants for metascience research. COS will provide small grants toscientific research about science. These include, for example, archival studies about publication practices, testing interventions to increase the reproducibility of research results, evaluating novel publishing or peer review practices, investigating the effects of pre-registration, and comparative evaluation of open versus closed scientific practices for knowledge building.Research MaterialsDevelop and maintain infrastructure for documentation, archiving, sharing, andregistering research materials2Archival ProjectInvestigate publishing practices, frequency of replication, effect sizes and power, and other issues related to reproducibility and confidence in research findings.2.1Roger Giner-SorollaOpen Science Collaboration project; Roger Giner-Sorolla, CoordinatorPsi ChiPsi BetaAn investigation of present publishing practices, frequency of replication, effect sizes and power, and other issues related to reproducibility and confidence in research findings. Two national psychology honor societies - Psi Chi and Psi Beta - have signed on to make this a national project for their chapters and members. The massively crowdsourced research design will enable coding of a substantial sample of journals and articles and produce a dataset useful for manyinvestigations of current publishing practices to inform efforts for innovation andimprovement. Scientific WorkflowJoin infrastructures to support the entire scientific workflow in a common framework3Open Science Framework (OSF)Support open science objectives across disciplines.3.1ResearchersResearch FundersJournalsIRBsOSF is the central infrastructure for the COS to support open science objectives across disciplines. Researchers use OSF to collaborate, document, archive, share, and register research projects, materials, and data. OSF respects and supports the scientist’s workflow. OSF will connect solutions for improving scientific practices and provide incentives for researchers to use the system and practice openly. Funders, journals, and IRBs will encourage or require researchers to use OSF to meet open science or reproducibility objectives.APIsConnect infrastructure with APIs so that researchers can access many services through a single framework.3.2APIs connecting open science infrastructure. There are many groups developinginfrastructure to facilitate open science. Rather than pursue redundant, competitivedevelopment, COS will aim for collaborative relationships and integration. OSF willconnect infrastructure with APIs so that researchers can access many services through a single framework. Researchers will benefit with choice and services in a single workflow, infrastructure developers will benefit by focusing their development and support on their core competencies rather than needing to reinvent the operational tools around it.GrantsProvide small grants to groups creating new infrastructure to support open science practices.3.3Starter grants for infrastructure development. COS will provide small grants togroups creating new infrastructure to support open science practices. Grants from COS will be limited to open solutions - open-source, creative commons licensing - rather than supporting commercial ventures.CommunityFoster an interdisciplinary community open science developers, scientists, andorganizations4Open Science Developers Open Science Scientists Open Science OrganizationsOpen Developer CommunityEstablish an open developer community.4.1Open DevelopersOpen science developer community. Many infrastructure projects in developmentoutside the COS will increase openness in science. Establishing an open developer community will enhance collaboration and interactivity among these siloed efforts. This is particularly important for establishing an interdisciplinary open science infrastructure that accounts for the entire researcher workflow. COS hosts conferences, supports short-term personnel exchanges between groups, provides administrative resources, and facilitates integrating functionality across projects.Open Science Community[Support an] open science researcher community4.2Open Science ResearchersOpen science researcher community. In parallel with a developer community,the early adopter community of open science researchers is critical for a successfulrevolution. An active open science community is essential for testing and improvinginfrastructure and practices. Already, there are more than 400 members of the OpenScience Collaboration discussion group. COS supports conferences, development ofbest practice standards), and administrative coordination for the community.Open Science PracticesPromote open science practices.4.3JournalsResearch Funders Researchers Rearch SocietiesPromoting open science practices with journals, funders, researchers, andsocieties. Open science practices will accelerate dramatically if stakeholders withlevers for change create incentives or requirements for researchers. COS will promote open science practices with journals, funders, researchers, and societies. COS will support and conduct model cases as existence proofs that open science practices can work. COS will also host conferences for stakeholder groups for developing strategies, adopting best practices, and establishing a collaborative network for promoting change.IncentivesAdjust incentives to make “getting it right” more competitive with “getting itpublished”5Replication GrantsProvide grants for replications of important research results that have a high replication value.5.1Brian NosekDaniel LakensIncentives and grants for Replicating Important Results. COS will provide grantsfor replications of important research results that have a high replication value - many citations or strong influence on research or practice, but few replications or imprecise estimation of effects. Further, COS will promote the development of incentives for conducting and publishing replications, such as supporting journals adopting new practices for publishing replications and promoting registration of research designs. A model example will be a special issue of the journal Social Psychology edited by Brian Nosek and Daniel Lakens.Discoverability & AccessibilityMake all academic research discoverable and accessible62013-01-312013-07-31https://docs.google.com/document/d/1HWJxPkyuMo49uzhEsvK5HxhyrSFR3Ys625NqHY3zmsk/edit?pli=1OwenAmburOwen.Ambur@verizon.net