“The reproducibility problem in science is a familiar issue, not only within the scientific community, but with the general public as well. Recent developments in social psychology (such as fraudulent research by D. Stapel) and cell biology (the Amgen Inc. and Bayer AG reports on how rarely they could reproduce published results) have become widely known. Nearly every field is affected, from clinical trials and neuroimaging, to economics and computer science. Obvious solutions include more research on statistical and behavioral fixes for irreproducibility, activism for policy changes, and demanding more pre-registration and data sharing from grantees. Two Perspectives in this issue (pp. 1420and 1422) describe how journals and academic institutions can foster a culture of reproducibility. Transparency is central to improving reproducibility, but it is expensive and time-consuming. What can be done to alleviate those obstacles? Most scientists aspire to greater transparency, but if being transparent taps into scarce grant money and requires extra work, it is unlikely that scientists will be able to live up to their own cherished values. Thus, one of the most effective ways to promote high-quality science is to create free open-source tools that give scientists easier and cheaper ways to incorporate transparency into their daily workflow: from open lab notebooks, to software that tracks every version of a data set, to dynamic document generation. Moreover, scientists who use open-source software are not locked into proprietary software platforms with unclear monetization plans. If philanthropy or government funds new tools that the open-source community can iterate and improve on, the per-dollar return on investment can far exceed the costs. Infrastructural tools are now available, or in development, that should help to catalyze a change in scientific transparency. One example is the Open Science Framework (OSF), a free and open-source software platform for managing scientific workflow (supported by the Laura and John Arnold Foundation in partnership with the Center for Open Science). Among its many features, this platform can enable scientists to easily track the history of all versions of every document or data set and the exact contributions made by each team member. All project materials can be given persistent identifiers, and the tracking of provenance allows any subsequent research project to give proper credit to the original. Projects using this platform include the Shared Access Research Ecosystem project of the Association of Research Libraries and its partners …”
A slide presentation by Simon Inger from May 2015.