“What opportunities do legal deposit web archives offer to those advocating for openness, and what are the potential risks?”
“In March, 2019, the Open Research Funders Group (ORFG) issued an open call for participation in a survey to better understand funder perspectives with respect to supporting open infrastructure. Sixteen funders completed the questionnaire, evenly split between ORFG members and other funding organizations. The vast majority of respondents (four in five) have some form of open access position, nearly evenly split between policies and recommendations. Beyond open access, however, there is very little consensus on other open activities. Data sharing is the only other activity supported by more than half of the respondents (four data sharing policies and six data sharing recommendations). Publication of null results, protocol sharing, and code sharing are each in play at roughly a third of responding foundations.”
Abstract: The evidence-based policy movement promotes the use of empirical evidence to inform policy decision-making. While this movement has gained traction over the last two decades, several concerns about the credibility of empirical research have been identified in scientific disciplines that use research methods and practices that are commonplace in policy analysis. As a solution, we argue that policy analysis should adopt the transparent, open, and reproducible research practices espoused in related disciplines. We first discuss the importance of evidence-based policy in an era of increasing disagreement about facts, analysis, and expertise. We then review recent credibility crises of empirical research (difficulties reproducing results), their causes (questionable research practices such as publication biases and p-hacking), and their relevance to the credibility of evidence-based policy (trust in policy analysis). The remainder of the paper makes the case for “open” policy analysis and how to achieve it. We include examples of recent policy analyses that have incorporated open research practices such as transparent reporting, open data, and code sharing. We conclude with recommendations on how key stakeholders in evidence-based policy can make open policy analysis the norm and thus safeguard trust in using empirical evidence to inform important policy decisions.
“This post is co-authored by Fernando Hoces de la Guardia, BITSS postdoctoral scholar, along with Sean Grant (Associate Behavioral and Social Scientist at RAND) and CEGA Faculty Director Ted Miguel. It is cross-posted with the BITSS Blog.
The Royal Society’s motto, “Take nobody’s word for it,” reflects a key principle of scientific inquiry: as researchers, we aspire to discuss ideas in the open, to examine our analyses critically, to learn from our mistakes, and to constantly improve. This type of thinking shouldn’t guide only the creation of rigorous evidence?—?rather, it should extend to the work of policy analysts whose findings may affect very large numbers of people. At the end of the day, a commitment to scientific rigor in public policy analysis is the only durable response to potential attacks on credibility. We, the three authors of this blog?—?Fernando Hoces de la Guardia, Sean Grant, and Ted Miguel?—?recently published a working paper suggesting a parallel between the reproducibility crisis in social science and observed threats to the credibility of public policy analysis. Researchers and policy analysts both perform empirical analyses; have a large amount of undisclosed flexibility when collecting, analyzing, and reporting data; and may face strong incentives to obtaining “desired” results (for example, p-values of <0.05 in research, or large negative/positive effects in policy analysis)….”
“Will the revolution be open? This is an important question and the jury is out. In this webinar series we examine what it will take for the academic library community to develop the human, technical and financial resources that will be required to support an open future for global scholarship. The Elsevier purchase of Bepress was for many a wake-up call. It indicated that much of the infrastructure academic libraries rely on to manage and make content openly accessible was at risk of being monopolized by proprietary interests, just as scholarly journals have been. While the problem is clear — academic libraries need to control the infrastructure they depend on to make scholarly content open and discoverable and accessible. It seems clear that the level of support now provided is barely adequate at best, and that the academic library community faces a collective action problem that makes the necessary investments difficult. How to escape the current situation is not clear. In this webinar series the problem will be considered from both North American perspectives and those from outside of North America — in the hope of devising a way forward to create the infrastructure necessary to support a global open scholarly commons.
Join us on Thursday, May 17 at 12:00 ET for “The 2.5% Commitment: Investing in Open.” This webinar will focus on the David Lewis’ proposal for a 2.5% investment in open infrastructure and how it aims to make visible the investments academic libraries make in open infrastructure and content. It will also review actions that have taken place in the past nine months to advance these ideas. For background on the “Invest in Open Initiative” see the initiative website at: https://scholarlycommons.net and a recent College & Research Library News article describing the initiative at: https://crln.acrl.org/index.php/crlnews/article/view/16902.
Time May 17, 2018 12:00 PM in Eastern Time (US and Canada)”