Dramatic Growth of Open Access June 30, 2016

Highlights this quarter include a new indicator illustrating that 42% of the cancer literature indexed by PubMed is available as free full-text within 3 years of publication; ongoing strong growth in open access archives and their content; milestone of over 10 million free texts for Internet Archive; a mix of negative growth reflecting clean-up at DOAJ and growth in articles searchable at the article level; over 50% annual growth at the Directory of Open Access Books; and concern noted about the apparent ongoing growth of Elsevier and what this might mean for open access.


New indicator : a search of the PubMed index for “cancer” for all articles and with limits by date of publication demonstrates that 42% of the cancer literature indexed in PubMed published in the last 3 years is available as free fulltext.  17% is available as free fulltext within 30 days of publication, 31% within one year of publication. With no date limits the overall percentage is 26% of the 3.3 million articles on cancer indexed by Pubmed.


Results of PubMed search for “cancer”
with limits by date of publication and free fulltext
  # of articles free fulltext % free fulltext
30 days 19,050 3,206 17%
60 days 32,562 6,540 20%
90 days 46,057 10,382 23%
180 days 85,913 23,421 27%
last 1 year 162,335 50,499 31%
last 2 years 323,252 126,867 39%
last 3 years 475,973 198,505 42%
no date limit 3,318,957 861,168 26%

Kudos to Internet Archive for exceeding 10 million free texts!

Ongoing strong open access archives growth is illustrated by OpenDOAR adding close to 200 repositories over the past year, a 7% growth rate and a total of over 3,000 repositories. The Registry of Open Access Repositories added 269 repositories over the past year, also a 7% annual growth rate for a total of over 4,000 repositories. The Bielefeld Academic Search Engine is now searching over 93 million documents from over 4,000 repositories. With growth of over 18 million documents over the past year (24% annual growth rate), it won’t be long before BASE passes the 100 million milestone. arXiv grew by over 10% over the past year, adding over 100,000 documents for a total of 1.6 million.

The Directory of Open Access Books grew by over 50% in the past year for a total of close to 5,000 books from more than 150 publishers. 

In spite of overall negative growth reflecting a major “get-tough” clean-up project, the Directory of Open Access Journals‘ number of articles searchable at the article level which grew by 16% over the past year, over 300,000 more articles for a total of over 2.1 million articles. On May 9, DOAJ removed over 3,000 journals that had not filled out the new application form. Since that date, DOAJ has added 234 titles for a DOAJ growth rate of 4.5 journals per day. Watch for continuing strong growth in the next few quarters as DOAJ has hired a team of international ambassadors. 

The ongoing dramatic growth of Elsevier 

The Social Sciences Research Network (SSRN) is still included in the downloadable data.  I would like to note concern about its current and future open access status and commitment, particularly since it was recently bought by Elsevier, features the ad for “free subscriptions to more than 500 partner-sponsored abstracting e-journals [emphasis added]”, (copied below for purposes of academic critique – please contact SSRN for other uses), the SSRN website indicates partnerships with providers of pay-per-view, and the message from chairman Michael Jensen on the Elsevier sale indicates that part of what is behind this is Elsevier’s desire to expand into social sciences.

In addition to the SSRN buyout, as noted on my research blog Sustaining the Knowledge Commons, Elsevier is now the world’s largest open access publisher as measured by number of fully open access journals.

Open access may resolve the access problem, however OA per se does not address the increasing commercialization of scholarly journal publishing and increasing market concentration that has been happening since the end of the second world war. The growing presence of large traditional commercial scholarly publishers in open access is something to watch, in particular because ongoing open access is likely not compatible with maximal profit-making.

As usual the full data is available for download from the DGOA Dataverse:  http://dataverse.scholarsportal.info/dvn/dv/dgoa

This post is part of the Dramatic Growth of Open Access series.

DuraSpace | Open technologies for durable digital content

“The Sheridan Libraries at Johns Hopkins University were awarded an Institute of Museum and Library Services (IMLS) National Leadership Grant for Libraries earlier this year. The aim of the funding is to to assist work on the API Extensions framework for Fedora 4 platform that will facilitate the exposure of repository contents as linked data web resources.”

Will Libraries become stewards of our Open Data Collections | Chris Moore | Pulse | LinkedIn

“What I have been thinking about lately is the role of our Public Libraries as stewards of Open Data.  As long as I can remember the Library and our Librarians are the stewards of information, those that guide us on our quests for knowledge.  What if our libraries had a person who had a responsibility for the communities Open Data collection.  This elevates data beyond just something a government “chooses” to release to a set of important current and historic information that needs to be curated.”

Virginia Tech researchers earn grant to study big data sharing and reuse | News | Virginia Tech

“Sharing, use, and reuse of data in a holistic manner across faculty, colleges, government, and industry is crucial for the community at large to be able to make sense of what is being gathered and to make good use of it as well,”

Barbara Fister, Babel Fish Bouillabaisse

An OA book on OA and other topics, by Barbara Fister. 

“As part of a sabbatical project, I have collected some things I’ve written into a lightly-edited, open access, Creative Commons-licensed volume. Some of this material comes from my personal blog, where I’ve been posting thoughts about [open access], books, publishing, and how online reading communities function (the actual subject of my sabbatical research). Much of this bouillabaisse comes  my writings at Inside Higher Ed, which is a born-digital news organization that combines sharp education journalism with a slate of bloggers, columnists, and guest commentaries….”

Hillary Clinton’s Initiative on Technology & Innovation

“Hillary believes that the government has an obligation to protect the open internet….She will also promote open-licensing arrangements for copyrighted material and data supported by federal grant funding, including in education, science, and other fields. She will seek to develop technological infrastructure to supports digitization, search, and repositories of such content, to facilitate its discoverability and use….Hillary will make it easier for the federal government to find, try, and buy innovative technology—including open source software….Open up More Government Data for Public Uses: The Obama Administration broke new ground in making open and machine-readable the default for new government information, launching Data.gov and charging each agency with maintaining data as a valuable asset. With more accessible datasets, entrepreneurs can create new products and services, citizens can evaluate more effectively how the government does it job, researchers can look for new insights – and government can work better. Hillary will continue and accelerate the Administration’s open data initiatives, including in areas such as health care, education, and criminal justice. She would fully implement the DATA Act to make government spending more transparent and accountable to the American people, improving USASpending.gov so that Americans can more accurately see how and where their taxpayer dollars are spent. She would also bring an open data approach to regulation—making it easier for businesses to submit structured data instead of documents, and bringing greater transparency to financial and other markets so that regulators, watchdog groups, and the American people can more easily identify fraud and illegal behavior….”

Statement by Christophe Rossel, President of the EPS, after UK’s decision to leave the EU – European Physical Society (EPS)

“At a time when the EU Commission wants to develop and implement open science policy to improve the quality and impact of European science, in particular by better interconnecting research infrastructures, it would be unfortunate to see such efforts refrained by political decisions….”