By Harinder Singh Director, Division of Immunobiology and the Center for Systems Immunology Cincinnati Children’s Hospital Medical Center This perspective is a result of the various insightful commentaries that have been posted on the ASAPbio site in the context of the HHMI/Wellcome/ASAPbio meeting on “Transparency, Recognition and Innovation in Peer Review in the Life Sciences.” […]
Editor’s Note: This press release also appears on the Cold Spring Harbor Laboratory Newsstand.
Public Library of Science (PLOS) and Cold Spring Harbor Laboratory (CSHL) announce an agreement that enables the automatic posting of research articles submitted to PLOS journals on bioRxiv, CSHL’s preprint server for the life sciences. This collaboration between bioRxiv and PLOS empowers authors to share their work on a trusted platform before peer review, accelerating the pace of biomedical research.
By Bernd Pulverer, EMBO As preprint posting takes hold in the biosciences community, we need both quality control and curation to ensure we share results in a reproducible and discoverable manner.
The 2018 European Meeting of the International Society for Medical Publication Professionals (ISMPP) was held in London on 23–24 January and attracted nearly 300 delegates; the highest number of attendees to date. The meeting’s theme was ‘Advancing Medical Publications in a Complex Evidence Ecosystem’ and the agenda centred around data transparency, patient centricity and the future of medical publishing. Delegates were treated to two keynote addresses, lively panel discussions, interactive roundtables and parallel sessions, and also had the chance to present their own research in a poster session. Continue reading “Meeting report: summary of day 1 of the 2018 European ISMPP Meeting”
By Samantha Hindle and Daniela Saderi, PREreview The image above (DOI) is CC-BY 4.0 licensed and is available for download on Figshare.
Preprints are freely available scientific manuscripts that have not yet undergone editorial peer review. They provide data and knowledge that is current, accessible by all, and at a stage where community peer review can contribute to scientific progression. Rather than restricting feedback to two or three journal-selected reviewers, preprints can be read and evaluated by a diverse population of interested scientists at different career stages. Theoretically, the advantages of opening up scientific evaluation to a larger pool of scientists should be straightforward: the more reviewers, the fewer mistakes – or to quote Linus’ Law, “Given enough eyeballs, all bugs are shallow.” Practically speaking, this can be more complicated as scientists have limited free time, are not well-incentivized for their reviewing activities, and some may argue that “too many cooks spoil the broth.”
By Rebecca Lawrence & Vitek Tracz, F1000, email@example.com We have been successfully running a service (which we call platforms, to distinguish from traditional research journals), for over 5 years at F1000 that is essentially a preprint coupled with formal, invited (i.e. not crowd-sourced) post publication peer review. We have consequently amassed significant experience of running […]
In November 2016 Wellcome became the first research funder to launch a publishing platform for the exclusive use of its grantholders. Wellcome Open Research, run on behalf of Wellcome by F1000, uses a model of immediate publication followed by invited, post-publication peer review. All reviews are citable and posted to the platform along with the identities of the reviewers. Continue reading “Peer review as practised at Wellcome Open Research”
By Michael B. Eisen Investigator, Howard Hughes Medical Institute Professor of Molecular and Cell Biology, UC Berkeley firstname.lastname@example.org, @mbeisen With the rapid growth of bioRxiv, biomedical research is entering a new era in which papers describing our ideas, experiments, data and discoveries are made available to our colleagues and the public without having undergone peer […]
By Dr. Stuart Taylor, Publishing Director, The Royal Society, London, UK Peer review has been a key part of the research communication system for centuries. Scientists absolutely depend on a research literature that is as reliable, reproducible and trustworthy as possible in order to inform their future work and to help explain other findings. Subjecting […]
By Chris Pickett Journal peer review is a critical part of vetting the integrity of the literature, and the research community should do more to value this exercise. Biomedical research is in a period of hypercompetition, and the pressures of hypercompetition force scientists to focus on metrics that define success in the current environment—funding, publications […]
By Ron Vale, Tony Hyman, and Jessica Polka Summary We propose the creation of a scientist-driven, journal-agnostic peer review service that produces an “Evaluated Preprint” and facilitates subsequent publication in a journal. Introduction Scientists have a love-hate relationship with peer review. Sadly, this relationship has been drifting towards the latter over time. Much of the […]
The purpose of this paper is to better understand the theory and practice of peer review in open-access mega-journals (OAMJs). OAMJs typically operate a “soundness-only” review policy aiming to evaluate only the rigour of an article, not the novelty or significance of the research or its relevance to a particular community, with these elements being left for “the community to decide” post-publication.
The paper reports the results of interviews with 31 senior publishers and editors representing 16 different organisations, including 10 that publish an OAMJ. Thematic analysis was carried out on the data and an analytical model developed to explicate their significance.
Findings suggest that in reality criteria beyond technical or scientific soundness can and do influence editorial decisions. Deviations from the original OAMJ model are both publisher supported (in the form of requirements for an article to be “worthy” of publication) and practice driven (in the form of some reviewers and editors applying traditional peer review criteria to OAMJ submissions). Also publishers believe post-publication evaluation of novelty, significance and relevance remains problematic.
The study is based on unprecedented access to senior publishers and editors, allowing insight into their strategic and operational priorities. The paper is the first to report in-depth qualitative data relating specifically to soundness-only peer review for OAMJs, shedding new light on the OAMJ phenomenon and helping inform discussion on its future role in scholarly communication. The paper proposes a new model for understanding the OAMJ approach to quality assurance, and how it is different from traditional peer review.
(2018) ““Let the community decide”? The vision and reality of soundness-only peer review in open-access mega-journals”, Journal of Documentation, Vol. 74 Issue: 1, pp.137-161, https://doi.org/10.1108/JD-06-2017-0092
Last month, Dina Balabanova, (Associate Professor in Health Systems Policy at the London School of Hygiene and Tropical Medicine (LSHTM); Section Editor for BMC Health Services Research) and Jamie Lundine (Research Fellow at LSHTM), hosted a workshop at LSHTM to discuss gender equality in peer review. The specific aim was to discuss ways to address women’s equal participation in the peer review process as authors, peer reviewers and editors in health journals. The workshop was attended by a diverse group of people with a range of backgrounds and experience including PhD students, researchers, editors, publishers and funders. Continue reading “Are you aware of gender bias in peer review?”
Traditional peer review relies on anonymous reviewers to thoughtfully assess and critique an author’s work. The idea is that blind review makes the evaluation process more fair and impartial–but many scholars have questioned whether this is always the case. Open review has the potential to make scholarship more transparent and more collaborative. It also makes it easier for researchers to get credit for the work they do reviewing the scholarship of their peers. Publishers in both the sciences and the humanities and social sciences have been experimenting with open review for almost two decades now, but it is only recently that open review seems to have reached a tipping point. So what exactly is open review, and what does it entail? Continue reading “Making Peer Review More Open”