– the scholarly peer review platform – has launched , a reviewer search and matchmaking tool to enable journal editors to confidently and reliably find, screen, and connect with reviewers. The AI-powered technology combines Publons’ cross-publisher peer review platform of more than 400k reviewers with Web of Science – the world’s largest curated author and citation database to deliver a high number of precise recommendations from more than seven million authors.
By Harinder Singh Director, Division of Immunobiology and the Center for Systems Immunology Cincinnati Children’s Hospital Medical Center This perspective is a result of the various insightful commentaries that have been posted on the ASAPbio site in the context of the HHMI/Wellcome/ASAPbio meeting on “Transparency, Recognition and Innovation in Peer Review in the Life Sciences.” […]
By Samantha Hindle and Daniela Saderi, PREreview The image above (DOI) is CC-BY 4.0 licensed and is available for download on Figshare.
Preprints are freely available scientific manuscripts that have not yet undergone editorial peer review. They provide data and knowledge that is current, accessible by all, and at a stage where community peer review can contribute to scientific progression. Rather than restricting feedback to two or three journal-selected reviewers, preprints can be read and evaluated by a diverse population of interested scientists at different career stages. Theoretically, the advantages of opening up scientific evaluation to a larger pool of scientists should be straightforward: the more reviewers, the fewer mistakes – or to quote Linus’ Law, “Given enough eyeballs, all bugs are shallow.” Practically speaking, this can be more complicated as scientists have limited free time, are not well-incentivized for their reviewing activities, and some may argue that “too many cooks spoil the broth.”
By Rebecca Lawrence & Vitek Tracz, F1000, email@example.com We have been successfully running a service (which we call platforms, to distinguish from traditional research journals), for over 5 years at F1000 that is essentially a preprint coupled with formal, invited (i.e. not crowd-sourced) post publication peer review. We have consequently amassed significant experience of running […]
In November 2016 Wellcome became the first research funder to launch a publishing platform for the exclusive use of its grantholders. Wellcome Open Research, run on behalf of Wellcome by F1000, uses a model of immediate publication followed by invited, post-publication peer review. All reviews are citable and posted to the platform along with the identities of the reviewers. Continue reading “Peer review as practised at Wellcome Open Research”
By Michael B. Eisen Investigator, Howard Hughes Medical Institute Professor of Molecular and Cell Biology, UC Berkeley firstname.lastname@example.org, @mbeisen With the rapid growth of bioRxiv, biomedical research is entering a new era in which papers describing our ideas, experiments, data and discoveries are made available to our colleagues and the public without having undergone peer […]
By Dr. Stuart Taylor, Publishing Director, The Royal Society, London, UK Peer review has been a key part of the research communication system for centuries. Scientists absolutely depend on a research literature that is as reliable, reproducible and trustworthy as possible in order to inform their future work and to help explain other findings. Subjecting […]
By Chris Pickett Journal peer review is a critical part of vetting the integrity of the literature, and the research community should do more to value this exercise. Biomedical research is in a period of hypercompetition, and the pressures of hypercompetition force scientists to focus on metrics that define success in the current environment—funding, publications […]
In preparation for our meeting on Transparency, Recognition, and Innovation in Peer Review in the Life Sciences on February 7-9 at HHMI Headquarters, we’ve collected some recent (and not-so-recent) literature on journal peer review. A full annotated bibliography can be found at the bottom of this post, and we invite any additions via comments. To […]
The purpose of this paper is to better understand the theory and practice of peer review in open-access mega-journals (OAMJs). OAMJs typically operate a “soundness-only” review policy aiming to evaluate only the rigour of an article, not the novelty or significance of the research or its relevance to a particular community, with these elements being left for “the community to decide” post-publication.
The paper reports the results of interviews with 31 senior publishers and editors representing 16 different organisations, including 10 that publish an OAMJ. Thematic analysis was carried out on the data and an analytical model developed to explicate their significance.
Findings suggest that in reality criteria beyond technical or scientific soundness can and do influence editorial decisions. Deviations from the original OAMJ model are both publisher supported (in the form of requirements for an article to be “worthy” of publication) and practice driven (in the form of some reviewers and editors applying traditional peer review criteria to OAMJ submissions). Also publishers believe post-publication evaluation of novelty, significance and relevance remains problematic.
The study is based on unprecedented access to senior publishers and editors, allowing insight into their strategic and operational priorities. The paper is the first to report in-depth qualitative data relating specifically to soundness-only peer review for OAMJs, shedding new light on the OAMJ phenomenon and helping inform discussion on its future role in scholarly communication. The paper proposes a new model for understanding the OAMJ approach to quality assurance, and how it is different from traditional peer review.
(2018) ““Let the community decide”? The vision and reality of soundness-only peer review in open-access mega-journals”, Journal of Documentation, Vol. 74 Issue: 1, pp.137-161, https://doi.org/10.1108/JD-06-2017-0092
Last month, Dina Balabanova, (Associate Professor in Health Systems Policy at the London School of Hygiene and Tropical Medicine (LSHTM); Section Editor for BMC Health Services Research) and Jamie Lundine (Research Fellow at LSHTM), hosted a workshop at LSHTM to discuss gender equality in peer review. The specific aim was to discuss ways to address women’s equal participation in the peer review process as authors, peer reviewers and editors in health journals. The workshop was attended by a diverse group of people with a range of backgrounds and experience including PhD students, researchers, editors, publishers and funders. Continue reading “Are you aware of gender bias in peer review?”
Traditional peer review relies on anonymous reviewers to thoughtfully assess and critique an author’s work. The idea is that blind review makes the evaluation process more fair and impartial–but many scholars have questioned whether this is always the case. Open review has the potential to make scholarship more transparent and more collaborative. It also makes it easier for researchers to get credit for the work they do reviewing the scholarship of their peers. Publishers in both the sciences and the humanities and social sciences have been experimenting with open review for almost two decades now, but it is only recently that open review seems to have reached a tipping point. So what exactly is open review, and what does it entail? Continue reading “Making Peer Review More Open”
When a paper is challenged on PubPeer, is a journal paying attention? A new feature recently unveiled by the site makes it easier to find out. The Journal Dashboards allow journals to see what people are saying about the papers they published, and allows readers to know which journals are particularly responsive to community feedback. […]
The post New feature aims to draw journals into post-publication comments on PubPeer appeared first on Retraction Watch.