Skip to content

ACN - 101321555 | ABN - 39101321555

Australasian Human Research Ethics Consultancy Services Pty Ltd (AHRECS)

AHRECS icon
  • Home
  • About Us
    • Consultants
    • Services
  • Previous Projects
  • Blog
  • Resources
  • Feeds
  • Contact Us
  • More
    • Request a Quote
    • Susbcribe to REM
    • Subscribe to VIP
Menu
  • Home
  • About Us
    • Consultants
    • Services
  • Previous Projects
  • Blog
  • Resources
  • Feeds
  • Contact Us
  • More
    • Request a Quote
    • Susbcribe to REM
    • Subscribe to VIP
Exclude terms...
Aboriginal and Torres Strait Islander
AHRECS
Analysis
Animal ethics
Animal Ethics Committee
Animal handling
Animal housing
Animal Research Ethics
Animal Welfare
ANZCCART
Artificial Intelligence
Arts
Australia
Authorship
Belief
Beneficence
Big data
Big data
Biobank
Bioethics
Biomedical
Biospecimens
Breaches
Cartoon/Funny
Case studies
Clinical trial
Collaborative research
Conflicts of interest
Consent
Controversy/Scandal
Controversy/Scandal
Creative
Culture
Data management
Database
Dual-use
Essential Reading
Ethical review
Ethnography
Euthanasia
Evaluative practice/quality assurance
Even though i
First People
Fraud
Gender
Genetics
Get off Gary Play man of the dog
Good practice
Guidance
Honesty
HREC
Human research ethics
Humanities
Institutional responsibilities
International
Journal
Justice
Links
Media
Medical research
Merit and integrity
Methodology
Monitoring
New Zealand
News
Online research
Peer review
Performance
Primary materials
Principles
Privacy
Protection for participants
Psychology
Publication ethics
Questionable Publishers
Research ethics committees
Research integrity
Research Misconduct
Research results
Researcher responsibilities
Resources
Respect for persons
Sample paperwork
sd
se
Serious Adverse Event
Social Science
SoTL
Standards
Supervision
Training
Vulnerability
x
Young people
Exclude news

Sort by

Animal Ethics Biosafety Human Research Ethics Research Integrity

Improving peer review on many fronts – Nature (Editorial | May 2022)

Posted by Dr Gary Allen in Research Integrity on June 17, 2022
Keywords: Institutional responsibilities, Journal, Peer review, Research results, Researcher responsibilities

The Linked Original Item was Posted On May 10, 2022

A girl with magnifier loupe reviewing something

There is a range of approaches to improving peer review, and at this journal we encourage many of them.

The importance of peer review and the imperfections of current peer-review systems are a perennial topic of discussion. Many different modifications to the traditional model have been advocated and tried, across journals and across fields, and the landscape of peer review has changed substantially for the better over the past 20 years or so. A recent preprint and accompanying blog post make a helpful contribution by summarizing many of the different ideas, and classifying them into four different schools of thought that have both complementarities and tensions.

Peer review has continued to evolve over the last twenty years, undoubtedly for the better – though there are definitely still room for improvement (e.g. gender and racial diversity).  This Nature editorial reflects on the changes over the last 20 years.

The four schools proposed by the authors are ‘quality and reproducibility’, ‘democracy and transparency’, ‘equity and inclusion’, and ‘efficiency and incentives’. Below, we describe the four schools and discuss how their approaches relate to the peer-review policies of Nature Ecology & Evolution and other Nature Portfolio journals.

The quality and reproducibility school includes a range of approaches that are aimed at making peer review more rigorous, and thus improving the reliability of the published record itself. This starts with choosing peer reviewers with the right expertise, and making editorial decisions that specifically take into account the different expertise of the reviewers — especially in the case of any disagreements. Reviewers can be assisted in scrutinizing a manuscript through the use of checklists, both those filled in by authors (such as our own reporting summary) to ensure all relevant information is available for assessment and those used by reviewers themselves to help to structure their approach, such as one that we encourage our reviewers to use. This school is also keen to improve the detection of image manipulation and plagiarism, checks for both of which are carried out in-house at Naturejournals and therefore are not, strictly speaking, part of the peer-review process. Further improvements to peer-review rigour come from specific reviewing of custom code, and use of registered reports to assess study design in advance. Both of these are currently being used by other Nature journals, and rollout at Nature Ecology & Evolution is under consideration.

Nature logo
Improving peer review on many fronts - Nature Ecology & Evolution
There is a range of approaches to improving peer review, and at this journal we encourage many of them.

Related Reading

Is anonymity or transparency the best solution to bias in peer review? – Times Higher Education (Kim Eggleton | March 2022)

Fraud and Peer Review: An Interview with Melinda Baldwin – Scholarly Kitchen (Robert Harington | March 20225)

There are four schools of thought on reforming peer review – can they co-exist? – London School of Economics Blog (Ludo Waltman, et al | March 2022)

Peer review will only improve if journals’ decisions are audited – Times Higher Education (Arfan Ghani | February 2022)

It is time to start paying peer reviewers – Times Higher Education (Adrian Furnham | October 2021)

“Fabulous document”, “very helpful guidance”: Sleuths react to recommendations for handling image integrity issues – Retraction Watch (Ivan Oransky | September 2021)

Let’s stop reviewing for publishers that profit from research | Joseph Paul Cohen Blog (July 2021)

The Absurdity of Peer Review – Elemental (Mark Humphries | June 2021)

Reading Peer Review – What a dataset of peer review reports can teach us about changing research culture – LSE Impact Blog (Martin Eve, et al | March 2021)

Why I Won’t Review or Write for Elsevier and Other Commercial Scientific Journals – The Sciences (T.R. Shankar Raman | April 2021)

Science relies on constructive criticism. Here’s how to keep it useful and respectful – Science (William A. Cunningham | March 2021)

The $450 question: Should journals pay peer reviewers? – Science (Jeffrey Brainard | March 2021)

Towards a Shared Peer-Review Taxonomy: An interview with Joris van Rossum and Lois Jones – Scholarly Kitchen (Phill Jones | December 2020)

Building trust in peer review: A Q&A with Dr Mario Malički – BMC Blog Network (Suzuki Limbu | September 2020)

The 450 Movement – James Heathers blog (James Heathers | September 2020)

On Clarifying the Goals of a Peer Review Taxonomy – Scholarly Kitchen (Micah Altman & Philip N. Cohenoct | October 2020)

Don’t be a prig in peer review

Anonymous Peer Review: Truth or Trolling? – Scientific American (Susana Carvalho | September 2020)

‘An isolated incident’: Should reviewers check references? – Retraction Watch (Adam Marcus | September 2020)

‘TripAdvisor for peer review’ targets publishing bias – Times Higher Education (Jack Grove | January 2020)

Nature will publish peer review reports as a trial – Nature (Editorial | February 2020)

Opinion: Exorcising Ghostwriting from Peer Review – TheScientist (James L. Sherley | January 2020)

(China) Science publishers review ethics of research on Chinese minority groups – Nature (Richard Van Noorden & Davide Castelvecchi | December 2019)

Rude paper reviews are pervasive and sometimes harmful, study find – Science (Christie Wilcox | December 2019)

Fighting Citation Pollution — The Challenge of Detecting Fraudulent Journals in Works Cited – Scholarly Kitchen ( Lisa Janicke Hinchliffe and Michael Clarke | September 2019)

How to Be A Good Peer Reviewer – Scholarly Kitchen (Jasmine Wallace | September 2019)

Elsevier investigates hundreds of peer reviewers for manipulating citations – Nature (Dalmeet Singh Chawla | September 2019)

Why we shouldn’t take peer review as the ‘gold standard’ – The Washington Post (Paul D. Thacker and Jon Tennant | August 2019)

It’s Time to Lift the Veil on Peer Review – UnDark (Dalmeet Singh Chawla | June 2019)

Guidelines for open peer review implementation (Paper: Tony Ross-Hellauer and Edit Görögh | February 2019)

Peer-review experiments tracked in online repository – Nature (Richard Van Noorden | March 2019)

We need to relearn how to play nice in peer review – UA/AU (Daniel Harris | March 2019)

Rare trial of open peer review allays common concerns – Nature (Dalmeet Singh Chawla | February 2019)

A Beginner’s Guide to the Peer Review System – GradHacker (Carolyn Trietsch | January 2019)

Kinder Peer Review – Scientists Are Humans (Dr Rebecca Kirk | November 2018)

How Do We Move Towards Better Peer Review? – The Wiley Network (Elizabeth Moylan | September 2018)

The Evolution and Critical Role of Peer Review in Academic Publishing – The Wiley Network (Marilyn Pollett | September 2018)

There is little evidence to suggest peer reviewer training programmes improve the quality of reviews – LSE Blog (Shaun Khoo | May 2018)

Opening up peer review – Science (Editorial – August 2018)

Gender and Regional Diversity In Peer Review – The Wiley Network (Lou Peck | September 2018)

Addressing the Regional Diversity of Reviewers – The Wiley Network (Thomas Gaston | September 2018)

Ask The Chefs: How Would You Ensure Diversity In Peer Review? – Scholarly Kitchen (Ann Michael | September 2018)

Can Peer Review Be Saved? – Chronicle of Higher Education (Paul Basken | March 2018)

Publish peer reviews – Nature (Jessica K. Polka, et al | August 2018)

The pros and cons of publishing peer reviews – Crosstalk (Deborah Sweet | May 2018)

Advocating for publishing peer review – ASAbio (Iain Cheeseman | April 2018)

Uncovering new peer review problems – this time at The BMJ – Health News Review (April 2018)

Make reviews public, says peer review expert – Retraction Watch (Alison McCook | November 2017)

Few authors choose anonymous peer review, massive study of Nature journals shows – Science (Martin Enserink | September 2017)

Towards a more transparent and collaborative review process – Crosstalk (Milka Kostic | September 2017)

How to be a great reviewer for a research paper – Crosslink (Milka Kostic | August 2017)

The Future of Peer Review – Scientific American (Andrew Preston | August 2017)

Ask The Chefs: Should Peer Review Change? – Scholarly Kitchen (Ann Michael | September 2017)

The Future of Peer Review – Scholarly Kitchen (Alice Meadows | May 2017)

Dear Peer Reviewer: Could you also replicate the experiments? Thanks – Retraction Watch (Dalmeet Singh Chawla | January 2017)

Is it becoming harder to secure reviewers for peer review? A test with data from five ecology journals (Papers: Arianne Y. K. Albert, et al | 2016)

Standing up for peer review – CrossTALK (Emilie Marcus: September 2016)

Peer review: the benefits of leaving it open – Biomed Central Blog (Francesca Martin: September 2016)

A fascinating experiment into measuring dishonesty: Is peer review a major determent in keeping science honest? – Elsevier Connect (Dan Ariely and Yael Melamede: September 2016)

Would peer review work better if reviewers talked to each other? – Retraction Watch (Dalmeet Singh Chawla September 2016)

Ask The Chefs: What Is The Future Of Peer Review? – The Scholarly Kitchen (Ann Michael September 2016)

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Related Links

Complaints against Research Ethics Monthly

Request a Takedown

Submission Guidelines

About the Research Ethics Monthly

About subscribing to the Research Ethics Monthly

A diverse group discussing a topic

Random selected image from the AHRECS library. These were all purchased from iStockPhoto. These are images we use in our workshops and Dr Allen used in the GUREM.

Research Ethics Monthly Receive copies of the Research Ethics Monthly directly
by email. We will never spam you.

  • Enter the answer as a word
  • Hidden
    This field is hidden and only used for import to Mailchimp
  • This field is for validation purposes and should be left unchanged.
  • Home
  • Services
  • About Us
  • Contact Us
  • Home
  • Services
  • About Us
  • Contact Us
  • Company
  • Terms Of Use
  • Copyright
  • Privacy Policy
  • Company
  • Terms Of Use
  • Copyright
  • Privacy Policy
  • Site Map
  • Site Map

Australasian Human Research Ethics Consultancy Services Pty Ltd (AHRECS)

Facebook-f Twitter Linkedin-in