Skip to content

ACN - 101321555 | ABN - 39101321555

Australasian Human Research Ethics Consultancy Services Pty Ltd (AHRECS)

AHRECS icon
  • Home
  • About Us
    • Consultants
    • Services
  • Previous Projects
  • Blog
  • Resources
  • Feeds
  • Contact Us
  • More
    • Request a Quote
    • Susbcribe to REM
    • Subscribe to VIP
Menu
  • Home
  • About Us
    • Consultants
    • Services
  • Previous Projects
  • Blog
  • Resources
  • Feeds
  • Contact Us
  • More
    • Request a Quote
    • Susbcribe to REM
    • Subscribe to VIP
Exclude terms...
Aboriginal and Torres Strait Islander
AHRECS
Analysis
Animal ethics
Animal Ethics Committee
Animal handling
Animal housing
Animal Research Ethics
Animal Welfare
ANZCCART
Artificial Intelligence
Arts
Australia
Authorship
Belief
Beneficence
Big data
Big data
Biobank
Bioethics
Biomedical
Biospecimens
Breaches
Cartoon/Funny
Case studies
Clinical trial
Collaborative research
Conflicts of interest
Consent
Controversy/Scandal
Controversy/Scandal
Creative
Culture
Data management
Database
Dual-use
Essential Reading
Ethical review
Ethnography
Euthanasia
Evaluative practice/quality assurance
Even though i
First People
Fraud
Gender
Genetics
Get off Gary Play man of the dog
Good practice
Guidance
Honesty
HREC
Human research ethics
Humanities
Institutional responsibilities
International
Journal
Justice
Links
Media
Medical research
Merit and integrity
Methodology
Monitoring
New Zealand
News
Online research
Peer review
Performance
Primary materials
Principles
Privacy
Protection for participants
Psychology
Publication ethics
Questionable Publishers
Research ethics committees
Research integrity
Research Misconduct
Research results
Researcher responsibilities
Resources
Respect for persons
Sample paperwork
sd
se
Serious Adverse Event
Social Science
SoTL
Standards
Supervision
Training
Vulnerability
What was that say
x
Young people
Exclude news

Sort by

Animal Ethics Biosafety Human Research Ethics Research Integrity

Distinguishing academic science writing from humans or ChatGPT with over 99% accuracy using off-the-shelf machine learning tools (Papers: Heather Desaire et. al | June 2023)

Posted by Connar Allen in Research Integrity on July 3, 2023
Keywords: Authorship, Journal, Researcher responsibilities

The Linked Original Item was Posted On June, 21 2023 17:08:03

A digital picture of a head in front of luminescent binary code, as representation of Artificial Intelligence.

Summary

The claim made in this open access paper is quite remarkable and important, if accurate.  We haven’t tried the method ourselves yet, but we can see how it will be of value to teachers, tutors and editors.  One wonders how long it will be before the system designers come up with a way to beat the detection method.

ChatGPT has enabled access to artificial intelligence (AI)-generated writing for the masses, initiating a culture shift in the way people work, learn, and write. The need to discriminate human writing from AI is now both critical and urgent. Addressing this need, we report a method for discriminating text generated by ChatGPT from (human) academic scientists, relying on prevalent and accessible supervised classification methods. The approach uses new features for discriminating (these) humans from AI; as examples, scientists write long paragraphs and have a penchant for equivocal language, frequently using words like “but,” “however,” and “although.” With a set of 20 features, we built a model that assigns the author, as human or AI, at over 99% accuracy. This strategy could be further adapted and developed by others with basic skills in supervised classification, enabling access to many highly accurate and targeted models for detecting AI usage in academic writing and beyond.

Desaire, H., Chua, A.E., Isom, M. Jarosova, R. & Hua, D. (2023) Distinguishing academic science writing from humans or ChatGPT with over 99% accuracy using off-the-shelf machine learning tools. Cell Reports Physical Science, 4(6)
Publisher (Open Access): https://www.sciencedirect.com/science/article/pii/S266638642300200X?via%3Dihub
Distinguishing academic science writing from humans or ChatGPT with over 99% accuracy using off-the-shelf machine learning tools
ChatGPT has enabled access to artificial intelligence (AI)-generated writing for the masses, initiating a culture shift in the way people work, learn,…

Related Reading

Guidance for Authors, Peer Reviewers, and Editors on Use of AI, Language Models, and Chatbots (Papers: Annette Flanagin et. al. | July 2023)

The ethics of disclosing the use of artificial intelligence tools in writing scholarly manuscripts (Papers: Mohammad Hosseini et. al. | June 2023)

(Spain) A researcher who publishes a study every two days reveals the darker side of science – El Pais (Manuel Ansede | June 2023)

Using artificial intelligence with academic integrity – Ethicsblog (Pär Segerdahl | June 2023)

AI intensifies fight against ‘paper mills’ that churn out fake research – Cell (Courtney Bricker-Anthony & Roland W. Herzog | May 2023)

Researchers embracing ChatGPT are like turkeys voting for Christmas – Times Higher Education (Dirk Lindebaum | May 2023)

Using AI in peer review – Research Professional News (Mohammad Hosseini & Serge Horbach | May 2023)

Fighting reviewer fatigue or amplifying bias? Considerations and recommendations for use of ChatGPT and other large language models in scholarly peer review – (Papers: Mohammad Hosseini | May 2023)

A Doctor Published Several Research Papers With Breakneck Speed. ChatGPT Wrote Them All – Daily Beast (Tony Ho Tran | May 2023)

AI makes plagiarism harder to detect, argue academics – in paper written by chatbot – The Guardian (Anna Fazackerley | March 2023)

Academic Publishers Are Missing the Point on ChatGPT – The Scholarly Kitchen (Avi Staiman | March 2023)

What Chatbot Bloopers Reveal About the Future of AI – WIRED (Will Knight | February 2023)

Turnitin announces AI detector with ‘97 per cent accuracy’ – Times Higher Education (Tom Williams | February 2023)

As scientists explore AI-written text, journals hammer out policies – Science (Jeffrey Brainard | February 2023)

A.I. Like ChatGPT Is Revealing the Insidious Disease at the Heart of Our Scientific Process – Slate (Charles Seife | January 2023)

What ChatGPT and generative AI mean for science – Nature (Chris Stokel-Walker & Richard Van Noorden | February 2023)

Nonhuman “Authors” and Implications for the Integrity of Scientific Publication and Medical Knowledge (Papers: Annette Flanagin et al. | January 2023)

Tools such as ChatGPT threaten transparent science; here are our ground rules for their use – Nature (January 2023)

ChatGPT: our study shows AI can produce academic papers good enough for journals – just as some ban it – The Conversation (Brian Lucy & Michael Dowling | January 2023)

Science journals ban listing of ChatGPT as co-author on papers – The Guardian (Ian Sample | January 2023)

CNET’s AI Journalist Appears to Have Committed Extensive Plagiarism – Futurism (Jon Christian | January 2023)

Abstracts written by ChatGPT fool scientists – Nature (Holly Else | January 2023)

ChatGPT listed as author on research papers: many scientists disapprove – Nature (Chris Stokel-Walker | January 2023)

AI and Scholarly Publishing: A View from Three Experts – The Scholarly Kitchen (Anita De Waard | January 2023)

Scientists, please don’t let your chatbots grow up to be co-authors – Substack (Gary Marcus | January 2023)

Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers (Papers: Catherine A. Gao et. al. | December 2022)

AI et al.: Machines Are About to Change Scientific Publishing Forever – ACS Publications (Gianluca Grimaldi & Bruno Ehrler | January 2023)

AI paper mills and image generation require a co-ordinated response from academic publishers – LSE (Rebecca Lawrence & Sabina Alam | December 2022)

Related Links

  • About the contributors
  • About the keywords
  • Suggest a resource
  • Report problem/broken link
  • Request a Take Down

Compiled here are links, downloads and other resources relating to research integrity and human research ethics. more…

Resources Menu

Four hands solving a jigsaw against the sun blazing out of a cloudy sky

Research Integrity

  • Codes, guidelines, policies and standards
  • Guidance and resource material
  • Papers
  • Books
  • Animal Ethics

Human Research Ethics

  • Codes, guidelines, policies and standards
  • Guidance and resource material
  • Papers
  • Books

Research Ethics Monthly Receive copies of the Research Ethics Monthly directly
by email. We will never spam you.

  • Enter the answer as a word
  • Hidden
    This field is hidden and only used for import to Mailchimp
  • This field is for validation purposes and should be left unchanged.
  • Home
  • Services
  • About Us
  • Contact Us
  • Home
  • Services
  • About Us
  • Contact Us
  • Company
  • Terms Of Use
  • Copyright
  • Privacy Policy
  • Company
  • Terms Of Use
  • Copyright
  • Privacy Policy
  • Site Map
  • Site Map

Australasian Human Research Ethics Consultancy Services Pty Ltd (AHRECS)

Facebook-f Twitter Linkedin-in