The role of AI in the production of research papers is rapidly moving from being a futuristic vision, towards an everyday reality; a situation with significant consequences for research integrity and the detection of fraudulent research. Rebecca Lawrence and Sabina Alam argue that for publishers, collaboration and open research workflows are key to ensuring the reliability of the scholarly record.
The latest iteration of OpenAI’s Artificial Intelligence (AI) chatbot, ChatGPT, and the bot’s almost uncanny capability to write poetry and academic essays that are very difficult to distinguish from human-centric production has recently, and much like other companies linked to Elon Musk, caused a stir in the world of research. This is raising the spectre of AI in the service of research fraud and a race-to-the-bottom in research output and publication. As John Gapper warned in the Financial Times, “…if an unreliable linguistic mash-up is freely accessible, while original research is costly and laborious, the former will thrive”. Does a new age of research desk top paper mills that are in easy reach of everyone anywhere present a real and present danger to research integrity?
Not so long ago we might have dismissed the idea of AI fabricating scientific images so well that humans cannot detect the fraud as being the stuff of science fiction. Similarly, we would have thought it ludicrous to suggest that an AI could write a scientific paper so well that it could not be easily spotted. It seems, science fiction is now science reality. This London School of Economics Blog piee discusses a call for a coordinated response to deal with this real threat to science and the scientific record. This begs the question of whether in such a situation, should the AI be listed as a collaborator? If there are misconduct proceedings in collaborative research, where a collaborator uses AI without the knowledge of their collaborators to what extent should the team be expected to spot if someone in their team has used AI to cheat?
“Does a new age of research desk top paper mills that are in easy reach of everyone anywhere present a real and present danger to research integrity?”
Investigating these issues within a context of shifting sands poses many challenges. Nevertheless, publishers play a vital role in ensuring the legitimacy and integrity of what we publish and disseminate across the world. We invest in systems, safeguards and expertise to ensure due process has been applied to the scholarly content we publish. So, when this is manipulated and the integrity of the scholarly record is under threat, it’s vital we take all steps necessary to protect it. Technology is playing an ever more important role for publishers. The ability to detect research integrity and publishing ethics issues needs to be scalable, because some types of misconduct only become noticeable when patterns are detected across a number of different articles and datasets. This is a key area where developers, publishers and other scholarly organisations are collaborating and investing, not just financially, but with time and effort too.