Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching for solutions to detect such content. The paper examines the general functionality of detection tools for AI-generated text and evaluates them based on accuracy and error type analysis. Specifically, the study seeks to answer research questions about whether existing detection tools can reliably differentiate between human-written text and ChatGPT-generated text, and whether machine translation and content obfuscation techniques affect the detection of AI-generated text. The research covers 12 publicly available tools and two commercial systems (Turnitin and PlagiarismCheck) that are widely used in the academic setting. The researchers conclude that the available detection tools are neither accurate nor reliable and have a main bias towards classifying the output as human-written rather than detecting AI-generated text. Furthermore, content obfuscation techniques significantly worsen the performance of tools. The study makes several significant contributions. First, it summarises up-to-date similar scientific and non-scientific efforts in the field. Second, it presents the result of one of the most comprehensive tests conducted so far, based on a rigorous research methodology, an original document set, and a broad coverage of tools. Third, it discusses the implications and drawbacks of using detection tools for AI-generated text in academic settings.

Library and outside resources to enrich your understanding of AI and its place in the classroom and beyond.

Everything is about to change.

What happens to higher education curriculum in a world revised by AI?This week the Forum continues our exploration of AI's impact with a great guest, profess...

Walking questionmark, 3D render, created by Ody Frank, a real person using Blender. Ody is a first year undergraduate studying towards a BA (Hons) Digital Game Art and Design at the Norwich Univers…

What might ChatGPT mean for higher education and society? EDITED TO ADD: This is a living document, and has grown since first posted. Today I’m hosting a Future Trends Forum session on the to…

What is ChatGPT and what might it mean for higher education? In this special Future Trends Forum session we'll collectively explore this new technology. How does the chatbot work? How might it reshape academic writing? Does it herald an age of AI transforming society, or is it really BS? Experts who joined us on stage includes Brent A. Anders, Rob Fentress, Philip Lingard, John Warner, Jess Stahl, and Anne Fensie. https://bryanalexander.org/future-of-education/resources-for-exploring-chatgpt-and-higher-education/ ///// The Future Trends Forum is a weekly discussion event created and hosted by Bryan Alexander. Since 2016 we have addressed the most powerful forces of change in academia. Each week, this video chat brings together practitioners in the field to share their most recent work and experience in education and technology. The intent of the Forum: to advance the discussion around the pressing issues at the crossroads of education and technology. http://forum.futureofeducation.us/ https://bryanalexander.org/ This event is powered by Shindig, the video chat event provider. On Shindig, audiences all can see one another and engage in private video chats sharing and discussing the content of the presentation. Event hosts may also bring selected audience members to the stage to ask questions or otherwise interact with guest speakers. Shindig; the dynamics of in person events, online.