Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching for solutions to detect such content. The paper examines the general functionality of detection tools for AI-generated text and evaluates them based on accuracy and error type analysis. Specifically, the study seeks to answer research questions about whether existing detection tools can reliably differentiate between human-written text and ChatGPT-generated text, and whether machine translation and content obfuscation techniques affect the detection of AI-generated text. The research covers 12 publicly available tools and two commercial systems (Turnitin and PlagiarismCheck) that are widely used in the academic setting. The researchers conclude that the available detection tools are neither accurate nor reliable and have a main bias towards classifying the output as human-written rather than detecting AI-generated text. Furthermore, content obfuscation techniques significantly worsen the performance of tools. The study makes several significant contributions. First, it summarises up-to-date similar scientific and non-scientific efforts in the field. Second, it presents the result of one of the most comprehensive tests conducted so far, based on a rigorous research methodology, an original document set, and a broad coverage of tools. Third, it discusses the implications and drawbacks of using detection tools for AI-generated text in academic settings.

Learn 5 practical steps to update college assignments for the AI age—boosting critical thinking, authentic learning, and academic integrity.

Mike Perkins and Jasper Roe share a practical framework for ethical AI integration in assessment on episode 569 of the Teaching in Higher Ed podcast

It’s been over 12 months since the first blog post about the AI Assessment Scale, and a lot has changed, both with the technology and with our understandings of how it impacts assessments in K-12 and higher education across a range of disciplines. The AIAS has been adopted by schools and universities worldwide, and will […]

1

The emergence of generative artificial intelligence (GenAI) requires innovative educational environments to leverage this technology effectively to address concerns like academic integrity, plagiarism, and others. Additionally, higher education needs effective pedagogies to achieve intended learning outcomes. This emphasizes the need to redesign active learning experiences in the GenAI era. Authentic assessment and experiential learning are two possible meaningful alternatives in this context. Accordingly, this article investigates how GenAI can enhance teaching and learning by constructively addressing study situations beyond conventional learning approaches and cultivating high-order skills and knowledge acquisition. This study employs thing ethnography to examine GenAI tools’ integration with authentic assessment and experiential learning and explore implementation alternatives. The results reveal insights into creating human-centered and GenAI-enhanced learning experiences within a constructive alignment. Specific examples are also provided to guide their implementation. Our contributions extend beyond the traditional use of GenAI tools as mere agents-to-write or agents-to-answer questions to become agents-to-support experiential learning for authentic assessment. These findings underscore the transformative role of GenAI tools in enhancing teaching and learning efficacy and effectiveness. The limitations in treating GenAI tools as subjects in thing ethnography are acknowledged, with potential for future implementation evaluation.