(352) Research: Human Graders Do Not Spot AI, Authentic Assessments Are No Shield
Plus, a Thai Police Colonel is busted cheating on an exam to be a Judge. Plus, a provost at WVU talks about academic integrity and AI in online classes.
Like so many things in our world, our well-intentioned efforts to solve one problem usher in a legion of new challenges, and AI detection is no different.
OK. I've seen a lot of stuff about "AI Detectors" lately. Seriously, if you are still using an AI Detector, you are hurting yourself and your students. AI Detectors are:
1. Completely fallible—both directions. AI Detectors will tell you a student isn't using AI when they are, and they will tell you that a student is using AI when they aren't.
2. Easily fooled.
3. Discriminatory against ESL, disabled, and economically disadvantaged students.
4. Create an environment of mistrust that is not conducive to learning.
Here are the receipts:
“AI Detectors Don’t Work. Here’s What to Do Instead.” MIT Sloan Teaching & Learning Technologies, https://lnkd.in/eNbAfYED. Accessed 16 Feb. 2025.
Dugan, Liam, et al. RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors. arXiv:2405.07940, arXiv, 10 June 2024. arXiv.org, https://lnkd.in/e7z4racy.
Elkhatat, Ahmed M., et al. “Evaluating the Efficacy of AI Content Detection Tools in Differentiating between Human and AI-Generated Text.” International Journal for Educational Integrity, vol. 19, no. 1, 1, Sept. 2023, pp. 1–16. link.springer.com, https://lnkd.in/e6izJzkm.
Giray, Louie, et al. “Beyond Policing: AI Writing Detection Tools, Trust, Academic Integrity, and Their Implications for College Writing.” Internet Reference Services Quarterly, vol. 29, no. 1, Jan. 2025, pp. 83–116. Taylor and Francis+NEJM, https://lnkd.in/e53dW9GN.
Krishna, Kalpesh, et al. Paraphrasing Evades Detectors of AI-Generated Text, but Retrieval Is an Effective Defense. proceedings.neurips.cc, https://lnkd.in/e2V6ipxv. Accessed 5 Sept. 2024.
Liang, Weixin, et al. “GPT Detectors Are Biased against Non-Native English Writers.” Patterns, vol. 4, no. 7, 2023. Google Scholar, https://lnkd.in/eeCM8fnG.
Perkins, Mike, et al. Data Files: GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education. Mar. 2024. https://lnkd.in/eqy-EupN.
Rivero, Victor. “Beyond AI Detection: Rethinking Our Approach to Preserving Academic Integrity.” EdTech Digest, 5 Nov. 2024, https://lnkd.in/eGgQBXM5.
Sadasivan, Vinu Sankar, et al. Can AI-Generated Text Be Reliably Detected? arXiv:2303.11156, arXiv, 19 Feb. 2024. arXiv.org, https://lnkd.in/eCBvVPQy.
Weber-Wulff, Debora, et al. “Testing of Detection Tools for AI-Generated Text.” International Journal for Educational Integrity, vol. 19, no. 1, Dec. 2023, p. 26. arXiv.org, https://lnkd.in/e-uJDHbp.
Fatemeh Ranjbaran | 217 comments on LinkedIn
Why I'm using AI detection after all, alongside many other strategies | LinkedIn
I argued against use of AI detection in college classrooms for two years, but my perspective has shifted. I ran into the limits of my current approaches last semester, when a first-year writing student persisted in submitting work that was clearly not his own, presenting document history that showed
You are not a good AI detector. Thinking you can detect it is a dangerous misconception. You might have spotted it a few times and think "hey I know the… | 37 comments on LinkedIn
AI Detectors are garbage and need to continue to be called out as more and more teachers are stepping into the AI world and making assumptions that these…
Best Way to Remove AI Plagiarism from Text: Bypass AI Detectors
Is your text AI-generated? If so, it may need to be revised to remove AI plagiarism. Submitting AI-plagiarized content to search engines, assignments, research papers, and similar platforms is not advisable.
Humanize AI text into undetectable AI. Bypass AI detection with the world's best AI detection remover and AI Humanizer. Free AI detector works with GPTZero, Turnitin, Originality AI, and more.
AI detection software doesn’t work. Do this instead.
Adam Sparks is a Nebraska-based educator that taught English and Social Studies for 7 years before recently finishing his master's in Learning Design and
AI Detectors Don't Work. Here's What to Do Instead. - MIT Sloan Teaching & Learning Technologies
As new tools raise concerns around AI academic integrity, instructors can deter misuse through transparent policies, open discussions with students, assignments that engage intrinsic motivation, and inclusive teaching practices.
When you live in a research/social media bubble like I do, it’s easy to take certain things for granted. For example, I always overestimate the number of people who are using generative AI re…
I've noted before that because AI detectors produce false positives, it's unethical to use them to detect cheating.
Now there's a new study that shows it's even worse. Not only do AI detectors falsely flag human-written text as AI-written, the way in which they do it is biased.
This is
Guidance on AI Detection and Why We’re Disabling Turnitin’s AI Detector
In April of this year, Turnitin released an update to their product that reviewed submitted papers and presented their determination of how much of a paper was written by AI. As we outlined at that time, many people had important concerns and questions about this new tool, namely how the product exactly works and how...
Academic writing has completely changed: Turnitin forges ahead
Vol. 5, No. 3 (Fall 2023) By Brian Hotson, Editor, CWCR/RCCR On July 20, 2023, OpenAI, the parent company of ChatGPT and Dall·E, stopped offering its GenAI detection tool, AI classifier, saying tha…
A simple hack to ChatGPT-proof assignments| THE Campus Learn, Share, Connect
What if there was a way to maintain the essay in all its three constituent parts – reading, thinking, writing – in the age of ChatGPT? Dave Sayers thinks he has an answer
AI Text Detectors (aka AI Plagiarism Detectors & AI Content Detectors) Designed by Torrey Trust, Ph.D. College of Education University of Massachusetts Amherst @torreytrust | torrey@umass.edu This work is licensed under CC BY NC 4.0, meaning that you can freely use, remix, and share it as long as...