Episode 6: Stochastic Parrot Galactica, November 23, 2022
Listen to this episode from Mystery AI Hype Theater 3000 on Spotify. Emily and Alex discuss MetaAI's bullshit science paper generator, Galactica, along with its defenders. Plus, where could AI actually help scientific research? And more Fresh AI Hell. Watch the video of this episode on PeerTube. References:Imre Lakatos on research programsShah, Chirag and Emily M. Bender. 2022. Situating Search. Proceedings of the 2022 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR ’22). UW RAISE (Responsibility in AI Systems and Experiences)Stochastic Parrots:Bender, Emily M., Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜. In Proceedings of FAccT 2021, pp.610-623. The Octopus Paper:Bender Emily M. and Alexander Koller. 2020. Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data. ACL 2020Palestinian man arrested because of bad machine translation.Katherine McKittrick, Dear Science and Other StoriesThe Sokal HoaxSafiya Noble, Algorithms of OppressionLatanya Sweeney, "Discrimination in Online Ad Delivery"Mehtab Khan and Alex Hanna, The Subjects and Stages of AI Dataset Development: A Framework for Dataset Accountability(What is 'sealioning'?)http://wondermark.com/1k62/Grover:Raji, Inioluwa Deborah, Emily M. Bender, Amandalynne Paullada, Emily Denton and Alex Hanna. 2021. AI and the Everything in the Whole Wide World Benchmark. Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021) Track on Datasets and Benchmarks.Ben Dickson's coverage of Grover:Why we must rethink AI benchmaYou can check out future livestreams at https://twitch.tv/DAIR_Institute. Follow us!Emily Twitter: https://twitter.com/EmilyMBender Mastodon: https://dair-community.social/@EmilyMBender Bluesky: https://bsky.app/profile/emilymbender.bsky.social Alex Twitter: https://twitter.com/@alexhanna Mastodon: https://dair-community.social/@alex Bluesky: https://bsky.app/profile/alexhanna.bsky.social Music by Toby Menon.Artwork by Naomi Pleasure-Park. Production by Christie Taylor.
Episode 7: There Are Now 15 Competing Evaluation Metrics (ft. Dr. Jeremy Kahn). December 12, 2022
Listen to this episode from Mystery AI Hype Theater 3000 on Spotify. Emily and Alex are joined by Dr. Jeremy G. Kahn to discuss the distressingly large number of evaluation metrics for artificial intelligence, and some new AI hell.Jeremy G. Kahn has a PhD in computational linguistics, with a focus on information-theoretic and empirical engineering approaches to dealing with natural language (in text and speech). He’s gregarious, polyglot, a semi-auto-didact, and occasionally prolix. He also likes comic books, coffee, progressive politics, information theory, lateral thinking, science fiction, science fact, linear thinking, bicycles, beer, meditation, love, play, and inquiry. He lives in Seattle with his wife Dorothy and son Elliott.This episode was recorded on December 12, 2022.Watch the video of this episode on PeerTube.References:XKCD: StandardsWikidataConGish GallopThe Bender RuleDJ Khaled - You Played YourselfJeff Kao's interrogation of public comment periods.Emily's blog post response to NYT pieceYou can check out future livestreams at https://twitch.tv/DAIR_Institute. Follow us!Emily Twitter: https://twitter.com/EmilyMBender Mastodon: https://dair-community.social/@EmilyMBender Bluesky: https://bsky.app/profile/emilymbender.bsky.social Alex Twitter: https://twitter.com/@alexhanna Mastodon: https://dair-community.social/@alex Bluesky: https://bsky.app/profile/alexhanna.bsky.social Music by Toby Menon.Artwork by Naomi Pleasure-Park. Production by Christie Taylor.
Episode 18: Rumors of Artificial General Intelligence Have Been Greatly Exaggerated, October 23 2023
Listen to this episode from Mystery AI Hype Theater 3000 on Spotify. Emily and Alex read through Google vice president Blaise Aguera y Arcas' recent proclamation that "artificial general intelligence is already here." Why this claim is a maze of hype and moving goalposts.References:Noema Magazine: "Artificial General Intelligence Is Already Here." "AI and the Everything in the Whole Wide World Benchmark" "Targeting the Benchmark: On Methodology and Current Natural Language Processing Research""Recoding Gender: Women's Changing Participation in Computing""The Computer Boys Take Over: Computers, Programmers, and the Politics of Technical Expertise""Is chess the drosophila of artificial intelligence? A social history of an algorithm" "The logic of domains""Reckoning and Judgment"Fresh AI Hell:Using AI to meet "diversity goals" in modelingAI ushering in a "post-plagiarism" era in writing"Wildly effective and dirt cheap AI therapy."Applying AI to "improve diagnosis for patients with rare diseases."Using LLMs in scientific researchHealth insurance company Cigna using AI to deny medical claims.AI for your wearable-based workoutYou can check out future livestreams at https://twitch.tv/DAIR_Institute. Follow us!Emily Twitter: https://twitter.com/EmilyMBender Mastodon: https://dair-community.social/@EmilyMBender Bluesky: https://bsky.app/profile/emilymbender.bsky.social Alex Twitter: https://twitter.com/@alexhanna Mastodon: https://dair-community.social/@alex Bluesky: https://bsky.app/profile/alexhanna.bsky.social Music by Toby Menon.Artwork by Naomi Pleasure-Park. Production by Christie Taylor.
Iain S. Thomas & Jasmine Wang: Can AI Answer Life’s Biggest Questions?
Listen to this episode from Sounds True: Insights at the Edge on Spotify. Mention to someone the words “artificial intelligence,” and chances are you’ll get a very emotional response. For some, the thought of AI triggers fear, anger, and suspicion; for others, great excitement and anticipation. In this podcast, Tami Simon speaks with technologist and philosopher Jasmine Wang along with poet Iain S. Thomas, coauthors of the new book What Makes Us Human? An Artificial Intelligence Answers Life’s Biggest Questions. Whatever your view on AI, we think you’ll find this conversation profoundly interesting and informative! Listen now as Tami, Jasmine, and Iain discuss the artificial intelligence known as GPT-3; holding an attitude of “critical techno optimism”; finding kinship with digital beings; the question of sentience; the sometimes “hallucinatory” nature of generative AI; the three main aspects of deep learning technology—classification, recommendation, and generation; AI as a creativity compounder; bringing a moral lens to the development and deployment of AI; the central human themes of presence, love, and interconnectedness; acting with intent and living with meaning; and more. Note: This episode originally aired on Sounds True One, where these special episodes of Insights at the Edge are available to watch live on video and with exclusive access to Q&As with our guests. Learn more at join.soundstrue.com.
Sonja Rattay on OpenAI & Ethics / Commercial Success
As a critical researcher of AI myself and experience as entrepreneur I know how hard it is to navigate the trade offs between surviving in the market and being…
A CRITICAL FIELD GUIDE FOR WORKING WITH MACHINE LEARNING DATASETS
Maybe you’re an engineer creating a new machine vision system to track birds. You might be a journalist using social media data to research Costa Rican households. You could be a researcher who stumbled upon your university’s archive of handwritten census cards from 1939. Or a designer creating a chatbot that relies on large language models like GPT-3. Perhaps you’re an artist experimenting with visual style combinations using DALLE-2. Or maybe you’re an activist with an urgent story that needs telling, and you’re searching for the right dataset to tell it.
re:publica 2018 – Mushon Zer-Aviv: The Political Tragedy of Data-Driven-Determinism
Find out more at: https://18.re-publica.com/node/24891Polls and predictions could not foresee the wide appeal of voting for Brexit, for Trump, against the pr...
SXSW Special Jury Award Winning documentary ANOTHER BODY follows American college student Taylor’s search for answers and justice after she discovers deepfake pornography of herself circulating online. She dives headfirst into the underground world of deepfakes, and discovers a growing culture of men terrorizing women—influencers, classmates, friends.
On artist Zach Blas's wide-ranging practice that scrutinizes the relationship between digital technologies and the cultures and politics that animate them.Za...
No Camera Cinema. A selection of AI-augmented teasers as artifacts, demonstrating a profound commitment to experimentation, inviting scrutiny and reflection,...
The long read: Artificial intelligence in its current form is based on the wholesale appropriation of existing culture, and the notion that it is actually intelligent could be actively dangerous
In an office in India, a cadre of Internet moderators ensures that social media sites are not taken over by bots, scammers, and pornographers. The Moderators...