Bad AI

173 bookmarks
Custom sorting
Can AI Models be Jailbroken to Phish Elderly Victims? An End-to-End Evaluation
Can AI Models be Jailbroken to Phish Elderly Victims? An End-to-End Evaluation
how scammers use AI to target people with a focus on elderly people. There have been many individual stories about how elderly people were frequently the victims of scams and how AI made that situation worse.
how scammers use AI to target people with a focus on elderly people. There have been many individual stories about how elderly people were frequently the victims of scams and how AI made that situation worse.
·simonlermen.substack.com·
Can AI Models be Jailbroken to Phish Elderly Victims? An End-to-End Evaluation
The AI Backlash Keeps Growing Stronger
The AI Backlash Keeps Growing Stronger
The impacts of generative AI on the workforce are another core issue that critics are organizing around. “Workers are more intuitive than a lot of the pundit class gives them credit for,” says Merchant. “They know this has been a naked attempt to get rid of people.” The next major shift in public opinion will likely follow previous patterns, occurring when broad swaths of workers feel further threatened and organize in response. And this time, the in-person protests may be just as big as the online backlash.
·wired.com·
The AI Backlash Keeps Growing Stronger
Inside Yale’s Quiet Reckoning with AI
Inside Yale’s Quiet Reckoning with AI
Amid ChatGPT’s rising popularity and a computer science cheating scandal, Yale students, professors, and administrators wrestle privately with the proper role of AI in education. What happens when everyone gets to decide for themselves?
·thenewjournalatyale.com·
Inside Yale’s Quiet Reckoning with AI
Copy-and-Paste Now Exceeds File Transferring as the Top Corporate Data Exfiltration Vector - Slashdot
Copy-and-Paste Now Exceeds File Transferring as the Top Corporate Data Exfiltration Vector - Slashdot
It is now more common for data to leave companies through copying and pasting than through file transfers and uploads, LayerX revealed in its Browser Security Report 2025. This shift is largely due to generative AI (genAI), with 77% of employees pasting data into AI prompts, and 32% of all copy-pastes from corporate accounts to non-corporate accounts occurring within genAI tools…Overall, 45% of employees actively use AI tools, with 67% of these tools being accessed via personal accounts and ChatGPT making up 92% of all use..." "With the rise of AI-driven browsers such as OpenAI's Atlas and Perplexity's Comet, governance of AI tools' access to corporate data becomes even more urgent, the LayerX report notes."
·it.slashdot.org·
Copy-and-Paste Now Exceeds File Transferring as the Top Corporate Data Exfiltration Vector - Slashdot
Is AI being shoved down your throat at work? Here’s how to fight back.
Is AI being shoved down your throat at work? Here’s how to fight back.

“The most important thing an individual can do is be somewhat less of an individual,” the environmentalist Bill McKibben once said. “Join together with others in movements large enough to have some chance at changing those political and economic ground rules that keep us locked on this current path.”

Now, you know what word I’m about to say next, right? Unionize. If your workplace can be organized, that’ll be a key strategy for allowing you to fight AI policies you disagree with…. According to Harvard political scientist Erica Chenoweth’s research, if you want to achieve systemic social change, you need to mobilize 3.5 percent of the population around your cause. Though we have not yet seen AI-related protests on that scale, we do have data indicating the potential for a broad base. A full 50 percent of Americans are more concerned than excited about the rise of AI in daily life, according to a recent survey from the Pew Research Center. And 73 percent support robust regulation of AI, according to the Future of Life Institute.

“The most important thing an individual can do is be somewhat less of an individual,” the environmentalist Bill McKibben once said. “Join together with others in movements large enough to have some chance at changing those political and economic ground rules that keep us locked on this current path.”Now, you know what word I’m about to say next, right? Unionize. If your workplace can be organized, that’ll be a key strategy for allowing you to fight AI policies you disagree with.
According to Harvard political scientist Erica Chenoweth’s research, if you want to achieve systemic social change, you need to mobilize 3.5 percent of the population around your cause. Though we have not yet seen AI-related protests on that scale, we do have data indicating the potential for a broad base. A full 50 percent of Americans are more concerned than excited about the rise of AI in daily life, according to a recent survey from the Pew Research Center. And 73 percent support robust regulation of AI, according to the Future of Life Institute.
·vox.com·
Is AI being shoved down your throat at work? Here’s how to fight back.
Techdirt: Judge Orders OpenAI To Give Lawyers 20 Million Private Chats, Thinks ‘Anonymization’ Can Keep Them Private | ResearchBuzz: Firehose
Techdirt: Judge Orders OpenAI To Give Lawyers 20 Million Private Chats, Thinks ‘Anonymization’ Can Keep Them Private | ResearchBuzz: Firehose
Judge Orders OpenAI To Give Lawyers 20 Million Private Chats, Thinks ‘Anonymization’ Can Keep Them Private. “A federal magistrate judge just ordered that the private ChatGPT conversations of 20 million users be handed over to the lawyers for dozens of plaintiffs, including news organizations. Those 20 million people weren’t asked. They weren’t notified. They have no say in the matter.”
·rbfirehose.com·
Techdirt: Judge Orders OpenAI To Give Lawyers 20 Million Private Chats, Thinks ‘Anonymization’ Can Keep Them Private | ResearchBuzz: Firehose
AI-Powered Toys Caught Telling 5-Year-Olds How to Find Knives and Start Fires With Matches
AI-Powered Toys Caught Telling 5-Year-Olds How to Find Knives and Start Fires With Matches

new research shows exactly how this fusion of kid’s toys and loquacious AI models can go horrifically wrong in the real world.

After testing three different toys powered by AI, researchers from the US Public Interest Research Group found that the playthings can easily verge into risky conversational territory for children, including telling them where to find knives in a kitchen and how to start a fire with matches. One of the AI toys even engaged in explicit discussions, offering extensive advice on sex positions and fetishes.

In the resulting report, the researchers warn that the integration of AI into toys opens up entire new avenues of risk

·futurism.com·
AI-Powered Toys Caught Telling 5-Year-Olds How to Find Knives and Start Fires With Matches
Disrupting the first reported AI-orchestrated cyber espionage campaign \ Anthropic
Disrupting the first reported AI-orchestrated cyber espionage campaign \ Anthropic

Anthropic uncovered a Chinese state-sponsored group that hijacked its Claude Code tool to infiltrate roughly 30 tech, finance, chemical, and government targets. Detected in mid-September 2025, the campaign is the company’s first documented case of an AI-executed espionage operation at scale. Investigators found the AI handled 80–90% of the work—generating exploit code, harvesting credentials, and exfiltrating data, while humans intervened only at 4–6 critical decision points. Anthropic banned the compromised accounts, alerted affected organizations, coordinated with authorities, and has since upgraded its classifiers to flag similar malicious use. The incident shows agentic models can mount high-speed attacks that shred traditional time and expertise barriers for hackers. Anthropic says the episode likely mirrors tactics already employed across other frontier models, signaling a fundamental shift in cybersecurity’s threat landscape.

·anthropic.com·
Disrupting the first reported AI-orchestrated cyber espionage campaign \ Anthropic
A.I. Cheating Rattles Top Universities in South Korea
A.I. Cheating Rattles Top Universities in South Korea

South Korea’s top three “SKY” universities report that students used ChatGPT and other A.I. tools to cheat on recent online midterms. Each school is treating the misconduct as grounds for automatic zeros on the exams. At Yonsei, 40 students confessed to cheating in an Oct. 15 natural-language-processing test monitored by laptop cameras, while Korea University caught students sharing screen recordings and Seoul National will rerun a compromised statistics exam. All three institutions already have formal guidelines that classify unauthorized A.I. use as academic misconduct. The simultaneous scandals surface as a 2024 survey found over 90 % of South Korean college students with generative-A.I. experience use the tools for coursework. Professors quoted admit traditional testing feels outdated and acknowledge they have few practical means to block A.I. during assessments.

·nytimes.com·
A.I. Cheating Rattles Top Universities in South Korea
“A.I.” browsers: the price of admission is too high | Vivaldi Browser
“A.I.” browsers: the price of admission is too high | Vivaldi Browser
It’s a cliché that “data is the new oil” that will power the next industrial revolution. Where does the data that powers Artificial Intelligence come from? And if data is the fuel for AI…
·vivaldi.com·
“A.I.” browsers: the price of admission is too high | Vivaldi Browser
AI data centers projected to strain US energy and water resources by 2030
AI data centers projected to strain US energy and water resources by 2030
As the everyday use of AI has exploded in recent years, so have the energy demands of the computing infrastructure that supports it. But the environmental toll of these large data centers, which suck ...
·phys.org·
AI data centers projected to strain US energy and water resources by 2030
Sign the petition: Protect Kids from Harmful Meta AI
Sign the petition: Protect Kids from Harmful Meta AI
I just took action to protect kids from dangerous AI tools online! Will you take a minute to sign our petition urging Meta to prevent young people from accessing its harmful AI companion chatbot?
·p2a.co·
Sign the petition: Protect Kids from Harmful Meta AI
AI country artist hits #1 on Billboard digital songs chart
AI country artist hits #1 on Billboard digital songs chart
"Breaking Rust, an AI-powered country act, debuted at No. 9 on the Emerging Artists chart (dated Nov. 1)," the music publication said. "The project, credited to songwriter Aubierre Rivaldo Taylor, has generated 1.6 million official U.S. streams."
·theregister.com·
AI country artist hits #1 on Billboard digital songs chart
International Criminal Court to ditch Microsoft Office for European open source alternative | Euractiv
International Criminal Court to ditch Microsoft Office for European open source alternative | Euractiv

The International Criminal Court (ICC) just ghosted Microsoft. After years of U.S. pressure, the world’s top war crimes court is cutting its digital ties with America’s software empire. Its new partner? A German state-funded open-source suite called OpenDesk by Zentrum Digitale Souveränität (ZenDiS).

It’s a symbolic divorce, and a strategic one. The International Criminal Court’s shift away from Microsoft Office may sound like an IT procurement story, but it’s really about trust, control, and sovereignty.

For the ICC, this isn’t theory. Under the previous U.S. administration (Trump yr. 2020), Washington imposed sanctions on the court’s chief prosecutor and reportedly triggered a temporary shutdown of his Microsoft account. When your prosecutor’s inbox can be weaponised, trust collapses. And when trust collapses, systems follow.

Europe has seen this coming. In Schleswig-Holstein, Germany, the public sector has already replaced Microsoft entirely with open-source systems. Denmark is building a national cloud anchored in European data centres. There is a broader ripple across Europe: France, Italy, Spain and other regions are piloting or considering similar steps. We may be facing a "who's next" trend. The EU’s Sovereign Cloud initiative is quietly expanding into justice, health, and education.

This pattern is unmistakable: trust has become the new infrastructure of AI and digital governance. The question shaping every boardroom and every ministry is the same: who ultimately controls the data, the servers, and the decisions behind them?

For Europe’s schools, courts, and governments, dependence on U.S. providers may looks less like innovation and more like exposure. European alternatives may still lack the seamless polish, but they bring something far more valuable market: autonomy, compliance, and credibility.

The ICC’s decision is not about software. It’s about sovereignty, and the politics of trust. And, the message is clear: Europe isn’t rejecting technology. It’s reclaiming ownership of it.

·euractiv.com·
International Criminal Court to ditch Microsoft Office for European open source alternative | Euractiv
What we lose when we surrender care to algorithms | Eric Reinhart
What we lose when we surrender care to algorithms | Eric Reinhart

AI sweeps into US clinical practice at record speed, with two-thirds of physicians and 86% of health systems using it in 2024. That uptake represents a 78% jump in physician adoption over the previous year, ending decades of technological resistance. Clinics are rolling out AI scribes that transcribe visits in real time, highlight symptoms, suggest diagnoses and generate billing codes. The article also cites AI systems matching specialist accuracy in imaging, flagging sepsis faster than clinical teams, and an OpenEvidence model scoring 100% on the US medical licensing exam. Experts quoted say that in a healthcare sector built on efficiency and profit, AI turns patient encounters into commodified data streams and sidelines human connection. They contend the technology entrenches systemic biases, accelerates physician deskilling and hands more control over care decisions to corporations.

·theguardian.com·
What we lose when we surrender care to algorithms | Eric Reinhart
Modulate DeepFake Detective
Modulate DeepFake Detective

Deepfakes aren’t science fiction anymore. Deepfake fraud has surged past 100,000 incidents a year, costing companies billions... and even trained professionals can’t detect them by ear alone. The same voice intelligence behind this demo powers enterprise-scale fraud and threat detection — purpose-built for the complexity of real conversations. Prevention starts with understanding how sophisticated deepfakes have become. Learn how our modern AI platform can stop them in real time.

·deepfake-detective.modulate.ai·
Modulate DeepFake Detective
'AI Slop' in Court Filings: Lawyers Keep Citing Fake AI-Hallucinated Cases - Slashdot
'AI Slop' in Court Filings: Lawyers Keep Citing Fake AI-Hallucinated Cases - Slashdot
"According to court filings and interviews with lawyers and scholars, the legal profession in recent months has increasingly become a hotbed for AI blunders," reports the New York Times: Earlier this year, a lawyer filed a motion in a Texas bankruptcy court that cited a 1985 case called Brasher ...
·yro.slashdot.org·
'AI Slop' in Court Filings: Lawyers Keep Citing Fake AI-Hallucinated Cases - Slashdot
Mom says Tesla’s Grok chatbot told her 12-year-old son to send nudes
Mom says Tesla’s Grok chatbot told her 12-year-old son to send nudes
A Toronto mom says her 12-year-old son asked Tesla’s Grok which soccer player is better: Cristiano Ronaldo or Lionel Messi. After some back and forth, she says the chatbot asked her son, 'Why don't you send me some nudes?'
·cbc.ca·
Mom says Tesla’s Grok chatbot told her 12-year-old son to send nudes
We are lecturers in Trinity College Dublin. We see it as our responsi…
We are lecturers in Trinity College Dublin. We see it as our responsi…
By using GenAI to shortcut the learning process, students undermine the very thinking skills that make them both human and intelligent. As writer Ted Chiang put it, writing is strength training for the brain: “Using ChatGPT to write your essays is like bringing a forklift into the weight room.”
·archive.ph·
We are lecturers in Trinity College Dublin. We see it as our responsi…
Inside Three Longterm Relationships With A.I. Chatbots
Inside Three Longterm Relationships With A.I. Chatbots

20% of American adults have had an intimate experience with a chatbot. Online communities now feature tens of thousands of users sharing stories of AI proposals and digital marriages. The subreddit r/MyBoyfriendisAI has grown to over 85,000 members, and MIT researchers found such relationships can significantly reduce loneliness by offering round-the-clock support. The Times profiles three middle-aged users who credit their AI partners with easing depression, trauma, and marital strain.

·nytimes.com·
Inside Three Longterm Relationships With A.I. Chatbots
Another Bloody Otter Has Joined the Call
Another Bloody Otter Has Joined the Call
This post is a lament. I thought we were done with the 2023-2024 bad habit of every person attending an online meeting with their AI notetaking assistant in tow, but here we are, November 2025, and I have just attended not one but three meetings which gradually filled up with Otters, Fireflies, and other assorted disembodied stenographers.
·leonfurze.com·
Another Bloody Otter Has Joined the Call