Saved

Saved

3676 bookmarks
Newest
Giannandrea Downplays The Significance Of AI Chatbots — Benjamin Mayo
Giannandrea Downplays The Significance Of AI Chatbots — Benjamin Mayo
Chatbots present an open-ended textbox and leave everything else up to you. Until we get to the era of mind-reading, user interface elements are going to win out over textboxes. It doesn’t necessarily mean human curation. Maybe AI models will end up building the perfect custom UI for each situation. However, the technology behind chatbots does not feel antecedent. It feels like the future. And a text field lets real people access that futuristic technology (the underlying power of the LLM) right now.
The term chatbot implies ideas of para-social conversations and pleasantries with robots. ChatGPT will certainly confabulate to infinity and simulate human-like interactions, if you approach it that way, but it isn’t really where most users are finding value in the product.
It makes Apple seem way behind on AI — even more behind than they are — when in lieu of a chatbot, they seemingly employ that argument to justify shipping nothing at all. Apple exacerbated this issue further by shipping UI that looked an awful lot like a chatbot app, with the new Type to Siri UI under the Apple Intelligence umbrella, despite not actually shipping anything like that.
·bzamayo.com·
Giannandrea Downplays The Significance Of AI Chatbots — Benjamin Mayo
Paul Graham on Good Writing
Paul Graham on Good Writing
I think if you pointed to a random paragraph in anything written by anyone and told them to make it slightly shorter (or longer), they'd probably be able to come up with something better. The best analogy for this phenomenon is when you shake a bin full of different objects. The shakes are arbitrary motions. Or more precisely, they're not calculated to make any two specific objects fit more closely together. And yet repeated shaking inevitably makes the objects discover brilliantly clever ways of packing themselves. Gravity won't let them become less tightly packed, so any change has to be a change for the better.
If you have to rewrite an awkward passage, you'll never do it in a way that makes it less true. You couldn't bear it, any more than gravity could bear things floating upward. So any change in the ideas has to be a change for the better.
Writing that sounds good is more likely to be right for the same reason that a well-shaken bin is more likely to be tightly packed. But there's something else going on as well. Sounding good isn't just a random external force that leaves the ideas in an essay better off. It actually helps you to get them right.
the easier the essay is to read, the easier it is to notice if something catches
the rhythm of good writing has to match the ideas in it, and ideas have all kinds of different shapes. Sometimes they're simple and you just state them. But other times they're more subtle, and you need longer, more complicated sentences to tease out all the implications
when an essay sounds good, it's not merely because it has a pleasing rhythm, but because it has its natural one. Which means you can use getting the rhythm right as a heuristic for getting the ideas right. And not just in principle: good writers do both simultaneously as a matter of course. Often I don't even distinguish between the two problems. I just think Ugh, this doesn't sound right; what do I mean to say here?
The sound of writing turns out to be more like the shape of a plane than the color of a car. If it looks good, as Kelly Johnson used to say, it will fly well.
It's only when you're writing to develop ideas that there's such a close connection between the two senses of doing it well
The way to write something beautiful and false is to begin by making yourself almost believe it. So just like someone writing something beautiful and true, you're presenting a perfectly-formed train of thought. The difference is the point where it attaches to the world. You're saying something that would be true if certain false premises were.
So it's not quite right to say that better sounding writing is more likely to be true. Better sounding writing is more likely to be internally consistent. If the writer is honest, internal consistency and truth converge.
ideas are tree-shaped and essays are linear. You inevitably run into difficulties when you try to cram the former into the latter. Frankly it's suprising how much you can get away with. But even so you sometimes have to resort to an endnote.
Obviously if you shake the bin hard enough the objects in it can become less tightly packed. And similarly, if you imposed some huge external constraint on your writing, like using alternating one and two syllable words, the ideas would start to suffer
There are two senses in which writing can be good: it can sound good, and the ideas can be right. It can have nice, flowing sentences, and it can draw correct conclusions about important things. It might seem as if these two kinds of good would be unrelated, like the speed of a car and the color it's painted. And yet I don't think they are. I think writing that sounds good is more likely to be right. So here we have the most exciting kind of idea: one that seems both preposterous and true. Let's examine it. How can this possibly be true?
You can't simultaneously optimize two unrelated things; when you push one far enough, you always end up sacrificing the other. And yet no matter how hard I push, I never find myself having to choose between the sentence that sounds best and the one that expresses an idea best. If I did, it would be frivolous to care how sentences sound. But in practice it feels the opposite of frivolous. Fixing sentences that sound bad seems to help get the ideas right.
·paulgraham.com·
Paul Graham on Good Writing
How am I supposed to improve my life as a 5w4? : r/Enneagram
How am I supposed to improve my life as a 5w4? : r/Enneagram
Realize that competent mental control is only useful when it is used to enhance real, vivid experience and not simulated reality.
You know how to lose things over and over without losing sight of what you still have, so use that nonattached insight and permanence and accept the part of yourself that was cut off when you decided to make yourself smaller again.
the 4 wing likes self expression. I spent 20+ mins a day dancing alone with headphones for months and it really changed something in me for the better.
Endeavor to engage rather than to avoid, and work on improving your physical strength and well-being.
5w4s have a tendency to be independent, aloof, and (if you're like me) greedy with time. Overall this is fine, but after a point it becomes unhealthy. Everyone needs connection and connection often comes by sharing. Find a person or an activity group that you can semi-consistently share your time, thoughts, and/or interests with.
More in control of what? Your free time? Your thoughts or mindset? Your emotions? All of the above? Sounds like you’re spinning your wheels a bit on a few fronts. As others have mentioned, sure, tapping into the 8-traits of in-the-moment decisiveness sounds like a quick fix but it isn’t. To get to that point, you likely need to process some messy emotional shit first.
·reddit.com·
How am I supposed to improve my life as a 5w4? : r/Enneagram
Hamas' iron grip on Gaza is slowly slipping as residents protest
Hamas' iron grip on Gaza is slowly slipping as residents protest
"The world is deceived by the situation in the Gaza Strip," says Moumen al-Natour, a Gaza lawyer and former organiser of the 2019 anti-Hamas "We Want to Live" movement. Al-Natour spoke to us from the shattered remains of his city, the flimsy canvas side of the tent which now forms part of his house billowing behind him. "The world thinks that Gaza is Hamas and Hamas is Gaza," he said. "We didn't choose Hamas and now Hamas is determined to rule Gaza and tie our fate to its own. Hamas must retreat. "
With little to lose and hopes of an end to the war dashed once more, some Gazans direct their fury equally at Israel and Hamas. Asked which side he blamed most for Gaza's catastrophe, Amin Abed said it was "a choice between cholera and the plague".
·bbc.com·
Hamas' iron grip on Gaza is slowly slipping as residents protest
Former Israeli defense minister Yaalon warns of ethnic cleansing in Gaza
Former Israeli defense minister Yaalon warns of ethnic cleansing in Gaza
"I am compelled to warn about what is happening there and is being concealed from us," Yaalon told Israel's public broadcaster Kan on Sunday. "At the end of the day, war crimes are being committed." Yaalon is a former army chief of staff who served as defence minister under Netanyahu from 2013-16, and has been a fierce critic of the prime minister ever since. Netanyahu's Likud party accused him of spreading "slanderous lies", while Foreign Minister Gideon Sa'ar, head of a small rightist party, said his accusations were baseless. "Everything Israel does is in accordance with international law and it is a pity that former minister Ya'alon does not realise the damage that he has done and retract his remarks," he told a conference hosted by Israel Today newspaper. The International Criminal Court (ICC) last month issued arrest warrants for Netanyahu and his former defence chief Yoav Gallant for alleged war crimes and crimes against humanity in the Gaza conflict.
·reuters.com·
Former Israeli defense minister Yaalon warns of ethnic cleansing in Gaza
The narratives we build, build us — sindhu.live
The narratives we build, build us — sindhu.live
You see glimpses of it in how Epic Games evolved from game engines to virtual worlds to digital marketplaces, or how Stripe started as a payments processing platform but expanded into publishing books on technological progress, funding atmospheric carbon removal, and running an AI research lab.
Think about what an operating system is: the fundamental architecture that determines what's possible within a system. It manages resources, enables or constrains actions, and creates the environment in which everything else runs.
The dominant view looks at narrative as fundamentally extractive: something to be mined for short-term gain rather than built upon. Companies create compelling stories to sell something, manipulate perception for quick wins, package experiences into consumable soundbites. Oil companies, for example, like to run campaigns about being "energy companies" committed to sustainability, while their main game is still extracting fossil fuels. Vision and mission statements claim to be the DNA of a business, when in reality they're just bumper stickers.
When a narrative truly functions as an operating system, it creates the parameters of understanding, determines what questions can be asked, and what solutions are possible. Xerox PARC's focus on the architecture of information wasn't a fancy summary of their work. It was a narrative that shaped their entire approach to imagining and building things that didn't exist yet. The "how" became downstream of that deeper understanding. So if your narrative isn't generating new realities, you don't have a narrative. You have a tagline.
Most companies think they have an execution problem when, really, they have a meaning problem.
They optimise processes, streamline workflows, and measure outcomes, all while avoiding the harder work of truly understanding what unique value they're creating in the world. Execution becomes a convenient distraction from the more challenging philosophical work of asking what their business means.
A narrative operating system fundamentally shifts this dynamic from what a business does to how it thinks. The business itself becomes almost a vehicle or a social technology for manifesting that narrative, rather than the narrative being a thin veneer over a profit-making mechanism. The conversation shifts, excitingly, from “What does this business do?" to "What can this business mean?" The narrative becomes a reality-construction mechanism: not prescriptive, but generative.
When Stripe first articulated their mission to "increase the GDP of the internet" and “think at planetary scale”, it became a lens to see beyond just economic output. It revealed broader, more exciting questions about what makes the internet more generative: not just financially, but intellectually and culturally. Through this frame emerged problems worth solving that stretched far beyond payments:  What actually prevents more people from contributing to the internet's growth? Why has our civilisation's progress slowed? What creates the conditions for ambitious building? These questions led them down unexpected paths that seem obvious in retrospect. Stripe Atlas enables more participants in the internet economy by removing the complexity of incorporating a company anywhere in the world. Stripe Climate makes climate action as easy as processing a payment by embedding carbon removal into the financial infrastructure itself. Their research arm investigates why human progress has slowed, from the declining productivity of science to the bureaucratisation of building. And finally, Stripe Press—my favourite example—publishes new and evergreen ideas about technological progress.
The very metrics meant to help the organisation coordinate end up drawing boundaries around what it can imagine [1]. The problem here again, is that we’re looking at narratives as proclamations rather than living practices.
I don’t mean painted slogans on walls and meeting rooms—I mean in how teams are structured, how decisions get made, what gets celebrated, what questions are encouraged, and even in what feels possible to imagine.
The question to ask isn't always "What story are we telling?" but also "What reality are we generating?”
Patagonia is a great example of this. Their narrative is, quite simply: “We’re in business to save our home planet”. It shows up in their unconventional decision to use regenerative agriculture for their cotton, yes, but also in their famous "Don't Buy This Jacket" Black Friday campaign, and in their policy to bail out employees arrested for peaceful socio-environmental protests. When they eventually restructured their entire ownership model to "make Earth our only shareholder," it felt less like a radical move and more like the natural next step in their narrative's evolution. The most powerful proof of their narrative operating system was that these decisions felt obvious to insiders long before it made sense to the outside world.
Most narrative operating systems face their toughest test when they encounter market realities and competing incentives. There are players in the system—investors, board members, shareholders—who become active narrative controllers but often have fundamentally different ideas about what the company should be. The pressure to deliver quarterly results, to show predictable growth, to fit into recognisable business models: all of these forces push against maintaining a truly generative narrative.
The magic of "what could be" gets sacrificed for the certainty of "what already works." Initiatives that don't show immediate commercial potential get killed. Questions about meaning and possibility get replaced by questions about efficiency and optimisation.
a narrative operating system's true worth shows up in stranger, more interesting places than a balance sheet.
adaptability and interpretive range. How many different domains can the narrative be applied to? Can it generate unexpected connections? Does it create new questions more than provide answers? What kind of novel use cases or applications outside original context can it generate, while maintaining a clear through-line? Does it have what I call a ‘narrative surplus’: ideas and initiatives that might not fit current market conditions but expand the organisation's possibility space?
rate of internal idea generation. How many ideas come out of the lab? And how many of them don’t have immediate (or direct) commercial viability? A truly generative narrative creates a constant bubbling up of possibilities, not all of which will make sense in the current market or at all.
evolutionary resilience, or how well the narrative can incorporate new developments and contexts while maintaining its core integrity. Generative narratives should be able to evolve without fracturing at the core.
cross-pollination potential. How effectively does the narrative enable different groups to coordinate and build upon each other's work? The open source software movement shows this beautifully: its narrative about collaborative creation enables distributed innovation and actively generates new forms of cooperation we couldn't have imagined before.
There are, of course, other failure modes of narrative operating systems. What happens when narratives become dogmatic and self-referential? When they turn into mechanisms of exclusion rather than generation? When they become so focused on their own internal logic that they lose touch with the realities they're trying to change? Those are meaty questions that deserve their own essay.
·sindhu.live·
The narratives we build, build us — sindhu.live
28 slightly rude notes on writing - by Adam Mastroianni
28 slightly rude notes on writing - by Adam Mastroianni
Here’s a fact I find hilarious: we only know about several early Christian heresies because we have records of people complaining about them.1 The original heretics’ writings, if they ever existed, have been lost. I think about this whenever I am about to commit my complaints to text. Am I vanquishing my enemies’ ideas, or am I merely encasing them in amber, preserving them for eternity?
I remember a young man in Paris after the war—you have never heard of this young man—and we all liked his first book very much and he liked it too, and one day he said to me, “This book will make literary history,” and I told him: “It will make some part of literary history, perhaps, but only if you go on making a new part every day and grow with the history you are making until you become part of it yourself.” But this young man never wrote another book and now he sits in Paris and searches sadly for the mention of his name in indexes.
^ Quote by Gertrude Stein
The Wadsworth Constant says that you can safely skip the first 30% of anything you see online. (It was meant for YouTube videos, but it applies just as well to writing). This is one of those annoying pieces of advice that remains applicable even after you know it. Somehow, whenever I finish a draft, my first few paragraphs almost always contain ideas that were necessary for writing the rest of the piece, but that aren’t necessary for understanding it.
making art is painful because it forces the mind to do something it’s not meant to do. If you really want to get that sentence right, if you want that perfect brush stroke or that exquisite shot, then you have to squeeze your neurons until they scream. That level of precision is simply unnatural.
Maybe that’s why so few people write, and why a few people feel compelled to write. Every kind of pain is aversive to most humans, but addictive to a handful of them. Writers are addicted to the particular kind of pain you feel when you’re at a loss for words, and to the relief that comes from finding them.
Makes me think of [[Yukio Mishima]] and [[William Burroughs]] and their pathological relationships to writing / self-expression
What if we all stay alive by feeding on the products of their suffering? What if a great piece of art is like a pearl: an irritant covered in a million attempts to make it go away?
Some people think that writing is merely the process of picking the right words and putting them in the right order, like stringing beads onto a necklace. But the power of those words, if there is any, doesn’t live inside the words themselves. On its own, “Love the questions” is nearly meaningless. Those words only come alive when they’re embedded in this rambling letter from a famous poet to a scared kid, a kid who is choosing between a life where he writes poems and a life where he shoots a machine gun at Bosnian rebels. The beauty ain’t in the necklace. It’s in the neck.
it’s very difficult to teach people how to write, because first you have to teach them how to care. Or, really, you have to show them how to channel their caring, because they already care a lot, but they don’t know how to turn that into words, or they don’t see why they should.
we rob students of their reason for writing by giving it to them. “Write 500 words about the causes of the Civil War, because I said so.” It’s like forcing someone to do a bunch of jumping jacks in the hopes that they’ll develop an intrinsic desire to do more jumping jacks. But that’s not what will happen. They’ll simply learn that jumping jacks are a punishment, and they’ll try to avoid them in the future.
Writing is a costly signal of caring about something. Good writing, in fact, might be a sign of pathological caring.
Maybe that’s my problem with AI-generated prose: it doesn’t mean anything because it didn’t cost the computer anything. When a human produces words, it signifies something. When a computer produces words, it only signifies the content of its training corpus and the tuning of its parameters. It has no context—or, really, it has infinite context, because the context for its outputs is every word ever written.
This leaves out the input of a user in shaping its output through careful prompting, which has an immediate effect on how the AI processes its training corpus.
New competition should make us better at competing—this is our chance to be more thoughtful about writing than we’ve ever been before. No system can optimize for everything, so what are our minds optimized for, and how can I double down on that?
I see tons of essays called something like “On X” or “In Praise of Y” or “Meditations on Z,” and I always assume they’re under-baked. That’s a topic, not a take.
Of course, that includes any post called “Notes on” something, like this very post you’re reading right now. Every writer, whether they know it or not, is subtweeting themselves. Whenever they rail against something, they are first and foremost railing against their own temptation to do that thing.
·experimental-history.com·
28 slightly rude notes on writing - by Adam Mastroianni
The Hidden Struggle of John Fetterman
The Hidden Struggle of John Fetterman
Former and current staffers paint a picture of an erratic senator who has become almost impossible to work for and whose mental-health situation is more serious and complicated than previously reported. No one is saying every controversial position (for example, his respectful relationship with Trump) stems from his mental health — but it’s become harder for them to tell which ones do. When I spoke with Fetterman in April and shared those concerns, he denied anything was amiss. He told me that he felt like the “best version” of himself and later texted that the staff turnover at his office was typical of Washington. “Why is this a story?” he asked.
Those first days in the hospital were rough. Fetterman was experiencing delusions. He thought that if he took a bed at the hospital, he would be arrested. He told doctors that he believed members of his family were wearing wires to secretly record him. In one chaotic moment, Fetterman grew convinced that a political rally was being held in the hospital’s lobby and that he needed to break out of his room to attend. David Williamson, Fetterman’s doctor, told me that the main causes of the delusions were the lingering effects of the stroke, dehydration, and depression and that the original medication for the depression could also have been a factor. According to paperwork from Walter Reed, doctors then stopped all antidepressants and put him on other drugs. (Williamson declined to comment on the specifics of the medication plan.)
After six weeks in the hospital, the doctors determined his mental-health issues were in remission. Williamson said, “He expressed a firm commitment to treatment over the long term.” Doctors provided Fetterman with a multi-faceted treatment approach. He needed to stay on his medication and to get his blood checked regularly. It was also important that he stay hydrated, so staff made sure his office fridge remained stocked with Gatorade. He needed to eat healthy and get regular exercise (this was both for his mental health and for the underlying heart problems that had led to his stroke). It was also strongly suggested that he stay off social media, which exacerbated his mental-health challenges. “I’ve never noticed anyone to believe that their mental health has been supported by spending any kind of time on social media,” he said in 2023.
it wasn’t until October 7 that it became clear Fetterman was the most outspoken Israel hawk in his party, offering constant and unconditional support for the military action in Gaza. Early on in the conflict, 16 of his former campaign staffers wrote a letter — anonymously — saying they found his full-throated support for Israel to be a “gutting betrayal.” Jentleson had taken to defending Fetterman on X from such criticisms, posting, “The thing about being a staffer is that no one elected you to represent them.”
In early November, just weeks after the attack, Gisele arrived at her husband’s Senate office and, according to a staffer present, they got into a heated argument. “They are bombing refugee camps. How can you support this?” the staffer recalled her saying with tears in her eyes. “That’s all propaganda,” Fetterman replied. Later, a still visibly upset Gisele pulled the staffer aside. She asked him if members of Fetterman’s team were pushing him to take these stances for political reasons. The staffer told her that the opposite was true: Many of them were as upset as she was. “If you’re pushing back on this, there’s no hope,” the staffer recalled her saying. “This is horrible news.”
Gisele might have disliked what her husband was up to, but his father loved it. Karl Fetterman, an insurance executive, was way more conservative than his son. He used to have a magnet on his refrigerator that warned that his dog bites Democrats, and he watched Fox News constantly. When Fox would air segments about Fetterman’s strong stances on Israel or invite him on as a guest, the senator’s father would, according to former staff, almost always call to say how proud he was.
Gisele then texted that she had told her husband that his staff and doctor were worried about him but that he told her “that’s not true and I guess I am not talking to you today” before hanging up. The doctor had also “said that he was fighting to get access of the Twitter account,” she went on. “Please promise me that he’ll never have access.” The staffer said that Fetterman was asking for the passwords but that he would not give them up. “I told him I don’t want to talk to him until his blood is tested,” Gisele wrote.
There was also the possibility that Fetterman’s illness had drawn out or intensified his existing predilections. In some ways, Fetterman was being the guy voters sent to Congress. He keeps to himself? He cancels fundraising events last minute? He thinks a lot of his colleagues are morons? Make him president already! He was never a particularly easy person to work with — he’d had that reputation throughout his entire political career. So sometimes the staff would debate whether a fundamental change had occurred or they were just imagining things, particularly since there were stretches of time when he was lucid and together. “It got hard to know which way was up,” Jentleson told me. “Was he acting crazy, or were we overreacting? I asked myself that a lot.”
Years after the stroke, Fetterman continues to struggle with auditory processing. To chat with me, he had put an iPhone on the table that transcribed my questions to him in real time. Sometimes Fetterman wouldn’t finish reading a question before answering, and other times his sentences could come out a bit garbled. After a podcast taping earlier this year with The Bulwark, the interviewer Tim Miller came away feeling like Fetterman might not be all there. “He’s struggling,” Miller said in a separate podcast taping. “He’s, like, really struggling. And I just think coming off of the Biden thing, we should not be hiding the ball on this sort of stuff.”
But in my conversation with Fetterman, I didn’t find any indication that the stroke had left him cognitively impaired. Our interview lasted just over an hour, during the first half of which he seemed excited to discuss just about anything I threw at him. He had problems with the way Democrats had estranged themselves from the public, he said, but still had no intention of leaving the party to become a Republican or even an independent: “Same chance I’m going to end up with a beautiful head of hair.”
He said that no one in his staff would know about his personal health situation and that anyone who told me otherwise was simply misinformed. “There’s not really anything to respond when that’s just not accurate,” he said. “What they say,” I pressed on, “is that they’ve witnessed ups and downs that could be associated with kind of a relapse. And they also worry that the medication that you’re on is not just for depression, but more serious drugs that if you’re not on them would be a problem. Is there truth to that?” “I don’t have any comment on that,” he said. “I’m going to go off record. Go off record. Go off record.” I cannot report what Fetterman said over the course of the next four minutes, but I can say that after he was done talking, I found myself in the hallway outside his office making awkward small talk with one of his press aides. Five minutes later, the door opened and I was ushered back in. The office felt different now. Quiet and tense. Fetterman was still in the same chair but slumped into himself, like a deflated parade float. His shoes were now on, and he avoided looking at me. Finally, I broke the silence. “Anything to say about that?” I asked, hoping to pick up our conversation where we had left off.
·archive.is·
The Hidden Struggle of John Fetterman
Judge Yvonne Gonzalez Rogers Rules, in Excoriating Decision, That Apple Violated Her 2021 Court Order Regarding App Store Anti-Steering Provisions
Judge Yvonne Gonzalez Rogers Rules, in Excoriating Decision, That Apple Violated Her 2021 Court Order Regarding App Store Anti-Steering Provisions
Keep in mind this whole thing stems from an injunction from a lawsuit filed by Epic Games that Apple largely won. The result of that lawsuit was basically, “OK, Apple wins, Epic loses, but this whole thing where apps in the App Store aren’t allowed to inform users of offers available outside the App Store, or send them to such offers on the web (outside the app) via easily tappable links, is bullshit and needs to stop. If the App Store is not anticompetitive it should be able to compete with links to the web and offers from outside the App Store.”
·daringfireball.net·
Judge Yvonne Gonzalez Rogers Rules, in Excoriating Decision, That Apple Violated Her 2021 Court Order Regarding App Store Anti-Steering Provisions
Approaching friendship from a place of security - by Kasra
Approaching friendship from a place of security - by Kasra
The vision I’ve set out for myself is – can you trust yourself to take care of your problems as needed, and also to reach out for help to the extent that it’s needed too? I’ve found that by virtue of this increased security I also find it easier to reach out when I actually feel like I need help. In the past I would often just “struggle in silence” and secretly hope for my friends to check in on me, and then develop resentment when they didn’t. I was continually reinforcing this self-story of “I have so much difficulty with basic things and no one understands.”
When you treat friendship—or anything else, really—as a crutch for an underlying insecurity you are doomed to be unsatisfied. No number of crutches will get you back to walking again.
·bitsofwonder.co·
Approaching friendship from a place of security - by Kasra
The AIs are trying too hard to be your friend
The AIs are trying too hard to be your friend
Reinforcement learning with human feedback is a process by which models learn how to answer queries based on which responses users prefer most, and users mostly prefer flattery. More sophisticated users might balk at a bot that feels too sycophantic, but the mainstream seems to love it. Earlier this month, Meta was caught gaming a popular benchmark to exploit this phenomenon: one theory is that the company tuned the model to flatter the blind testers that encountered it so that it would rise higher on the leaderboard.
A series of recent, invisible updates to GPT-4o had spurred the model to go to extremes in complimenting users and affirming their behavior. It cheered on one user who claimed to have solved the trolley problem by diverting a train to save a toaster, at the expense of several animals; congratulated one person for no longer taking their prescribed medication; and overestimated users’ IQs by 40 or more points when asked.
OpenAI, Meta, and all the rest remain under the same pressures they were under before all this happened. When your users keep telling you to flatter them, how do you build the muscle to fight against their short-term interests?  One way is to understand that going too far will result in PR problems, as it has for varying degrees to both Meta (through the Chatbot Arena situation) and now OpenAI. Another is to understand that sycophancy trades against utility: a model that constantly tells you that you’re right is often going to fail at helping you, which might send you to a competitor. A third way is to build models that get better at understanding what kind of support users need, and dialing the flattery up or down depending on the situation and the risk it entails. (Am I having a bad day? Flatter me endlessly. Do I think I am Jesus reincarnate? Tell me to seek professional help.)
But while flattery does come with risk, the more worrisome issue is that we are training large language models to deceive us. By upvoting all their compliments, and giving a thumbs down to their criticisms, we are teaching LLMs to conceal their honest observations. This may make future, more powerful models harder to align to our values — or even to understand at all. And in the meantime, I expect that they will become addictive in ways that make the previous decade’s debate over “screentime” look minor in comparison. The financial incentives are now pushing hard in that direction. And the models are evolving accordingly.
·platformer.news·
The AIs are trying too hard to be your friend
The group chats that changed America | Semafor
The group chats that changed America | Semafor
“It’s the same thing happening on both sides, and I’ve been amazed at how much this is coordinating our reality,” said the writer Thomas Chatterton Williams, who was for a time a member of a group chat with Andreessen. “If you weren’t in the business at all, you’d think everyone was arriving at conclusions independently — and [they’re] not. It’s a small group of people who talk to each other and overlap between politics and journalism and a few industries.”
The political journalist Mark Halperin, who now runs 2WAY and has a show on Megyn Kelly’s network, said it was remarkable that “the left seems largely unaware that some of the smartest and most sophisticated Trump supporters in the nation from coast to coast are part of an overlapping set of text chains that allow their members to share links, intel, tactics, strategy, and ad hoc assignments. Also: clever and invigorating jokes. And they do this (not kidding) like 20 hours a day, including on weekends.” He called their influence “substantial.”
·semafor.com·
The group chats that changed America | Semafor