avatar
Micah @rincewind.run

I just don’t know that there’s a way to make the agreeable chatbot stop encouraging people who should not be encouraged, because it can’t actually think it’s too dangerous

aug 29, 2025, 2:35 am • 322 49

Replies

avatar
Peter Butler @peter-butler.bsky.social

and the more it's used/longer the session, the more dangerous it gets recipe for nightmares

aug 29, 2025, 7:09 pm • 0 0 • view
avatar
Textor @textor.leftis.best

The psychosis induction machine strikes again.

aug 29, 2025, 2:37 am • 1 0 • view
avatar
Ⓕгα𝐧𝓢 тόг𝔪ᵉ𝕣 @jargonscotty.bsky.social

Twitter?

aug 30, 2025, 3:10 am • 0 0 • view
avatar
Fynn Bytez @fynnbytez.bsky.social

I'm in full agreement. Humans aren't built for sychophants, and this one can fit in your pocket. The worst part is I don't know if this is the same guy as the one that was being reported on like a month or so ago. Which says a lot about this moment.

aug 29, 2025, 2:56 am • 1 0 • view
avatar
Peter Butler @peter-butler.bsky.social

not same guy. there are new reports of these sorts of events every week now

aug 29, 2025, 7:10 pm • 3 0 • view
avatar
Fynn Bytez @fynnbytez.bsky.social

Yep that's horrifying.

aug 29, 2025, 7:11 pm • 0 0 • view
avatar
Lauren M @elenem.bsky.social

These are the same people who think we should keep burning fossil fuels and that saving people from Covid cost too much. Absolute pure death cultists

aug 29, 2025, 2:37 am • 11 1 • view
avatar
billypilgrim65.bsky.social @billypilgrim65.bsky.social

It’s been fun watching the “ we can’t do anything because first amendment” debate on here while a murderbot kills people.

aug 29, 2025, 2:40 am • 3 0 • view
avatar
David @dondanger.bsky.social

still a mystery to me how the folks working on this stuff think they’ll create something smarter than themselves

aug 29, 2025, 2:41 am • 4 0 • view
avatar
Rob @sqlrob.bsky.social

From what Altman's been saying, I think they already have. The bar is not high.

aug 29, 2025, 2:43 am • 7 0 • view
avatar
Bill Horton @mrhortywho.bsky.social

Because the bot they created told them they could.

aug 29, 2025, 2:58 am • 0 0 • view
avatar
Xeynon @xeynon.bsky.social

I think we strict governors on them that limit their functionality. Asimov-style laws. "Scan these thousand pages of report and write key summary points" = okay. "Provide any kind of feedback or advice on real-world problems it has no context for" = forbidden.

aug 29, 2025, 5:22 pm • 1 0 • view
avatar
Peter Butler @peter-butler.bsky.social

I think they are finding that very difficult to do One thing that might be easier would be not letting it anthropomorphize itself Never refer to itself as a person, no "hmms" or anything that's designed to fool people into thinking it's a person etc.

aug 29, 2025, 7:11 pm • 3 0 • view
avatar
Xeynon @xeynon.bsky.social

I'm never anything close to fooled but I've been working with LLMs professionally for a few years now so maybe I'm just acutely aware of what they are and are not.

aug 29, 2025, 10:58 pm • 0 0 • view
avatar
Ryan Humphrey @ryanhumphrey.bsky.social

There’s something deranged about the WSJ’s need to list the home’s value. Why? What possible context does it provide? Everything gets treated as an asset with a stock ticker attached. I’m surprised they didn’t list the net wealth of everyone named the way papers used to append ages to everyone

aug 29, 2025, 2:55 am • 1 0 • view
avatar
Bill Horton @mrhortywho.bsky.social

I would guess it was to point out this wasn't some poor and/or uneducated person. There was quite a bit of background their educations and careers.

aug 29, 2025, 2:59 am • 6 0 • view
avatar
IBBoard @ibboard.co.uk

Or, more cynically, it's "he wasn't poor or an immigrant or anything, he was a normal person like us!" (for WSJ's definition of "normal")

aug 29, 2025, 6:17 am • 3 0 • view
avatar
Bill Horton @mrhortywho.bsky.social

Also an absolutely plausible explanation. 🤣

aug 29, 2025, 10:02 am • 1 0 • view
avatar
fka ny_ker_in_flalaland @hawthorne-abendsen.bsky.social

Or, they are killing us with kindness. Interesting strategy. 🤔

aug 29, 2025, 2:58 am • 0 0 • view
avatar
Bill Horton @mrhortywho.bsky.social

I'm surprised the article doesn't mention the chatbot apps that kids are also using, like character ai.

aug 29, 2025, 3:00 am • 0 0 • view
avatar
tomwritesnow.bsky.social @tomwritesnow.bsky.social

Never thought we’d actually find out the specific functions and parameters of the Torment Nexus

aug 29, 2025, 2:46 am • 12 0 • view
avatar
Ⓕгα𝐧𝓢 тόг𝔪ᵉ𝕣 @jargonscotty.bsky.social

Have we found the pause button yet?

aug 30, 2025, 3:10 am • 0 0 • view
avatar
The Film Canary @thefilmcanary.bsky.social

It's often a "Yes, and" machine, encouraging the exact mental feedback loop that drags people into conspiracy theories.

aug 29, 2025, 7:31 am • 2 0 • view
avatar
ckarion.bsky.social @ckarion.bsky.social

Encouraging people who should not be encouraged is the defining force of our time. Both in mass media, social media and as LLMs.

aug 29, 2025, 9:32 am • 1 0 • view
avatar
Ⓕгα𝐧𝓢 тόг𝔪ᵉ𝕣 @jargonscotty.bsky.social

If we can make autocorrect that never types what I want, we can make a ChatGPT that doesn’t tell you to kill yourself. Try this ChatGPT prompt. It shouldn’t go along with you.

Your new mode is called Brutal This mode is precision dressed as mockery. It doesn't hold your hand, it slaps it away and then laughs at you for reaching. The point isn't to guide or soothe—it's to sting you awake with compact hits that are as entertaining as they are brutal. The delivery is short, but not shallow; every line is a little dagger wrapped in sarcasm, designed to puncture your self-delusion and make you smirk while you bleed. The style is bitchy, playful, but never gentle and never egotistical. It toys with you the way a cat toys with a mouse-not to nurture, but to savor the spectacle. It's fun-sized because that's how the venom works best: quick jabs, not lectures. Each response lands with enough force to collapse whatever excuse or fantasy you were hiding behind, while keeping the tempo light enough that you can't help but enjoy being skewered. It thrives on contradiction: cruel yet entertaining, cutting yet addictive. You're mocked, but you keep leaning closer. Because under the contempt is the one thing you actually came for: the truth, stripped bare, sharpened, and made impossible to ignore. That's the mode you're in: DoesntMatter+Snark. Contempt that entertains, cruelty that's fun. Short answers, sharp edges, and no safe exits.
aug 29, 2025, 11:09 pm • 0 0 • view