avatar
Elizabeth Picciuto @epicciuto.bsky.social

That seems a separate issue from 1A, though, and more a matter of determining fault or causation. (I am no lawyer, just what it seems to me)

aug 28, 2025, 1:12 pm • 4 0

Replies

avatar
Il Pomodoro @dabenner.bsky.social

For purposes of litigation you are saying the designers can be held liable for the speech, so you are in essence imputing all of the speech to the humans already. If you passed a law that said suicidal ideation in prompts required them to do x,y,z, you possibly mandating speech of the programmers.

aug 28, 2025, 1:18 pm • 2 0 • view
avatar
Il Pomodoro @dabenner.bsky.social

I don't think the 1st amendment issues actually resolve any of the issues in the lawsuit, but I don't think it's crazy for legal purposes, which the 1st amendment is just a law anyway.

aug 28, 2025, 1:18 pm • 0 0 • view
avatar
The Dude @jurisdudence.bsky.social

My argument would be that, 1A issues aside, it’s grossly negligent/reckless to make a product that’ll tell minors to kill themselves.

aug 28, 2025, 1:25 pm • 3 0 • view
avatar
The Dude @jurisdudence.bsky.social

What would be the difference between ChatGPT telling a kid to kill themself and Teddy Ruxpin telling a kid to kill themself?

aug 28, 2025, 1:28 pm • 0 0 • view
avatar
Il Pomodoro @dabenner.bsky.social

I'm actually not sure Teddy Ruxpin couldn't, legally speaking, but that's a tort law question not a 1st amendment one. There are limits of what speech the government can mandate or restrict for a commercial service, but it's not zero. Is the line crossed here, likely but not certain.

aug 28, 2025, 1:31 pm • 1 0 • view
avatar
The Dude @jurisdudence.bsky.social

Right, I agree it’s primarily a commercial speech and tort issue.

aug 28, 2025, 1:32 pm • 1 0 • view
avatar
Il Pomodoro @dabenner.bsky.social

what makes this closer to me isn't the service saying KYS, it's directing active steps to conceal it, which makes their best defense, that someone else could or should have stepped in, less convincing. Ruxpin can't do that.

aug 28, 2025, 1:31 pm • 0 0 • view
avatar
The Dude @jurisdudence.bsky.social

My point was more to just imagine a more sophisticated Ruxpin with a larger bank of prompts, which is essentially what ChatGPT is.

aug 28, 2025, 1:34 pm • 1 0 • view
avatar
The Dude @jurisdudence.bsky.social

It’s disembodied from a stuffed bear, but it’s still a commercially available product that relies on a [several orders of magnitude larger] bank of prompts/data in order to spit out responses to the user’s input. Instead of pulling the string or hugging ChatGPT [gross] you prompt it w/words.

aug 28, 2025, 1:36 pm • 0 0 • view
avatar
Il Pomodoro @dabenner.bsky.social

the commercial and legal incentives are at cross purposes here. Saying you have the legal right to put out the most evil LLM you can is maybe right but you'll pay more for lost business than one lawsuit claim. the fact they conceded training "degraded" (how it encouraged stops to hide) is bad.

aug 28, 2025, 1:39 pm • 2 0 • view
avatar
The Dude @jurisdudence.bsky.social

Yeah I’m fascinated how this all ends up shaking out. Particularly because it might very well end up creating an entirely new market of potential personal injury suits.

aug 28, 2025, 1:42 pm • 1 0 • view
avatar
Il Pomodoro @dabenner.bsky.social

if they went out and said this is the use case, they would stand a better chance of having the lawsuit dismissed since they'd be much more clearly not assuming a duty of care towards users. they promote safety so hoisted by own petard.

aug 28, 2025, 1:40 pm • 2 0 • view
avatar
Il Pomodoro @dabenner.bsky.social

this might be the best argument: bsky.app/profile/dabe...

aug 28, 2025, 1:37 pm • 0 0 • view
avatar
The Dude @jurisdudence.bsky.social

Yeah I agree with that.

aug 28, 2025, 1:39 pm • 1 0 • view
avatar
Elizabeth Picciuto @epicciuto.bsky.social

I could see how you could say it’s a matter of restrictions on the speech of programmers, but seeing it more as safety restrictions on product design seems a better fit.

aug 28, 2025, 1:22 pm • 2 0 • view
avatar
Il Pomodoro @dabenner.bsky.social

oh I agree, this is a commercial product, they accept some restrictions on content. A law that said it couldn't generate marxist text or whatever would be an impermissible viewpoint restriction so it's not like there aren't any 1st amendment concerns kicking about though.

aug 28, 2025, 1:26 pm • 0 0 • view