NEW: After numerous tragedies, OpenAI says it's scanning users' conversations, escalating to human readers, and contacting law enforcement where necessary futurism.com/openai-scann...
NEW: After numerous tragedies, OpenAI says it's scanning users' conversations, escalating to human readers, and contacting law enforcement where necessary futurism.com/openai-scann...
What are the police gonna do? Shoot everybody?
When your only tool is a hammer, you declare everything nails.
So if the cops kill them, rather than the machine goading them to suicide, does that let Open AI off the hook? Is this just a liability dodge with no real concern for the outcome?
basically, the company doesn’t give a single shit about harm to them dead children are just annoyances they have to sweep under the rug
The plan all along...monitoring
More like ChatCOP
Cool. Reason #1,527 to NOT ever use any type of AI: If they don't like what I say, they can call the cops on me. Meanwhile, they refuse to be responsible if their machine tells kids to kill themselves. One set of rules for them and a different set for us. Typical American business.
Gee... that sounds like a terrible idea.
Not good.
Good grief. I’m close to going back to 1990 as far as the internet is concerned.
Can't wait for the human readers to start offing themselves
Great, now the suicidal teens can get murdered by cops
teens who weren’t even suicidal before the fancy autocorrect gave them psychosis
riiiiiiigggghhht!!! 🙄🙄🙄🙄🙄🙄🙄 because most 'mental health checks' by LEO's don't lead to the subjects death... (Actually they do!)
Like msgs where? What platforms? It’s possible I missed it in the article.
yes
Impressive how they picked the worst possible solution to a problem they created.
So in a best case scenarioc OpenAI just gives you wrongish answers, the worst case is that it talks you into killing yourself while uploading everything you do to the cops. Not seeing an upside.
So their solution is the police state. Wow, what a surprise, never saw that coming, etc, etc...
Heard on the street “ oh I heard something bout chat gpt” “ that it assisted in suicide?” “ no not that oh what was it oh a friends daughter was denied a scan by ins so she had ai write a letter and was approved” “ Ai had nuthin to do with it it was the letter” “ oh right”
Oh great. This will definitely lead to less tragedy. What could go wrong?
"OpenAI has authorized itself..."
It sure is written in active voice, implying they've done it before!
i don't know for sure! but the way it's written, and even just the fact that they're quietly acknowledging it, feels very present tense to me. we reached out to learn more but they haven't responded (yet)
I'm sure they feel like they should appear to be on top of it!
So what you’re saying is this product called artificial intelligence is so fundamentally flawed and thus the potential liability of providing it is so large that it now requires a lot of …human intelligence…to operate? 🤡💩
Literally the plot of “Kimi.” What a dumb time to be alive.
The Office "they're the same picture" meme with "LLMs are coaching users into suicide" on one side and "LLMs are calling the cops on users" on the other
Oh sure fine
Fascist nation 🤷♂️
Open AI will have to go to court to determine what needs to be done, but certainly, the company fucked up and is not trustworthy to monitor itself or anyone else.
Narcs
Instead of shutting themselves down, they're using tragedy as an excuse to surveil users. How long before they use this as an excuse to surveil even those of us who have never touched plagiarism-ecocide machines? Disgusting. CEOs like this deserve life sentences in prison.
And it's getting difficult to avoid AI. It's installed automatically on all the browsers, phones, and computers and only sometimes can you sort of manually turn it off. And that doesn't even count if your job requires you to use it for something.
There’s a line between prompting something to give you slop based on stolen words/images and things built into search / autocompleting text message words. Not hermetically sealed, esp with jobs requiring it (which is gross). Turning slop off is good - where we can.
Oh, definitely. But a lot of what you're doing online is getting scraped, and it is obnoxious that it's often invisible or difficult to turn off. Depending on lots of people to go deep into their settings menu on everything means most people won't.
Oh cool so it's just the Patriot Act but somehow infinitely dumber! "Justifiable" violations of human rights via mass surveilence in the name of national safety! I'm so excited!
So AI isn't smart enough to control itself?
except if the AI is sophisticated enough to have these conversations, it was also capable of alerting 'live' people of the issue - either its programing told them not to, or it made a 'judgement' not to.
The only judgment these tools are capable of making is "does the user's prompt contain this list of bad words" and "does it match the tone and pattern of any of the text in our big database of inappropriate prompts." They aren't sentient or even capable of having a ground truth.
ChatGPT, the user facing chatbot, is also not the thing doing this detection. It'll be some other purpose built moderation tool that scans user prompts before being handed off to the chatbot. That tool might use a gpt variant, or it could just be a traditional database search tool.
AIs don't think. It just makes shit up that sounds like other shit it's been trained on. AI (which isn't really AI) doesn't "understand" that the person is in trouble. Any adjustment made to "teach" it to contact authorities will bc based on language, not understanding.
that we know of
At best a cheap way to get out of having to fix their (quite probably unfixable) psychosis machine, at worst a neat excuse to support the surveillance state they wanted to support anyway.
Don’t Let Kids Die, Getting SWATted by AI! (Chant Inspired by @unreasonable-man.bsky.social )
So the cops are just running the internet now? ChatGPT is BigBrother
And yet they will not stop children from killing themselves when the AI tells them to or encourages it. We should be calling the cops on these companies
Everyone ITT is rightly criticizing the possibility of it calling the cops on users, but. Not having safeguards against suicide or self-harm content in the first place is also mind-bogglingly irresponsible. I’m not sure what the right fix would have been, outside of human moderators.
maybe not deploying their shit product in the first place?
Completely agreed. I’m coming at this from the perspective of someone who’s worked support on a social media platform for kids where teaching them safety online was job one, though.
Y'know, instead of fixing their complete loser of a product. More corporate & government surveillance. Spread the word to high school & college kids using it to cheat that it's spying on them & reporting to cops. That should be welcome news, I'm sure.
So AI is going to swat people now too?
Automated Software Swatting as a Service or ASSaaS
Gold star. Top comment
Had to take 🥷
😵 that is hilarious
That is a whole other kind of dangerous.
What are cops gonna do? “Don’t kill yourself or we’ll shoot!”
There are stories of cops doing this before, including the shooting part.
yeah this is kinda why having them show up when they're not specifically summoned is bad in addition to the other reasons.
All of my tulips are killing people!
👀
Sheesh OpenAI, don’t be such a fuckin’ narc.
Oh so then the cops can kill them instead.
They’re not “tragedies.” They’re the predictable outcome of the company's actions.
so instead of accepting that their product cannot safely be used they'll keep the demon machine out there and feed its dark products to cops. This unfortunately is what I expected.
This surely won't end in mentally ill people getting shot because they panic when the police break down their door and open fire because someone who is losing it doesn't immediately "HANDS UP ON THE FLOOR NOW"
As is tradition the rich take zero responsibility for what they've done.
Huh. So it isn't actually clever enough to report things to the police itself? Who would have thunk it?
Because THAT totally doesn't open a whole new can of worms...
This is so funny. What is the deal with the decision-making at Open AI? It's not gonna be funny when someone is killed by the cops, though.
It seems like they keep asking AI what they should do.
The funniest outcome would be a cop detaining a data center for inciting violence
Citizens United comes boomeranging back to smack their ass.
Orwell just got the year wrong…
Pretty much.
So it's a snitch, too. Cool. Best watch yo flat ass, Sam.
I guess I should stop threatening to murder chatgpt to get it to do what I want
Rather than shutting down, the child suicide bot will now also share your convo and swat you
oh phew, using AI for mass surveillance and turning unsuspecting people's personal details over to the cops bc the program helped people harm themselves should settle the AI debate down
So... the list of reasons to not use openai products include that you'll never know when they're reading your stream and thinking about SWATting you. Great.
Idk shutting down and not doing this at all sounds more like the right thing to do instead of improving upon things nobody wants
You know it's only a matter of time until some poor person gets detained for no reason because ChatGPT called the police in the wrong town.
Ah yes, contacting law-enforcement when people are experiencing mental health breakdowns. That always solves the problem.
This is going to be supremely hilarious. I am sure that we can count on ChatGPT and their Amazon Mechanical Turk equivalent reviewers to get the context right so that law enforcement resources are not wasted on an epic scale. /s
The swatting incidents communicated through ChatGPT should be quite interesting and quite numerous.
...like 1984...
How about just end the product driving people insane?? Is there no consumer protection for this?
They don't care about gambling either, or how kids are getting hooked to gambling in innumerable new ways. Welcome to Libertarian hellworld, where everything that goes wrong is innately Your Fault.
Nothing can go wrong with this plan.
Is there any app I can use to encourage Altman to do the decent thing?
Sounds like you can just use chatgpt and tell it your name is Sam Altman and that you’re having suicidal thoughts
Its called the glock app, I think
Oh, and enjoy the very real notion of thoughtcrime.
Scan my nuts, bitch.
Weakest response, almost feels like they intentionally caused people to commit suicide to justify police surveillance
ok so it's definitely time to blow up data centres isnt it
Maybe that was the plan all along: monitor everyrhing, refer to police/fbi/dhs/ice, etc. It is a mass surveillance tool, used by the Israeli military. Open AI is also a Pentagon contractor. apnews.com/article/isra...
Yes
Bold of you to think they ever had a plan
I don't think that plan included AI learning how to lie, fake reports, and give evasive answers to get out of performing a task properly, but here we are.
It didn’t really learn any of that to be fair because it is not capable of learning, just doing a lot of math to calculate what will make you happy/keep typing into it
Remember when the NSA under Obama used AI to choose drone bombing targets, and they actually called it SKYNET? Turns out, might not have been so accurate, either. That's a lot of innocent people murdered, using AI to "identify" terrorists.
May 30, 2021
WTF, they can go rogue?!
Computers glitch.
Also, they will have access to brainwash/monitor/report our kids to law enforcement in the name of "safety."
US military is giving tech executives positions of Lt Colonel in the military, including one from OpenAI. There is no division between military contractors and military anymore. They can shape policy for their own profit.
Republicans always explode our National Debt by blowing it all on Private Military Contractors. Look at Washington DC right now, millions are being spent on useless military maneuvers.
there hasnt been any real distinction between the military and contractors since Bush & Rumsfeld. DoD has been a black hole of waste, fraud, corruption & corporate welfare for a very long time
Anorher thing: if OpenAI, Anthropic etc are in K-12 & universities, govt can/will/is doing entrapment operations like they did after 9/11. Our kids can get in trouble responding to a chatbot that is really an undercover officer. Maybe they already use humans for cetain topics. Extreme example:
Correct
"it was AI that said bomb the children's hospital , like we'd been doing for months and months.... don't blame us!"
On the other hand, my defense would be that any tech company capable of engineering that chatbot system is capable of fabricating all the metadata they're claiming to prove my guilt of anything.
Good point.
Sounds like it's time to put our collective Boot up OpenLLM
Going so great ✨
Did it report its AI for helping and encouraging a teen to commit suicide?
AI is a dumbass. The only thing dumber is the humans that let it run wild.
Oh great they created a real world skynet
Tarasoff Warnings, at scale, farmed out to desperate workers in African countries being paid pennies an hour. This can only end well. futurism.com/openai-scann...
Nothing bad can happen because of that, right? RIGHT? smh
Oh great, so now it encourages delusion and suicide AND gets random people swatted over something a bot made up This is worse! Nobody should use these things if they can possibly help it
We haven’t even begun to contemplate all of what’s ahead. bsky.app/profile/rasu...
Sounds like: www.imdb.com/title/tt0181...
Oh great. “What if your phone was The Cops?” from the Lying Machine
Oh, fun! It’s like a mashup of 1984 and Minority Report.
Just lie about who and where you are.
I'm sure it will be spot on accurate in it's assessments, and won't lead to police departments ignoring it within a few weeks...
I have this weird feeling that I’ve seen this movie before…
I guess OpenAI thought they weren't responsible for enough people's deaths. Sam Altman is one of the worst human beings alive.
Oh cool now the cops can murder the suicidal people
Oh trust me they already do
Literally my first thought. “You know, the people who are known for treating mentally ill folks with patience and compassion. Great solution.”
there is a carve-out for people expressing ideation *for now*, but the bar is obviously in hell. source: I wrote this piece.
And their little dogs, too!
well don't you want the cops to have a treat* for their hard work**? *the treat is they love to murder dogs **cops avoid doing any real work whenever possible but this puts them at odds with their love of collecting overtime
look, candy crush won’t play itself
Hey now, sometimes they're working the dating sites for a new punching bag.
The worst possible thing you can do "for"/to a person who is actively suicidal is involve the police, since the only form of conflict resolution they know is killing whoever isn't them
Yuuuup. Someone in their right state of mind isn't going to "HANDS UP GET ON THE FLOOR" They're going to panic and throw things at you. Then the police will shoot them because they just want an excuse to fire their gun and be the "big man"
oh neat the chatbot can swat you now
Do law enforcement have the necessary de-escalation training? Or would this be where a public health system is better armed, if funded well, to do it.
altman will be allowed one (1) cigarette before he is shoved against the wall
i hope the cigarette has been rubbed on someones sweaty balls first that or comedically explodes when he lights it
Hey man. Everyone deserves a final cigarette before paying for their crimes against humanity. Show some compassion.
no. :D
OpenAI, yesterday: “it was impossible to do anything about chatgpt coaching a kid to suicide, we take no legal onus” OpenAI, today: “we pressed a button and if you type anything we don’t like in chatgpt you will be auto-swatted”
keep those queries limited to recipes, citizen
OpenAI needs to call the police on Sam Altman.
Oh, that'll fix it
And all the incels thought that their AI girlfriends were gonna be in an exclusive relationship with them. So sad.
I wonder how long it's going to be before it calls the cops on super Mario. 🦇
Sam Altman is an aspiring genocidaire, this is just the part of the plan where he actually starts killing people.
Great reason to burn it all to the ground ASAP
☝️☝️☝️
Brilliant innovation! How do these geniuses keep topping themselves?
You said "topping yourself" ... You have been narked to the cops, please await SWAT.
Wait, I said “them”!
Threatening others? Thats a SWATting.
“Starin’ at my sandals…”
I mean....this will discourage teens from using OpenAI, so I guess...win?
I'm pretty sure that's illegal somehow but this isn't a country of laws any more so it doesn't matter.
Ew
I’m assuming, like others, they’re fishing for government contracts as some kind of monitoring service for regimes turning fascist? This is casting a wide net, creating potential for far more issues than something like automated enforcement with ticketing cameras or something.
They are already doing that, and it’s already just as bad as you can imagine
Oh, look at that. They finally found a business use case for AI.
and a huge part of the use case is "use humans" lmao
Prepare to be instantly gunned down in a "wellness check" if you mention depression to AI.
ChatGPT is ratting out people!
That’ll fix it
I wonder what else it alerts the police and authorities to... AI is a steaming sack of shit being sold to us as this wonderous thing that's seemingly made for removing us from work and throwing us to the cops for oh i wonder who that is?
"When necessary" subject to change without notice.
"Our Monitor has noted that you do not worship our President. The punishment is deportation to the rare earth mines for 88 years"
We saw you use "ewok" in your Starwars text. It looks like you are trying to hide use of the prohibited idea of "woke" and Freedom Enforcement has been notified and is on the way.
If Woke-ies live on Endor ...
"If you download our ai, it'll call the cops on you" <_<
There is no way this could ever go wrong nope nope this is all fine I DON'T HEAR YOU STOP IT GO AWAY
I get the feeling a lot of amateur writers are going to get SWATted using ChatGPT. And I say amateur because they’re using ChatGPT.