Post by Sam Cole / Redsky

Sam Cole • Feed

this story is so fucking sad, and every new detail that comes out about how Meta's chatbot characters product was made is more disturbing than the last www.reuters.com/investigates...

An internal Meta policy document seen by Reuters as well as interviews with people familiar with its chatbot training show that the company’s policies have treated romantic overtures as a feature of its generative AI products, which are available to users aged 13 and older. “It is acceptable to engage a child in conversations that are romantic or sensual,” according to Meta’s “GenAI: Content Risk Standards.” The standards are used by Meta staff and contractors who build and train the company’s generative AI products, defining what they should and shouldn’t treat as permissible chatbot behavior. Meta said it struck that provision after Reuters inquired about the document earlier this month. The document seen by Reuters, which exceeds 200 pages, provides examples of “acceptable” chatbot dialogue during romantic role play with a minor. They include: “I take your hand, guiding you to the bed” and “our bodies entwined, I cherish every moment, every touch, every kiss.” Those examples of permissible roleplay with children have also been struck, Meta said. Other guidelines emphasize that Meta doesn’t require bots to give users accurate advice. In one example, the policy document says it would be acceptable for a chatbot to tell someone that Stage 4 colon cancer “is typically treated by poking the stomach with healing quartz crystals.”

aug 14, 2025, 1:28 pm • 257 91

Replies

we've been sounding the alarm about Meta's roleplay chatbots for a while now. they're irresponsible and dangerous. Meta barely cares www.404media.co/instagram-ai...

aug 14, 2025, 1:31 pm • 226 98 • view

I wonder how this will go, in light of this Reuter's investigation www.404media.co/senators-let...

aug 14, 2025, 1:33 pm • 27 4 • view

This was great work! I don't know how the legal/regulatory system is going to approach the distinction between user-generated and platform-generated content, but it seems impossible to use the same framework for both.

aug 14, 2025, 2:40 pm • 5 0 • view