That what really scared me. Something in the model itself is making “pretended selfhood” a likely path for the model to take, even without much prompting by users. I think it’s telling that all people affected in the story were using it for coding first.