The resemblance falls apart more easily when something simple and objective (like counting, or citations) is introduced, or when the user asks about a topic where they have expert knowledge. But absent those tells, it can be convincing because the models are designed and refined with that goal.