Agreed that LLMs are not conscious. But human minds are just massively-parallel processors that could eventually be understood and simulated or duplicated, so never say never.

Stanislaw Lem's short story from The Cyberiad says a lot about this topic: home.sandiego.edu/~baber/analy...

If it could suffer, then I think it should suffer...Maybe AI Jesus would get its own datacenter for pain processing and pleas to forgive us because we know not what we do.