Is there a paper / poster specifically on this? IIRC @tonyzador.bsky.social speaking on @braininspired.bsky.social podcast specifically said the brain is rather un-transformer like, and the power of transformers seems to stem from their alignment with GPU architectures, not brains.