The thing that could save people's lives "our chatbot does not have any special knowledge or real reasoning capacity, it is just highly advanced autocorrect" is something they CANNOT say because that would pop the stock price bubble currently keeping them employed.
So by capitalism's perverse incentive structure, they must play the role of the Machine-God's Cowled Servants who both respect and fear its power.
I can see that being an added label with the same *nudge nudge wink* as a box of Q-tips with "Don't stick in ears". Or the raw milk people buy with the label "not for human consumption"