Well, you can see in the chain-of-thought part of the o3 answer how it's handling the ambiguity of the question. But yeah, you generally need enough knowledge to have a sense if the answer is good or not (also true for a lot of things you get answers to, especially online).
But most of the proselytizing for LLMs is along the lines of "Let AI do this thing that you don't know how to do/aren't good at", rather than "you have to check every single detail to make sure none of them are total bullshit". "Ask ChatGPT" is not an adequate replacement for "learn lots of things"
How do you learn lots of things? Actually do the work, reading, thinking, discussion yourself. The goal of weight training is usually to become stronger, not just get barbells off the floor. "AI" doing your homework or job is like a weightlifter training for the Olympics with a forklift.