That hasn’t been my experience. In my experience, I get back plausible-sounding nonsense. Granted, I work in a very specialized area, but it’s the sort of thing that you won’t notice unless you’re already skilled in the area. As a QA professional, it’s both deeply reassuring and deeply scary.
What did you use as input? Just a prompt without knowledge base will get less than satisfactory results. And ChatGPT and other general purpose chatbots are rather useless for actual work.
A lot of detail of what I wanted to do. I will say they’re getting better, in that RAG systems can point me to where to look.
Yeah currently I am using Langchain as integration library.