✅ The best freely available coding assistant at this time is Google Gemini 2.5 flash. The GPT-4o based assistant from ChatGPT which is now freely available is trash. (This is AFAIK - if any of the better models are freely available please correct me!)
❗ All the coding assistants completely fail (0% pass rate) at the "hard" level problems (there are NO red bars in the accuracy chart) So don't hold your breath if you're expecting these systems totally replace human coders anytime soon. Expert level coders, your jobs are safe for now. 😅
There is a website where you can track the latest stats: livecodebenchpro.com. And the research methodology paper is on Arxiv: arxiv.org/pdf/2506.11928