So bad. I've been trying to get it to write a simple Mac app for the last 2 days and the code is riddled with errors. I thought this was supposed to code for you with just a prompt. No coding experience necessary. It just doesn't work.
Replies
I tried a refactor experiment last week on a simple component between Claude and GPT. GPT5 cut lots of stuff out, didn’t tell me, and made lots of bad assumptions. Forced me to ask it for answers. Felt like a social media site milking engagement stats.
aug 19, 2025, 4:06 pm • 0 0 • view
Have you tried Claude Code? No point trying to do this stuff inside the desktop apps. productmarketorbit.com/posts/250528...
aug 19, 2025, 4:41 pm • 0 0 • view
I sent the same company both tie GPT and Claude to see the difference. Claude didn’t lose anything, was more deferential to what I had done before.
aug 19, 2025, 4:46 pm • 0 0 • view
“…sent the same component to both…”
aug 19, 2025, 4:52 pm • 0 0 • view
The back and forth is producing negative productivity.
aug 19, 2025, 3:58 pm • 1 0 • view
I asked it why it randomly cut stuff out of my code, and it essentially said, "because you didn't specifically tell me to keep it". None of these bullets it told me are good reasons to start cutting out code.
aug 19, 2025, 4:09 pm • 0 0 • view
Alternatively ask it to create any web app and it should be able to manage that inside its own environment. That’s really what they are talking about.
aug 19, 2025, 4:43 pm • 0 0 • view
It made a simple html5 game on the first try. I don't see where ChatGPT is claiming you can code with just a prompt only (or primarily) applies to html5. Plus, when I ask it to make a Mac app, it still tries instead of saying it can't do it. I am not using beta MacOS or xcode.
aug 19, 2025, 4:47 pm • 0 0 • view
It’s much better on languages that show up more in its training data, and where it can run the code and quickly see any error messages etc. That favours popular single page app web languages, and makes proper native apps hard.
aug 19, 2025, 4:57 pm • 0 0 • view
You wouldn't know that listening to the folks at OpenAI!
aug 19, 2025, 5:15 pm • 0 0 • view
Well yeah but I mean, they believe AGI is right around the corner, right? I wouldn’t listen to them…
aug 19, 2025, 6:44 pm • 0 0 • view
Really you need to work with it to write a short spec document first, so it has everything it needs to understand there to build it consistently. But really really, only use it for small handy utilities. Then move to Lovable for bigger apps. Then Claude Code 🤫
aug 19, 2025, 4:57 pm • 0 0 • view
I’ve written a number of posts as someone with an English degree and marketing background on what I’ve learned building with these tools. They are truly truly insane. Https://productmarketorbit.com (I built that site with AI too - and blogged about it.)
aug 19, 2025, 4:57 pm • 0 0 • view