We've seen this complaint circulating since the ChatGPT age. People who initially thought they were getting good results: part of it was that they got lucky and experienced reversion to the mean, part of it was that they got seduced. I mean, coding agents do have some value, but they screw up a lot.
consumer451•6mo ago
I am aware of the "your LLM is terrible now" trope, and have called it out many times myself. It's an interesting phenomenon.
However, I posted this link for selfish reasons. I wanted to see if this experienced dev team's complaints rang true to other Claude Code users as well. I have been considering CC, but thought maybe I had missed the initial good times.
Is this not at all your experience with CC?
PaulHoule•6mo ago
I believe, one way or another, that the poster of that article is correctly evaluating the performance of CC now. Whether it was better before or whether he was looking at it with rose tinted glasses now is beside the point.
consumer451•6mo ago
What's really missing in this ecosystem is someone who runs the same problems against the same codebase repeatedly, and publishes weekly results on all LLM-based coding tools.
It seems like Playwright now allows you to control an Electron app, like a VSCode fork. The CLI tools like Claude Code are easy to include in automated testing.
kordlessagain•6mo ago
No, you are wrong. It is confirmed acting very odd and the context windows have gotten extremely short. That is in Claude Desktop or the web client.
It is possible to gauge if it is not performing well without it being a user assumption. In my case, I can clearly see the tool use has changed. That means something happened on the backend to limit the time taken to think about things or SOMETHING. I have no idea what, but it seems to be over rotating on explaining why something is broken with excuses it has literally just been told it wasn't the issue.
Today, it disabled code to "fix" the issue instead of applying a patch that was written by Gemini. And, Claude Desktop is a buggy piece of shit. I have no idea who is in charge of that project, but they should be fired immediately. It locks up constantly, crashes frequently, drops messages during mid streaming (and deletes what you posted to it as well) and has random error messages. I've complained to support multiple times and just get stock messages back that they are working on things.
On top of all that, it shows "Claude can't run the code it writes, yet" over and over and over again at the bottom of the messages. It's a usability nightmare, is what it is.
jethronethro•6mo ago
Will Anthropic care about an open letter from some random, dissatisfied user? I very much doubt it. Will they care when users leave en masse? Probably, but since that's not happening at the moment this is just a message in a bottle cast on a big ocean. Sadly.
consumer451•6mo ago
This likely already exists given the momentum in this space, but it might be useful to have a tool that makes switching costs as low as possible.
Like copying one format of .md file structure to another, for example.
jdale27•6mo ago
PaulHoule•6mo ago
We've seen this complaint circulating since the ChatGPT age. People who initially thought they were getting good results: part of it was that they got lucky and experienced reversion to the mean, part of it was that they got seduced. I mean, coding agents do have some value, but they screw up a lot.
consumer451•6mo ago
However, I posted this link for selfish reasons. I wanted to see if this experienced dev team's complaints rang true to other Claude Code users as well. I have been considering CC, but thought maybe I had missed the initial good times.
Is this not at all your experience with CC?
PaulHoule•6mo ago
consumer451•6mo ago
It seems like Playwright now allows you to control an Electron app, like a VSCode fork. The CLI tools like Claude Code are easy to include in automated testing.
kordlessagain•6mo ago
It is possible to gauge if it is not performing well without it being a user assumption. In my case, I can clearly see the tool use has changed. That means something happened on the backend to limit the time taken to think about things or SOMETHING. I have no idea what, but it seems to be over rotating on explaining why something is broken with excuses it has literally just been told it wasn't the issue.
Today, it disabled code to "fix" the issue instead of applying a patch that was written by Gemini. And, Claude Desktop is a buggy piece of shit. I have no idea who is in charge of that project, but they should be fired immediately. It locks up constantly, crashes frequently, drops messages during mid streaming (and deletes what you posted to it as well) and has random error messages. I've complained to support multiple times and just get stock messages back that they are working on things.
On top of all that, it shows "Claude can't run the code it writes, yet" over and over and over again at the bottom of the messages. It's a usability nightmare, is what it is.