When it works on the first prompt its magic. I especially like to generate UI components, but for more complex things its a major time waster. Often complex functions just dont work and debugging is slower than rewriting it from scratch.
https://news.ycombinator.com/item?id=44522772
Link to the full paper: https://metr.org/Early_2025_AI_Experienced_OS_Devs_Study.pdf
Overall the study is a very small sample size (16), with mixed AI tooling and mixed AI experience. It's an interesting data point, but honestly not an extensive enough study to make any causal determination. It's certainly plagued by much of the discourse around AI being highly polarized, as well as AI being such a broad category as to have little meaning overall.
Quoting from the above thread:
> My intuition here is that this study mainly demonstrated that the learning curve on AI-assisted development is high enough that asking developers to bake it into their existing workflows reduces their performance while they climb that learning curve.
The above quote, very much matches my personal experience. The first month or two was very hit or miss, and plagued with frustration. As I got better using the tools, and figured out new workflows, and settled on better tools, it's become a much better experience for me. Specifically, asking ChatGPT or Claude to generate a function for me sucked, editor tab completion with a good model was better, but still occasionally frustrating, chat in cursor was better than that, and claude code as an agent has been fantastic. But the journey was long and required a lot of reading, video watching, and listening to podcasts about how people who are successfully using AI coding tools work.
Currently I feel like I'm about 2x as productive (note: I'm not a particularly quick developer, so YMMV).
pitched•5h ago
ath3nd•3h ago
xorbax•3h ago
bobbiechen•1h ago
Not feeling tired afterwards is a real improvement though, and I think that feeling is reliably self-reported.
pitched•1h ago