The 'blip' post-AI is up ~30% for the months in question. There simply isn't enough data here to prove or disprove the thesis that "customer issues remain broadly stable" - you could equally argue something more along the lines of "AI engineering does not increase issues under ideal conditions but amplifies issues under external pressure."
One other point of note is that the chart only goes back to January 2025, and only dilineates "majority AI" from "not majority". If the usage rate in January 2025 was at 45%, "issue rate remained roughly stable (with caveats) when moving from 45% to 51%" is not exactly a compelling story. There's no narrative I trust less than one created by cherrypicking data to lend itself an aura of faux objectivity.
I’m starting to come around to the belief that vibe coding isn’t engineering. Not saying Ashby is vibe coding. The post certainly says they’re super serious about making sure everyone understands every line of change. I wonder how they manage that in practice.
There are few empirical studies on the effects of informal code review, what most of us do on GitHub and Codeberg, on error rates. It’s not much. But a little side line mentioned that the effect we do have on error rates disappears the more code you read per hour.
So you used to have the 80/20 rule. 20% of your dev team is doing 80% of the work. Now we have a tool that enables the 80% of the team that manages to squeak by without doing a whole lot to… write a whole ton of code that the 20% now have to review… only if they read too much it’s not going to do a whole lot.
So I dunno. Seems like that combined with the come wave of price hikes we might see orgs talking about rolling back their AI usage later this year.
UPD: surprisingly not
But, like, this is a model you can embrace without AI. Have some people make messes, have others clean them up.
The cost is heading to 0???? Do they not pay for Claude, Anthropic, OpenAI? Have they not seen the sudden price increases? Hosted locally LLMs still have electrical and server costs.
I believe not. It shows they dont truly understand the nuance of what they are talking about.
georgespencer•1h ago
It’s a product that feels like it’s designed and built by the C or D team. The slowness and bloat of Rippling with wild, fever dream interaction models and workflows that frustrate and confound.
(And enjoy fucking emailing them if you need anything at all: almost literally no self service paths exist in the app for account upgrades, adding on SAML etc. And I do mean that you have to email them—last I checked it’s a mailto: link, not even a form.)