I see you guys have a blog post factory as well.
At this point people genuinely do not have the willpower to write, and instantly give into the lazy shortcuts llms provide. Just like how GPS apps degraded smart people's ability to navigate around their own towns (I've seen this happen to many over the years), LLMs will totally degrade people's ability to write (and think for themselves).
We're slowly auctioning off our sovereignty in exchange for quick shortcuts to every tech company. Not good.
Just wait, soon you will hear rumors of how tech CEOs don't let their children use AI in school (while they demand everyone else's children do), similar to how Zuck et al didn't let his kids use social media.
Slowly?
And honestly it's incredibly good. - 50% of the time it'll generate code that I accept wholesale.
- 25%: it maybe makes a choice I don't like, or the implementation isn't the approach I liked, so I tweak it.
-10%: it needlessly creates semi-duplicate function logic, so it's a lot more code and execution paths become hard to conceptualise
-10%: it mirrors business logic it shouldn't, and subtly changes it. Which needs a huge amount of intervention to fix.
- 5% it goes completely off the rails. Eg decided that business/application logic should be in the database.
Prompt and check this honestly works very well (still waiting on tests with more than a handful of paying customers however!) but a FULLY automated agent pipeline? I'm not convinced. That last 15% of cases will make a degenerate codebase real fast.
Also without a CC subscription, paying per token, it would be horrifically expensive for my approach.
I'm also curious where the discuss part comes from, because I guess you don't just let them start on a basic prompt without any context
I also do not understand the obsession with “software factories”. Like “JIRA to product” nonsense. Is like we can hand wave the details that matter and somehow the end product would still be what we want.
Not even talking about the degenerative codebase you mention, which is also an issue I am seeing after some time in any project.
Recently I’ve been looking into why LLMs tend to write in some off putting ways. This one apparently is for LLMs to get better results.
It puts the cases to avoid closer to the main requirement so is easier for a LLM to follow without losing track with more ambiguous language.
Is very interesting because is harder to read by a human but it gets better results for an LLM.
notatoad•1d ago
This is content marketing, at least give it a review pass before you hit publish… if your marketing is unpolished AI slop, I have to assume your product is too.
4b11b4•1d ago
bix6•1d ago
Honestly I’m just glad they built the gates before the fleet! That’s not a step change, it’s a paradigm shift!