I respect Karpathy, but I can’t shake the feeling that recently has been doing more damage than good to the AI community. First he came up with “vibecoding“ and now this one. What we need is better engineering approaches to build AI systems, not buzzy marketing words that only benefit AI companies.
I think this gives room for non technical people to vibecode prototypes, knowing that the output will eventually go off the rails without technical understanding.
The prompt engineering side of the problem (how you structure your prompt) is trivial by comparison and will become less and less relevant as frontier models improve.
What's described here is mostly a list of barely disguised tips, tricks and heuristics. It's all fine until someone wants to put it in production and suddenly a "real" engineer has to take over and do the actual engineering.
(and yes, I'm old - and grumpy!)
A typical person does not understand scientific principles and cannot validate whether a bridge is safe before using it. An engineer that approves a bridge can be held liable when that bridge fails, even if they had orders from their boss or company.
If you're not prepared to accept personal liability when your code kills someone or causes a disaster, you shouldn't try to be an engineer.
I live in a country (Canada) where software engineering is legally considered engineering and that's what officially distinguishes a "software engineer" from a "software developer". In practice, I rarely see the rule followed.
Unless you're actively attacking a castle.
So which scientific principles do context engineering apply?
There is none. So yeah. It's not engineering at all.
Doctor - body engineer
Lawyer - court engineer
Plumber - pipe engineer
Gardener - plant engineer
Politician - lie engineer
Psychotherapist - feelings engineer
Criminal - crime engineer
Chef - food engineer
Baby - cry engineer
Dog - woof engineer
You see, we're all engineers.
This domain is so far from real engineering it's almost embarrassing.
You cant trust LLMs for 100%, constant supervision is needed
Sebastian_09•6mo ago