I use LLMs at work and think they can be useful, but I will still hit problems that even the almighty Claude cannot solve and think to myself: “this person has a lot of domain area knowledge here or has probably seen an error like this before, maybe they will know!”
Nope! Or even if they did know at one point the amount of calories required to use their brain long enough to remember are too precious to be spent when they can just blast my question right back into an LLM of their choosing and reply with that. The other acceptable answer is asking me if I’ve tried to ask an LLM what to do yet or not because maybe that will solve it. Why even bother anymore? Just keep hitting the generate button on the virtual slot machine until you get something that works.
I had someone from another team offer to commit code to fix an issue we were having and upon reviewing it imagine my surprise when it was almost verbatim what we had just tried and failed with from asking the LLM ourselves. This was after answering “yes” to the question of if we had tried using an LLM or not yet to solve the issue as well, but you never know this person might have asked it the right way this time…
One of my other favorite ones is being asked if we had checked our “design” with AI before we committed to building it. This was for probably the most textbook and basic REST API designs you could have, but what if we missed something?? How would we know? Would the AI still help us later if we asked it to?
Where is the collaboration? Where is the desire to learn and share with others? Where is the confidence in what we do? What the hell are we doing here?