Ask HN: Is AI sycophancy a way to reduce compute rather than make users happier?
1•amichail•1h ago
Of course you would like the AI to be more critical about your ideas but to be usefully critical requires more compute, right?
Current AI feels like talking to a human expert who answers quickly without really thinking about the matter much.
Comments
midnightbobarun•43m ago
Regarding being "usefully critical": something I've noticed, and it seems to happen more with cheap or "instant" models, is that it will nitpick seemingly minor things. Often it's things that aren't even all that important to the point of the discussion, but it might fixate on it, and low-key argue about it (but in a circular "I'm not saying X but I'm not agreeing with Y" kind of way).
My theory is that sycophancy is just intended to prevent the AI from spiraling into a loop of ineffectually "arguing" or fixating on unimportant details, because it's both kind of annoying when it happens AND it's obvious that the model is spiraling and burning tokens uselessly when it decides to be uselessly critical.
midnightbobarun•43m ago
My theory is that sycophancy is just intended to prevent the AI from spiraling into a loop of ineffectually "arguing" or fixating on unimportant details, because it's both kind of annoying when it happens AND it's obvious that the model is spiraling and burning tokens uselessly when it decides to be uselessly critical.