I find both of those positions to be pretty naive which instinctively makes me feel like I'm missing something people way smarter than me (like Amodei) can see but yet never seems to be articulated in these articles.

When it demonstrates the ability to synthesize unique solutions to problems given nothing but an objective. For example --- find a cure for cancer. And arsenic isn't acceptable for obvious reasons.