In my group, I had an over confident employee that was at times very smart. But, I could not ever really trust him as his confidence prevented him changing his mind based on the facts. He could lead you over a cliff. the LLMs are similar. They can spit out great content for coding, but you always had to have a careful eye on output, the design, the scalability, and the ability to support.