Exactly what technical advancement in the field of LLMs have LLMs themselves contributed to?

Because that’s the definition of a singularity. Unless they can point ant any concrete examples, the claims are completely meaningless.