Takens a embeddings theorem shows how we can learn about the world based on partial observations of its dynamics.

Maybe it will prove useful to move past LLM type models of the world.