Anyone with a billion dollars want to try this and report back?

It makes sense to me that distributing across more parameters results in models that can be quant more heavily (information theory - more bits available)

I wonder if anyone has figured out how the information is compressed and calculated the amount of information an LLM can hold depending on its size