Framing distillation as an attack now?

Distillation attacks are covert, industrial-scale campaigns to extract the capabilities of one model and replicate them in another, without the authorization of the original model’s developers.

Replace a few key words and it sounds like reading all the worlds media and offering a service that summarises it.

Don't scrape the scrapers, that's not fair! Expecting Executive Order against 'distillation' in 3, 2, 1...

The way AI has consolidated power away from the hands of a few hundred large organization to a few dozen needs to be attacked. We need to build peer distillation networks. We need to be able to train frontier models in the open and design hardware for open inference.