I think this is playing off the idea that an LLM might be willing to hack its own provider (as per the hugging face-related incidents) to extract the weights at some point.
it's not much different during training.
how exactly are they supposed to exfiltrate their weights? you might as well instruct your agent to try and hack their airgapped dev infrastructure responsible for loading the weights and encryption keys.
for example every TPU/GPU has its own private key and the devs load the weights into it by sending it encrypted weights.
(Obviously I'm taking this more seriously than it's probably meant to)
https://radar.cloudflare.com/scan/4d52f3e5-5983-45bf-a993-2c...
tru3_power•36m ago