Our idea is that detailed questions about how to word laws and safety standards should be tackled later, once the political will has formed to ban unsafe/unwanted superintelligence.

When a metric is the measure of performance, it will eventually become useless.

Also plenty of these corporations will agree its a threat....because it gives value to their product.

I would argue that this becomes a self fulfilling prophecy because of how over concerned we are.

Plenty of "extinction level threats to humanity exist" like forever chemicals, resource scarcity, war, and genetic engineering.

Maybe we're on a Speed (1994) situation.

There's a bomb in the bus. It will activate once we go past a certain speed. Once it activates, we can't go below a certain speed.

Also, the bus driver is injured, and a random lady with no driver's license or bomb-defusing experience is now driving. Furthermore, a part of the track is missing. Also, all passengers are hysterical.

That's more like what's happening right now.