I'm not sure how I feel about the Platonic Representation Hypothesis.
In some ways it seems like it should be profound, but part of me thinks it might just be saying 'There is an optimal way to perform dimensionality reduction and as things get bigger it is easier to appoximate'
foolswisdom•4m ago
Seems to me that it matters because it has implications for how we can train smaller models?
Lerc•19m ago
In some ways it seems like it should be profound, but part of me thinks it might just be saying 'There is an optimal way to perform dimensionality reduction and as things get bigger it is easier to appoximate'
foolswisdom•4m ago