Interesting. I tend to imagine the exact opposite - it seems as though this is the big players realizing there's not much left from training better models, so they're focusing on scaffolding to get their improvements. If that's the case, why wouldn't a company completely devoted to the scaffolding not do a better job at that goal? And more importantly, why would I lock myself into their system?
dangoodmanUT•38m ago
Because the model labs can RL against their own scaffold, which will be borderline unbeatable
digdugdirk•45m ago
dangoodmanUT•38m ago