Is the fact that everybody almost catches up with the frontier a sign that we are entering a new region of sigmoid curve?
dominotw•29m ago
meta fails at everything yet is frontier on this one
redox99•27m ago
No because the frontier keeps advancing very fast.
samuelknight•25m ago
Meta has an enormous amount of compute. They are either going use it making and inferencing models or they are going to sell their excess capacity to model providers. Zuck had to completely rebuild his AI team after the Llama 4 launch mess.
schopra909•22m ago
Progress is iterative. Everyone is always riffing on other’s ideas and can execute on them given enough support (eg $$). The person to get to an idea first is just 5% away, so it’s possible to catch up.
Moreover,I think it’s impossible to know if you’re hitting a portion of the sigmoid, because there will often be an idea that changes the trajectory altogether.
In 2024, there was a ton of talk about the plateau. Reasoning was an iteration on chain of thought, but it didn’t really work. Deepseek proposes RLVR as a way to get around the lack of $ they have to produce human reasoning trace data. That small iteration catches the eye of OpenAI and Anthropic, turns out to be way more important than even DeepSeek could have ever expected when it comes to improving LLMs for coding, and last 18 months have been an exercise on riding that insight to the nth degree.
That one small iteration brought us a lot of progress. Now we’re seemingly exhausting the impact of that one insight, but there may be another soon enough.
stymaar•12m ago
> Deepseek proposes RLVR as a way to get around the lack of $ they have to produce human reasoning trace data.
What was the difference between what deepseek did for R1 and what OpenAI did for o1?
mgaunard•27m ago
They could have just called the article "struggling to remain relevant"
scotty79•32m ago
dominotw•29m ago
redox99•27m ago
samuelknight•25m ago
schopra909•22m ago
Moreover,I think it’s impossible to know if you’re hitting a portion of the sigmoid, because there will often be an idea that changes the trajectory altogether.
In 2024, there was a ton of talk about the plateau. Reasoning was an iteration on chain of thought, but it didn’t really work. Deepseek proposes RLVR as a way to get around the lack of $ they have to produce human reasoning trace data. That small iteration catches the eye of OpenAI and Anthropic, turns out to be way more important than even DeepSeek could have ever expected when it comes to improving LLMs for coding, and last 18 months have been an exercise on riding that insight to the nth degree.
That one small iteration brought us a lot of progress. Now we’re seemingly exhausting the impact of that one insight, but there may be another soon enough.
stymaar•12m ago
What was the difference between what deepseek did for R1 and what OpenAI did for o1?