I just skimmed but is there any manual verification / human statistical analysis done on this or we just taking Claude’s word for it?
I expected to see measures of the economic productivity generated as a result of artificial intelligence use.
Instead, what I'm seeing is measures of artificial intelligence use.
I don't really see how this is measuring the most important economic primitives. Nothing related to productivity at all actually. Everything about how and where and who... This is just demographics and usage statistics...
We get it guys the very scary future is here any minute now and you’re the only ones taking it super seriously and responsibly and benevolently. That’s great. Now please just build the damn thing
If the output of the model depends on the intelligence of the person picking outputs out of its training corpus, is the model intelligent?
This is kind of what I don't quite understand when people talk about the models being intelligent. There's a huge blindspot, which is that the prompt entirely determines the output.
you could argue that our input (senses) entirely define the output (thoughts, muscle movements, etc)
These things are supposed to have intelligence on tap. I'll imagine this in a very simple way. Let's say "intellignce" is like a fluid. It's a finite thing. Intelligence is very valuable, it's the substrate for real-world problem solving that makes these things ostensibly worth trillions of dollars. Intelligence comes from interaction with the world; someone's education and experience. You spend some effort and energy feeding someone, clothing them, sending them to college. And then you get something out, which is intelligence that can create value for society.
When you are having a conversation with the AI, is the intelligence flowing out of the AI? Or is it flowing out of the human operator?
The answer to this question is extremely important. If the AI can be intelligent "on its own" without a human operator, then it will be very valuable -- feed electricity into a datacenter and out comes business value. But if a model is only intelligent as someone using it, well, the utility seems to be very harshly capped. At best it saves a bit of time, but it will never do anything novel, it will never create value on its own, independently, it will never scale beyond a 1:1 "human picking outputs".
If you must encode intelligence into the prompt to get intelligence out of the model, well, this doesn't quite look like AGI does it?
You spend energy distilling the intelligence of the entire internet into a set of weights, but you still had to expend the energy to have humans create the internet first. And on top of this, in order to pick out what you want from the corpus, you have to put some energy in: first, the energy of inference, but second and far more importantly, the energy of prompting. The model is valuable because the dataset is valuable; the model output is valuable because the prompt is valuable.
So wait then, where does this exponential increase in value come from again?
1. Accelerated US Diffusion vs. Global Stagnation
The report estimates that usage parity across US states could be achieved in 2–5 years. This rate of diffusion is approximately 10 times faster than that of major 20th-century technologies (e.g., electricity or the automobile). However, this rapid convergence is not observed globally. International adoption remains strictly correlated with GDP per capita, with no evidence of lower-income countries "catching up." This suggests AI may currently exacerbate rather than narrow the digital divide between nations.
2. The Education Mirror Effect
A high correlation (r > 0.92) exists between the education level required to write a prompt and the education level of Claude's response. This implies that the model's sophisticated capabilities are only unlocked by users who already possess high formal education. Rather than acting as a cognitive equalizer, AI appears to function as a capital multiplier for existing high-skill workers.
3. Productivity "Haircut" via Reliability
While raw "speedup" data suggest significant time savings (e.g., a 12x speedup for college-level tasks), these gains are substantially offset by task failure. Adjusting aggregate productivity growth estimates for task reliability reduces the projected impact from 1.8 percentage points to approximately 1.0 percentage point of annual labor productivity growth. This 44% "haircut" highlights that current model unreliability is a primary bottleneck for macroeconomic impact.
4. Selective Deskilling of White-Collar Work
The report finds that AI disproportionately covers high-education tasks. In a task-displacement model, this leads to a net "deskilling" effect for several professions. For example, Technical Writers may lose their most complex analytical tasks to AI, leaving behind only routine illustrative or observational work. Conversely, occupations like Property Management may experience "upskilling" as AI handles bookkeeping, leaving managers to focus on high-stakes negotiations.
5. Multi-Turn "Task Horizon" Extension
The "task horizon"—the maximum task duration at which AI achieves a 50% success rate—varies wildly by interface. For single-turn API interactions, the horizon is 3.5 hours. For multi-turn Claude.ai conversations, it extends to 19 hours. This suggests that the iterative, human-in-the-loop chat interface is significantly more effective at managing complex, long-duration tasks than programmatic automation.
Critical Uncertainties:
Temporal limitations: The data was collected over a single week in November 2025 and predates the release of Opus 4.5.
Self-selection bias: Success rates reflect only the tasks users choose to bring to AI. If users avoid tasks they expect the AI to fail at, success rates are artificially inflated.
Measurement of "Education Years": The report uses a Ridge regression model to predict education requirements from task embeddings. If the training data (BLS occupation levels) is a lagging indicator of actual skill requirements, the deskilling/upskilling analysis may be skewed.
oh I know this one!
it's created mountains of systemic risk for absolutely no payoff whatsoever!
I would never make the argument that there are no risks. But there's also no way you can make the argument there are no payoffs!
* value seems highly concentrated in a sliver of tasks - the top ten accounting for 32%, suggesting a fat long-tail where it may be less useful/relevant.
* productivity drops to a more modest 1-1.2% productivity gain once you account for humans correcting AI failure. 1% is still plenty good, especially given the historical malaise here of only like 2% growth but it's not like industrial revolution good.
* reliability wall - 70% success rate is still problematic and we're getting down to 50% with just 2+ hours of task duration or about "15 years" of schooling in terms of complexity for API. For web-based multi-turn it's a bit better but I'd imagine that would at least partly due to task-selection bias.
You can't compare the speed of AI improvements to the speed of technical improvements during the industrial revolution. ChatGPT is 3 years old.
> a sustained increase of 1.0 percentage point per year for the next ten years would return US productivity growth to rates that prevailed in the late 1990s and early 2000s
What can it be compared to? Is it on the same level of productivity growth as computers? The internet? Sliced bread?
mips_avatar•1h ago
malshe•44m ago