> Today, the mathematicians are weeping, because the machine smashed their tower first. But tomorrow, it may be the physicists, the economists, the illustrators, or the writers who weep over their fallen blocks.
Isn't it extraordinary that these models still can't write well? I mean, they write passably well, but they all have a highly characteristic style that you can spot from a mile away. These language models can crack the toughest open problems in math, but they haven't yet cracked human-like writing, especially long-form writing, without exposing themselves. This is very very odd, IMO.
Either these mathematicians thought it would never come for their jobs, because all of these other jobs were simpler or they've been living under a rock.
Either way, I don't feel for them any more than I do for all of humanity.
Finding that new knowledge may be exponentially more difficult, but it will be much more valuable.
This seems like a good summary of the article, and I think the answer here is obvious.
So what?
News flash folks: we do not have the knowledge to survive on our own. If a solar flare deletes the electric grid, the first thing that happens is 8 billion people die in the next year.
We survive on abstractions others have built, and we have a global dependency web.
AI abstracting knowledge is neither new or dangerous; if it is dangerous, this certainly isnt the argument to prove it.
I think they might find comfort in knowing it's not just mathematicians - this is coming for all of us. Computers putting us out of work has been coming for a long long time.... and now it's here.
Still disgusted?
The bean counters laying off software engineers ought to take notes from the frontier labs' own hiring practices. They're still hiring lots of humans for business and engineering roles even when they would be better positioned than anyone to automate away those jobs with their world-class models (https://openai.com/careers/search/).
This is what it seems like so far for software. The speed limit has changed. It’s interesting to explore what that means. Extending the analogy, long ago you could be a race car driver part time; that would be pretty laughable for an F1 driver. It’s a very specialized skill and the optimal athlete is quite different for driving a car than for running, for example. That feels like what I’m seeing in software.
The most effective folks are much faster and better with these tools than average. It’s a different skill set.
I think that formal verification makes Math much closer to code than many other fields. But I’m eager to see the first mathematicians that are dramatically more proficient with the new tools than average.
Nothing has changed in math. Math is not solved nor has the human been kicked out of the loop. Same with programming.
Sure, there are people who overstate things. But that isn't an excuse to keep your head in the sand.
Worth reading: Robert Brandom, “Making It Explicit: Reasoning, Representing, and Discursive Commitment”
The same goes for math.
Let's find some things that bring value other than just the price of a stock.
So I wonder if mathematics will go through that too? A period of chaos and doubt, but finding new and more effective ways of working.
What is true, is that chat models (and by extension agents) have a very characteristic style after their LLM went through post-training. But the pre-trained language model doesn't have that style.
So if you want to write well with an LLM, you could and it is a well understood problem. It is more a matter of that not being of much interest, as it competes with having the model be good for chat interfaces.
How to have a well-aligned, RL'ed, safe or thinking model, which also writes well in long-form, is a bit an open problem. Though presumably agents could do it when they have access to a pretrained model.
I read this passage and thought, "has Derek even talked to software developers"?
That feels to me like the first discipline to go through this, where their daily activities are massively changed by GenAI.
That is why it's so disturbing. After several paragraphs, you realize there's nothing human there even when the actual information is present. People that do create AI piece are OK with it because they already have the context, but for the reader, it's always the uncanny valley.
Their math is as just as good as their rambling writing and their Ghiblified poster art. Most people don't seem to realize that.
Neither sits right with me. Can't we just all collectively acknowledge that we have to grapple with this new piece of technology that either is already or at least seems to be going to be hurtful to a lot of individuals?
Instead of looking at the in comparison limited group of people currently pushing this technology and asking ourselves whether we should be on board with their doing, we look to one another and are happy that someone else is now suffering just the same as we are. What a sad state of affairs.
bananaflag•27m ago
I am also sad, but my sadness is, in a way, priced in.
Lambdanaut•25m ago
I just had a chance to flinch first.
qarl•6m ago
The people struggling right now - they were told. 30 years ago. They really should have come to terms with it by now.
But these are also the people who refused to believe it, for whatever reason. Their heads were in the sand. So I do feel bad for them... but... this is somewhat self inflicted.
QuesnayJr•14m ago
Also, it's impossible to really know how you're going to react to something until it happens to you. When ChatGPT came out, I already thought "in the long run they're going to automate almost everything humans love to do". Despite having 4 years to brood about it, I did not really know what it would feel like until it happened to me directly.
qarl•9m ago
That's how the singularity works. It's going to keep getting quicker, incomprehensibly so.