frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

The RAM shortage comes for us all

https://www.jeffgeerling.com/blog/2025/ram-shortage-comes-us-all
143•speckx•56m ago

Comments

jsheard•44m ago
I wonder if Apple will budge. The margins on their RAM upgrades were so ludicrous before that they're probably still RAM-profitable even without raising their prices, but do they want to give up those fat margins?
loloquwowndueo•42m ago
It’s 4D chess my dude, they were just training people to accept those super high ram prices. They saw this coming I tell you!
dcchambers•42m ago
I am fully expecting a 20%+ price bump on new mac hardware next year.
Eric_WVGG•21m ago
Not me. It’s wildly unusual for Apple to raise their prices on basically anything… in fact I'm not sure if its ever happened. *

It’s been pointed out by others that price is part of Apple's marketing strategy. You can see that in the trash can Mac Pro, which logically should have gotten cheaper over the ridiculous six years it was on sale with near-unchanged specs. But the marketing message was, "we're selling a $3000 computer."

Those fat margins leave them with a nice buffer. Competing products will get more expensive; Apple's will sit still and look even better by comparison.

We are fortunate that Apple picked last year to make 16gb the new floor, though! And I don't think we're going to see base SSDs get any more generous for a very, very long time.

* okay I do remember that Macbook Airs could be had for $999 for a few years, that disappeared for a while, then came back

suprnurd•42m ago
I read online that Apple uses three different RAM suppliers supposedly? I wonder if Apple has the ability to just make their own RAM?
umanwizard•41m ago
Apple doesn't own semiconductor fabs. They're not capable of making their own RAM.
kayson•40m ago
Apple doesn't own any foundries, so no. It's not trivial to spin up a DRAM foundry either. I do wonder if we'll see TSMC enter the market though. Maybe under pressure from Apple or nvidia...
FastFT•35m ago
There are no large scale pure play DRAM fabs that I’m aware of, so Apple is (more or less) buying from the same 3 companies as everyone else.
Night_Thastus•42m ago
RAM upgrades are such a minor, insignificant part of Apple's income - and play no part in plans for future expansion/stock growth.

They don't care. They'll pass the cost on to the consumers and not give it a second thought.

rfmc•41m ago
I know contract prices are not set in stone. But if there’s one company that probably has their contract prices set for some time in the future, that company is Apple, so I don’t think they will be giving up their margins anytime soon.
throw0101d•23m ago
> I wonder if Apple will budge.

Perhaps I don't understand something so clarification would be helpful:

I was under the impression that Apple's RAM was on-die, and so baked in during chip manufacturing and not a 'stand alone' SKU that is grafted onto the die. So Apple does not go out to purchase third-party product, but rather self-makes it (via ASML) when the rest of the chip is made (CPU, GPU, I/O controller, etc).

Is this not the case?

jsheard•21m ago
That's not the case, Apple buys standard LPDDR packages and places them on top of their SoC packages. The very close proximity of the core and memory allows them to push very high speeds with very low power, but they're still ultimately separate dies.

https://upload.wikimedia.org/wikipedia/commons/d/df/Mac_Mini...

That square is the whole M1 package, Apple's custom die is under the heatspreader on the left, and the two blocks on the right are LPDDR packages stacked on top of the main package.

https://wccftech.com/apple-m2-ultra-soc-delidded-package-siz...

Scaled up, the M2 Ultra is the same deal just with two compute dies and 8 separate memory packages.

diabllicseagull•21m ago
I'd like to believe that their pricing for ram upgrades are like that so the base model can hit a low enough of a price. I don't believe they have the same margin for the base model compared to the base model + memory upgrade.
hyperhello•41m ago
Is this a shortage of every type of RAM simultaneously?
internetter•38m ago
Essentially yes, not necessarily equivalently but every type has increased substantially
jsheard•38m ago
Every type of DRAM is ultimately made at the same fabs, so if one type is suddenly in high demand then the supply of everything else is going to suffer.
bee_rider•31m ago
Wait, really? For CPUs each generation needs basically a whole new fab, I thought… are they more able to incrementally upgrade RAM fabs somehow?
selectodude•11m ago
The old equipment is mothballed because china is the only buyer and nobody wants to do anything that the Trump admin will at some point decide is tariff-worthy. So it all sits.
fithisux•40m ago
32GB should be more than enough.

You can go 16GB if you go native and throw some assembly in the mix. Use old school scripting languages. Debloat browsers.

It has been long delayed.

Night_Thastus•38m ago
16GB is more than fine if you're not doing high-end gaming, or heavy production workloads. No need for debloating.

But it doesn't matter either way, because both 16 and 32GB have what, doubled, tripled? It's nuts. Even if you say "just buy less memory", now is a horrible time to be building a system.

Aardwolf•32m ago
I found web browser tabs eating too much memory when you only have 16GB
felixfurtak•36m ago
“640K ought to be enough for anybody.” - Bill Gates
shawndumas•29m ago
there's no reliable evidence he ever uttered that phrase
felixfurtak•8m ago
Doesn't matter. It's folklore.
franciscojs•31m ago
I bought a motherboard to build a DIY NAS... takes DDR5 SO-DIMM RAM and only 16gb costs more than double the motherboard (which includes an intel processor)
harvey9•26m ago
Hey, hey 16k What does that get you today?

https://m.youtube.com/watch?v=IagZIM9MtLo

khannn•13m ago
16GB is more than enough on Linux, but Win11 eats resources like crazy
Loic•38m ago
I think the OpenAI deal to lock wafers was a wonderful coup. OpenAI is more and more losing ground against the regularity[0] of the improvements coming from Anthropic, Google and even the open weights models. By creating a chock point at the hardware level, OpenAI can prevent the competition from increasing their reach because of the lack of hardware.

[0]: For me this is really an important part of working with Claude, the model improves with the time but stay consistent, its "personality" or whatever you want to call it, has been really stable over the past versions, this allows a very smooth transition from version N to N+1.

codybontecou•37m ago
This became very clear with the outrage, rather than excitement, of forcing users to upgrade to ChatGPT-5 over 4o.
Grosvenor•24m ago
Could this generate pressure to produce less memory hungry models?
hodgehog11•5m ago
There has always been pressure to do so, but there are fundamental bottlenecks in performance when it comes to model size.

What I can think of is that there may be a push toward training for exclusively search-based rewards so that the model isn't required to compress a large proportion of the internet into their weights. But this is likely to be much slower and come with initial performance costs that frontier model developers will not want to incur.

hodgehog11•24m ago
I don't see this working for Google though, since they make their own custom hardware in the form of the TPUs. Unless those designs include components that are also susceptible?
frankchn•20m ago
TPUs use HBM, which are impacted.
bri3d•20m ago
Still susceptible, TPUs need DRAM dies just as much as anything else that needs to process data. I think they use some form of HBM, so they basically have to compete alongside the DDR supply chain.
hnuser123456•18m ago
Sure, but if the price is being inflated by inflated demand, then the suppliers will just build more factories until they hit a new, higher optimal production level, and prices will come back down, and eventually process improvements will lead to price-per-GB resuming its overall downtrend.
malfist•15m ago
Micron has said they're not scaling up production. Presumably they're afraid of being left holding the bag when the bubble does pop
Analemma_•12m ago
Not just Micron, SK Hynix has made similar statements (unfortunately I can only find sources in Korean).

DRAM manufacturers got burned multiple times in the past scaling up production during a price bubble, and it appears they've learned their lesson (to the detriment of the rest of us).

mholm•13m ago
Chip factories need years of lead time, and manufacturers might be hesitant to take on new debt in a massive bubble that might pop before they ever see any returns.
nutjob2•13m ago
Memory fabs take billions of dollars and years to build, also the memory business is a tough one where losses are common, so no such relief in sight.

With a bit of luck OpenAI collapses under its own weight sooner than later, otherwise we're screwed for several years.

citizenpaul•38m ago
> Micron's killing the Crucial brand of RAM and storage devices completely,

More rot economy. Customers are such a drag. Lets just sell to other companies for billion dollar deals at once. These AI companies have bottomless wallets. No one has thought of this before we will totally get rich.

MengerSponge•30m ago
"I don't want to make a little bit of money every day. I want to make a fuck ton of money all at once."

https://www.youtube.com/watch?v=BzAdXyPYKQo

aynyc•37m ago
Ha! Maybe Javascript developers will finally drop memory usage! You need to display the multiplication table? Please allocate 1GB of RAM. Oh, you want alternate row coloring? Here is another 100MB of CSS to do that.
phantasmish•3m ago
I do sometimes reflect on how 64MB of memory was enough to browse the Web with two or three tabs open, and (if running BeOS) even play MP3s at the same time with no stutters. 128MB felt luxurious at that time, it was like having no (memory-imposed) limits on personal computing tasks at all.

Now you can't even fit a browser doing nothing into that memory...

nish__•37m ago
Anyone want to start a fab with me? We can buy an ASML machine and figure out the rest as we go. Toronto area btw
jacquesm•35m ago
I hope you have very deep pockets. But I'm cheering you on from the sidelines.
nish__•32m ago
Just need a half billion in upfront investment. And thank you for the support :)
dylan604•15m ago
So, playing the Mega Powerball are you?
tmaly•30m ago
that is an understatement
bhhaskin•31m ago
Only if you put up the 10 billion dollars.
nish__•26m ago
Machines are less than 400 million.
pixl97•18m ago
And the cost of the people to run those machines, and the factories that are required to run the machines?
GeekFortyTwo•30m ago
As someone with no skills in the space, no money, and lives near Ottawa: I'd love to help start a fab in Ontario.
nish__•24m ago
Right on, partner. I think there's a ton of demand for it tbh

I'll do the engineering so we're good on that front. Just need investors.

mindcrime•1m ago
I think I have a few dollars left on a Starbucks gift card. I'm in!
deuplonicus•23m ago
Sure, we can work on brining in TinyTapeout to modern fab
Reason077•20m ago
A dozen or so well-resourced tech titans in China are no doubt asking themselves this same question right now.

Of course, it takes quite some time for a fab to go from an idea to mass production. Even in China. Expect prices to drop 2-3 years from now when all the new capacity comes online?

dylan604•16m ago
At that point, it'll be the opposite problem as more capacity than demand will be available. These new fabs won't be able to pay for themselves. Every tic receives a tok.
umanwizard•14m ago
China cannot buy ASML machines. All advanced semiconductor manufacturing in China is done with stockpiled ASML machines from before the ban.
gizmo•36m ago
The big 3 memory manufacturers (SK Hynix, Samsung, Micron) are essentially all moving upmarket. They have limited capacity and want to use it for high margin HBM for GPUs and ddr5 for servers. At the same time CXMT, Winbond and Nanya are stepping in at the lower end of the market.

I don't think there is a conspiracy or price fixing going on here. Demand for high profit margin memory is insatiable (at least until 2027 maybe beyond) and by the time extra capacity comes online and the memory crunch eases the minor memory players will have captured such a large part of the legacy/consumer market that it makes little sense for the big 3 to get involved anymore.

Add to that scars from overbuilding capacity during previous super memory super cycles and you end up with this perfect storm.

stevenjgarner•34m ago
My understanding is that this is primarily hitting DDR5 RAM (or better). With prices so inflated, is there an argument to revert and downgrade systems to DDR4 RAM technology in many use cases (which is not so inflated)?
cptnapalm•31m ago
DDR 4 shot up too. It was bad enough that instead of trying to put together a system with the AM4 m/b I already have, I just bought a Legion Go S.
Numerlor•30m ago
DDR4 manufacturing is mostly shut down, so if any real demand picks starts there the prices will shoot up
gizmo•30m ago
No DDR4 is affected too. It's a simple question of production and demand, and the biggest memory manufacturers are all winding down their DDR4/DDR5 memory production for consumers (they still make some DDR5 for OEMS and servers).
tencentshill•30m ago
It will be hit just as hard, they have stopped new DDR4 production to focus on DDR5 and HBM.
segmondy•20m ago
DDR4 prices have gone up 4x in the last 3 months.
geerlingguy•19m ago
Linked in the article, DDR4 and LPDDR4 are also 2-4x more expensive now, forcing smaller manufactures to raise prices or cancel some products entirely.
phendrenad2•34m ago
I'm way ahead of all of you, I'm hoarding DDR2.
altmanaltman•33m ago
I mean what's the big deal, can't we just download more ram
submeta•33m ago
Very happy to have bought a MBP M4 with 64 gb of Ram last year.
wslh•28m ago
And sharing the RAM between your CPU/GPU/NPU instead of using separate memories.
SchwKatze•31m ago
I just gathered enough money to build my new PC. I'll even go to another country to pay less taxes, and this spike hit me hard. I'll buy anyway because I don't believe it will slow down so soon. But yeah, for me is a lot of money
rolandog•26m ago
Me too. I had saved up to make a small server. I guess I'll have to wait up until 2027–2028 at this rate.
dylan604•14m ago
Buy used gear and rip out the guts???
comeonbro•31m ago
This is ultimately the first stage of human economic obsolescence and extinction.

This https://cdna.pcpartpicker.com/static/forever/images/trends/2... will happen to every class of thing (especially once it hits energy, because everything is downstream of that).

kalterdev•27m ago
Why should we believe in another apocalypse prediction?
IAmBroom•15m ago
One of them has to be right, eventually!
gooseus•14m ago
Because the collapse of complex societies is real - https://github.com/danielmkarlsson/library/blob/master/Josep...

Unbounded increases in complexity lead to diminishing returns on energy investment and increased system fragility which both contribute to an increased likelihood of collapse as solutions to old problems generate new problems faster than new solutions can be created since energy that should be dedicated to new solutions is needed to maintain the layers of complexity generated by the layers of previous solutions.

captainkrtek•25m ago
I'm no economist, but if (when?) the AI bubble bursts and demand collapses at the price point memory and other related components are at, wouldn't price recover?

not trying to argue, just curious.

reducesuffering•7m ago
IF a theoretical AI bubble bursts sure. However the largest capitalized companies in the world and all the smartest people able to do cutting edge AI research are betting otherwise. This is also what the start of a takeoff looks like
squidbeak•7m ago
I'm no economist either, but I imagine the manufacturing processes for the two types of RAM are too different for supply to quickly bounce back.
benlivengood•23m ago
If your argument is that value produced per-cpu will increase so significantly that the value produced by AGI/ASI per unit cost exceeds what humans can produce for their upkeep in food and shelter, then yes that seems to be one of the significant risks long term if governments don't intervene.

If the argument is that prices will skyrocket simply because of long-term AI demand, I think that ignores the fact that manufacturing vastly more products will stabilize prices up to the point that raw materials start to become significantly more expensive, and is strongly incentivized over the ~10-year timeframe for IC manufacturers.

kace91•1m ago
>the value produced by AGI/ASI per unit cost exceeds what humans can produce for their upkeep in food and shelter

The value of AGI/ASI is not only defined by its practical use, It is also bounded by the purchasing power of potential consumers.

If humans aren’t worth paying, those humans won’t be paying anyone either. No business can function without customers, no matter how good the product.

asdfman123•31m ago
I can't help but be the pessimist angle. RAM production will need to increase to supply AI data centers. When the AI bubble bursts (and I do believe it will), the whole computing supply chain, which has been built around it, will take a huge hit too. Excess production capacity.

Wonder what would happen if it really takes a dive. The impact on the SF tech scene will be brutal. Maybe I'll go escape on a sailboat for 3 years or something.

Anyway, tangential, but something I think about occasionally.

roadside_picnic•31m ago
I know this is mostly paranoid thinking on my behalf, but it almost feels like this is a conscious effort to attempt to destroy "personal" computing.

I've been a huge advocate for local, open, generative AI as the best resistance to massive take-over by large corporations controlling all of this content creation. But even as it is (or "was" I should say), running decent models at home is prohibitively expensive for most people.

Micron has already decided to just eliminate the Crucial brand (as mentioned in the post). It feels like if this continues, once our nice home PCs start to break, we won't be able to repair them.

The extreme version of this is that even dumb terminals (which still require some ram) will be as expensive as laptops today. In this world, our entire computing experience is connecting a dumb terminal to a ChatGPT interface where the only way we can interact with anything is through "agents" and prompts.

In this world, OpenAI is not overvalued, and there is no bubble because the large LLM companies become computing.

But again, I think this is mostly a dystopian sci-fi fiction... but it does sit a bit too close to the realm of possible for my tastes.

ben_w•27m ago
The first "proper" "modern" computer I had, initially came with 8 megabytes of RAM.

It's not a lot, but it's enough for a dumb terminal.

rolandog•21m ago
That's not disproving OP's comment; OpenAI is, in my opinion, making it untenable for a regular Joe to build a PC capable of running local LLM model. It's an attack on all our wallets.
petre•9m ago
Why do you need a LLM running locally so much that's the inflated RAM prices are an attack on your wallet? One can always opt not to play this losing game.

I remember when the crypto miners rented a plane to deliver their precious GPUs.

plufz•23m ago
I don’t think you need a conspiracy theory to explain this. This is simply capitalism, a system that seems less and less like the way forward. I’m not against markets, but I believe most countries need more regulations targeted at the biggest companies and richest people. We need stronger welfare states, smaller income gaps and more democracy. But most countries seems to vote in the absolute opposite direction.
BizarroLand•5m ago
The end goal of capitalism is the same as the end goal of monopoly.

1 person has all the money and all the power and everyone else is bankrupt forever and sad.

dangus•20m ago
It’s not a conspiracy, it’s just typical dumb short term business decisions amplified and enabled by a cartel supply market.

If Crucial screws up by closing their consumer business they won’t feel any pain from it because the idea of new competitors entering the space is basically impossible.

SimianSci•7m ago
Wouldn't the easy answer to this be increased efficiency of RAM usage?

RAM being plentiful and cheap led to a lot of software development being very RAM-unaware, allowing the inefficiencies of programs to be mostly obfuscated from the user. If RAM prices continue rising, the semi-apocalytic consumer fiction you've spun here would require that developers not change their behaviors when it comes to software they write. There will be an equillibrium in the market that still allows the entry of consumer PC's it will just mean devices people buy will have less available RAM than is typical. The demand will eventually match up to the change in supply as is typical of supply/demand issues and not continuously rise into an infinite horizon.

walterbell•29m ago
If the OpenAI Hodling Company buys and warehouses 40% of global memory production or 900,000 memory wafers (i.e. not yet turned into DDR5/DDR6 DIMMs) per month at price X in October 2025, leading to supply shortages and tripling of price, they have the option of later un-holding the warehoused memory wafers for a profit.

https://news.ycombinator.com/item?id=46142100#46143535

  Had Samsung known SK Hynix was about to commit a similar chunk of supply — or vice-versa — the pricing and terms would have likely been different. It’s entirely conceivable they wouldn’t have both agreed to supply such a substantial part of global supply if they had known more...but at the end of the day - OpenAI did succeed in keeping the circles tight, locking down the NDAs, and leveraging the fact that these companies assumed the other wasn’t giving up this much wafer volume simultaneously…in order to make a surgical strike on the global RAM supply chain..
What's the economic value per warehoused and insured cubic inch of 900,000 memory wafers? Grok response:

> As of late 2025, 900,000 finished 300 mm 3D NAND memory wafers (typical high-volume inventory for a major memory maker) are worth roughly $9 billion and occupy about 104–105 million cubic inches when properly warehoused in FOUPs. → Economic value ≈ $85–90 per warehoused cubic inch.

petre•17m ago
Sounds like the Silver Thursday all over again. I hope OpenAI ends up like the Hunt Btothers.

https://en.wikipedia.org/wiki/Silver_Thursday

radicality•29m ago
Think the article should also mention how OpenAI is likely responsible for it. Good article I found from another thread here yesterday: https://www.mooreslawisdead.com/post/sam-altman-s-dirty-dram...
diabllicseagull•16m ago
yes. on the moore's law is dead podcast they were talking about rumors where some 'AI enterprise company's representatives' were trying to buy memory in bulk from brick and mortar stores. in some cases openai was mentioned. crazy if true. also interesting considering none of those would be ECC certified like what you would opt for for a commercial server.
comeonbro•9m ago
This is an aggressively stupid medieval villager thing I'm seeing people do more and more.

Blaming OpenAI for this like it's some sort of targetted evil hostile act is like blaming China for industrial pollution: yeah, you outsourced all your industrial production to them.

mschuster91•29m ago
> The reason for all this, of course, is AI datacenter buildouts. I have no clue if there's any price fixing going on like there was a few decades ago—that's something conspiracy theorists can debate—but the problem is there's only a few companies producing all the world's memory supplies.

So it's the Bitcoin craze all over again. Sigh. The bubble will eventually collapse, it has to - but the markets can stay irrational longer than you can stay solvent... or, to use a more appropriate comparison, have a working computer.

I for myself? I hope once this bubble collapses, we see actual punishments again. Too-large-to-fail companies broken up, people getting prosecuted for the wash trading masquerading itself as "legitimate investments" in the entire bubble (that more looks like the genetic family table of the infamously incestuous Habsburg family), greedy executives jailed or, at least where national security is impacted due to chip shortages, permanently gotten rid of. I'm sick and tired of large companies being able to just get away with gobbling up everything, killing off the economy at large, they are not just parasites - they are a cancer, killing its host society.

otherayden•27m ago
I think we kiss of deathed the article haha. Here's an archive https://archive.is/6QD8c
carlCarlCarlCar•26m ago
Pricing compute out of the average persons budget to prop up investment in data centers, stocks, ultimately control agency

If an RTX 5000 series price topped out at historical prices no one would need hosted AI

Then it came to be that models were on a path to run well enough loaded into RAM... uh oh

This is in line with ISPs long ago banning running personal services and the long held desire to sell dumb thin clients that must work with a central service

Web developers fell for confidence games of old elders hook line and sinker. Nothing but the insane ego and vanity of some tech oligarchs driving this. They cannot appear weak. Vain aura farming, projection of strength.

zoobab•26m ago
"dig into that pile of old projects you never finished instead of buying something new this year."

You don't need a new PC. Just use the old one.

kevin_thibedeau•22m ago
I just bought some 30pin SIMMs to rehab an old computer. That market is fine.
fullstop•17m ago
I have a bag of SIMMs that I saved, no idea why, because I clearly wrote BAD on the mylar bag.

At time time I was messing around with the "badram" patch for Linux.

ogogmad•24m ago
Every shortage is followed by a glut. Wait and see for RAM prices to go way down. This will happen because RAM makers are racing to produce units to reap profits from the higher price.
ok_dad•24m ago
I am very excited for a few years when the bubble bursts and all this hardware is on the market for cheap like back in the early to mid 2000's after that bubble burst and you had tons of old servers available for homelabs. I can't wait to fill a room with 50kW of bulk GPUs on a pallet and run some cool shit.
JKCalhoun•24m ago
> maybe it's a good time to dig into that pile of old projects you never finished instead of buying something new this year.

Always good advice.

haunter•23m ago
panem et circenses

But what will happen when people are priced out from the circus?

mikelitoris•17m ago
Companies are adamant about RAMming AI down our throats, it seems.
AceJohnny2•16m ago
> And those companies all realized they can make billions more dollars making RAM just for AI datacenter products, and neglect the rest of the market.

I wouldn't ascribe that much intent. More simply, datacenter builders have bought up the entire supply (and likely future production for some time), hence the supply shortfall.

This is a very simple supply-and-demand situation, nothing nefarious about it.

MPSimmons•15m ago
This reminds me of the recent LaurieWired video presenting a hypothetical of, "what if we stopped making CPUs": https://www.youtube.com/watch?v=L2OJFqs8bUk

Spoiler, but the answer is basically that old hardware rules the day because it lasts longer and is more reliable of timespans of decades.

DDR5 32GB is currently going for ~$330 on Amazon

DDR4 32GB is currently going for ~$130 on Amazon

DDR3 32GB is currently going for ~50 on Amazon (4x8GB)

For anyone where cost is a concern, using older hardware seems like a particularly easy choice, especially if a person is comfortable with a Linux environment, since the massive droves of recently retired Windows 10 incompatible hardware works great with your Linux distro of choice.

fullstop•12m ago
If everyone went for DDR4 and DDR3, surely the cost would go up. There is no additional supply there, as they are no longer being made.
MPSimmons•8m ago
Undoubtably the cost would go up, but nobody is building out datacenters full of DDR4, either, so I don't figure it would go up nearly as much as DDR5 is right now.
fullstop•5m ago
https://pcpartpicker.com/trends/price/memory/

You can see the cost rise of DDR4 here.

MPSimmons•1m ago
Awesome charts, thanks! I think it bears out that the multiplier for older hardware isn't as extreme as the newer hardware, right?
acdha•7m ago
At some point that’s true, but don’t they run the n-1 or 2 generation production lines for years after the next generation launches? There’s a significant capital investment there and my understanding is that the cost goes down significantly over the lifetime as they dial in the process so even though the price is lower it’s still profitable.
fullstop•3m ago
Unless plans have changed, the foundries making DDR4 are winding down, with the last shipments going out as we speak.
christkv•11m ago
A friend built a new rig and went with DDR4 and a 5800x3d just because of this as he needed a lot of ram.
diabllicseagull•9m ago
a 2x16 ddr4 kit I bought in 2020 for $160 is now $220. older memory is relatively cheap but not cheaper than before at all.
bullen•6m ago
Yes, DDR3 is the lowest CAS latency and lasts ALOT longer.

Just like SSDs from 2010 have 100.000 writes per bit instead of below 10.000.

CPUs might even follow the same durability pattern but that remains to be seen.

Keep your old machines alive and backed up!

jl6•13m ago
Can someone explain why OpenAI is buying DDR5 RAM specifically? I thought LLMs typically ran on GPUs with specialised VRAM, not on main system memory. Have they figured out how to scale using regular RAM?
fullstop•11m ago
They're not. They are buying wafers / production capacity to make HBM so there is less DDR5 supply.
jl6•9m ago
OK, fair enough, but what are OpenAI doing buying production capacity rather than, say, paying NVIDIA to do it? OpenAI aren’t the ones making the hardware?
fullstop•7m ago
Because they can provide the materials to NVIDIA for production and prevent Google, Anthropic, etc from having them.
snuxoll•3m ago
Just because Nvidia happily sells people discrete GPU's, DGX systems, etc., doesn't mean they would turn down a company like OpenAI paying them $$$ for just the packaged chips and the technical documentation to build their own PCBs; or, let OpenAI provide their own DRAM supply for production on an existing line.

If you have a potentially multi-billion dollar contract, most businesses will do things outside of their standard product offerings to take in that revenue.

Thegn•8m ago
They didn't buy DDR5 - they bought raw wafer capacity and a ton of it at that.
christkv•12m ago
I grabbed a framework desktop with 128GB due to this. I can't imagine they can keep the price down for the next batches. If you bought 128GB of ram with "close" specs to the one used just that would be 1200 EUR at retail (who are obviously taking advantage).
RachelF•9m ago
Perhaps we'll have to start optimizing software for performance and RAM usage again.

I look at MS Teams currently using 1.5GB of RAM doing nothing.

hathawsh•9m ago
The article suggests that because the power and cooling are customized, it would take a ton of effort to run the new AI servers in a home environment, but I'm skeptical of that. Home-level power and cooling are not difficult these days. I think when the next generation of AI hardware comes out (in 3-5 years), there will be a large supply of used AI hardware that we'll probably be able to repurpose. Maybe we'll sell them as parts. It won't be plug-and-play at first, but companies will spring up to figure it out.

If not, what would these AI companies do with the huge supply of hardware they're going to want to get rid of? I think a secondary market is sure to appear.

topaz0•9m ago
I wonder how much of that RAM is sitting in GPUs in warehouses waiting for datacenters to be built or powered?
bibimsz•7m ago
time to stop using python boys, it's zig from here on out
QuadrupleA•6m ago
Only a matter of time before supply catches up and then likely overshoots (maybe combined with AI / datacenter bubble popping), and RAM becomes dirt cheap. Sucks for those who need it now though.
delichon•3m ago
Public Service Announcement: One or other of my two DDR5 cards that I bought two years ago is now acting up and I have to buy a new one. So the price of memory is due to crash as soon as my return windows closes. Unless of course I were to bet on that happening.
seanalltogether•59s ago
I wonder if these RAM shortages are going to cause the Steam Machine to be dead on arrival. Valve is probably not a big enough player to have secured production guarantees like Sony or Nintendo would have. If they try to launch with a price tag over $700, they're not going to get a lot of sales.