frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Rethinking PostgreSQL Storage

https://www.ubicloud.com/blog/time-to-rethink-postgresql-storage
25•furkansahin•1d ago

Comments

fake-name•1d ago
* if you're doing cloud stuff.

Otherwise, continue as normal.

It turns out that local drives continue to be faster then remote drives. Who would have thought?

speedbird•1d ago
Well this is quite a simplification and also happens to miss out a while swathe of history.

There’s a massive it depends, not all about basic performance.

hanikesn•1d ago
Yeah storage appliances predate public clouds fo at least a decade. Not even talking about mainframes etc.
kevincox•1d ago
Honestly the takeaway I get from this is that Auora is pretty incredible (possible consistency bugs aside) in that it gets nearly the performance of local disk without the risk of data loss and downtime due to hardware failure (although the more complex architecture can of course cause data loss and failure due to other problems).
isoprophlex•1d ago
This is an advert, trying to sell you something. The only bits of information that could be tangentially interesting is "local drives outperform network attached storage", or, "aws can get really expensive". But none of these things are particularly novel findings.
9dev•1d ago
Still makes for compelling reasons to choose a different architecture for new database deployments than you used to; datacenter offerings from the likes of Hetzner can be a vastly superior choice over cloud providers for IO-intensive workloads like database servers.
ozgune•1d ago
Question to author.

Are you planning to publish CH benchmarks (TPC-C and TPC-H combined)? I'd expect Aurora to perform much worse on CH than on TPC-C/H. That's because Aurora pushes the WAL logs to replicated shared storage. Since you only need quorum on a write, you get a fast ack on the write (TPC-C). The way you've run TPC-H doesn't modify the data that much, so you also get baseline Postgres performance.

However, when you're pushing writes and you have a sequential scan over the data, then Aurora needs to reconcile the WAL writes, manage locks, etc. CH benchmark exercises that path and I'd expect it to notably slow down Aurora.

(Disclaimer: ex-Citus and current Ubicloud founder)

pwmtr•1d ago
Yes, that is correct. That said, in our tests we only saw 2x improvements in CH benchmarks. However, we found out that it was due to an architectural issue in our VM I/O path and how we virtualize the storage. Based on our estimations we should see ~5x difference but for that we need to revamp our storage virtualization first.

We have plans for publishing a CH benchmark results on a follow up blog post. However, we didn't want to do that for now to not put misleading results.

regularfry•1d ago
What surprised me here is how close Aurora got. That's some magic right there.

I've always held that if you want resilience, you just cannot rely on local storage. No matter how many times you've got data replicated locally, you're still at risk of the whole machine failing - best case falling off the network, worst case trashing all its disks in some weird failure state as the RAID firmware decides today is the day to Just Not. And while you might technically still be able to recover the data, you're still offline.

You just need your data to be off the machine already when that happens. Not to say that all access needs to go over the network - local caching ought to go a long way here - but the default should be to switch to another machine and recycle the failed one.

Relevant to the article, this is independent of the speed and reliability of the actual hardware. It was true in 2010, it's true now.

jbverschoor•1d ago
Please add [Ad] to the title
lionls•1d ago
no network layer for local drives, therefore faster than remote drives
fmajid•1d ago
This is supposed to be news? Databases moved to SSDs 15 years ago, but it’s true the high-latency SAN mindset lingers in its reincarnation as EBS.
SonOfLilit•1d ago
There's this amazing gif at the top that shows local storage running circles around network storage, and then the benchmarks are... x1.5-x4? I feel like the graphic is very misleading here...
kakoni•1d ago
> standard-8 instance (comes with 8 vCPU, 32GB RAM and local NVMe SSD)

So were they using the GD instances? (With XXgd instances, local NVMe-based SSDs are physically connected to the host server..) or something else?

panrobo•1d ago
there is a middle ground where you can get NVMe-optimized networked storage with solutions like simplyblock. It gives you local-like performance but separates compute from storage and gives more options for backup & DR.
kkfx•1d ago
I agree but... NVME actually is also network attachable!

Beside that IMVHO the future of cloud, meaning the modern mainframe, is the cluster, or decentralized applications run from homes and sheds with p.v. and local storage, the desktop at the center. Because we can't live with such centralization, we can't evolve and we can't even be democracies with such model where information in in the hands of very few at such level of details. With FTTH, p.v., energy storage, IT development we could came back to the original interconnected desktop model sparing resources instead of consuming more.

Smart suggestions on your Fish shell, without AI

https://www.edu4rdshl.dev/
1•edu4rdshl•1m ago•0 comments

Show HN: CrowdRender – collaborative rendering plugin for Blender

https://www.crowd-render.com
1•heffalump•3m ago•0 comments

Show HN: Hashish v5.5.1 – C++ Hash Cracker, Extreme Performance Boost

https://github.com/Karim93160/hashish
1•karim7793•5m ago•0 comments

Tim Sweeney Didn't Expect a Five-Year Fortnite Ban

https://www.theverge.com/games/678885/epic-games-ceo-tim-sweeney-five-year-fortnite-ban
1•m463•7m ago•0 comments

The OpenAI Board Drama Is Turning into a Movie

https://www.hollywoodreporter.com/movies/movie-news/luca-guadagnino-to-direct-openai-movie-1236236357/
2•m463•11m ago•1 comments

Show HN: Certificate transparency log with LSM-tree based storage

https://github.com/Barre/compact_log
2•Eikon•13m ago•0 comments

Qt's New Bridging Technology – Looking Back to Move Forward

https://www.qt.io/blog/about-the-new-qt-bridging-technology
1•heavyset_go•14m ago•0 comments

Where's Marty McFly's guitar? Search for Back to the Future prop 4 decades later

https://apnews.com/article/back-to-future-guitar-lost-570b6a17359b31a04996fcd89fadcca1
2•WalterGR•14m ago•0 comments

Chocolate-quake: A purist Quake source port

https://github.com/Henrique194/chocolate-quake
1•todsacerdoti•18m ago•0 comments

IAS Interview with Demis Hassabis on the Future of Knowledge [video]

https://www.youtube.com/watch?v=TgS0nFeYul8
1•pixelpoet•21m ago•1 comments

Cook My Meat

https://up.csail.mit.edu/science-of-cooking/home-screen.html
1•kmstout•21m ago•0 comments

June of Stories: Read a Short Story Every Day in June

https://www.juneofstories.com/
1•astro-•22m ago•0 comments

If This, Then That, Except for When

https://www.chrbutler.com/2025-06-03
3•delaugust•23m ago•0 comments

Things are different between system and application monitoring

https://utcc.utoronto.ca/~cks/space/blog/sysadmin/SystemVsApplicationMonitoring
1•todsacerdoti•24m ago•0 comments

Aurora DSQL: How to spend a dollar

https://marc-bowes.com/dsql-how-to-spend-a-dollar.html
1•cebert•28m ago•0 comments

Meta pauses mobile port tracking tech on Android after researchers cry foul

https://www.theregister.com/2025/06/03/meta_pauses_android_tracking_tech/
2•coloneltcb•29m ago•1 comments

American Malware

https://quality.ghost.io/american-malware/
1•notkoalas•30m ago•1 comments

How China Uses Work to Reshape Uyghur Identity and Control a Strategic Region

https://www.nytimes.com/2025/05/29/world/asia/china-uyghur-labor.html
1•suraci•30m ago•0 comments

A Meme Generator MCP

https://github.com/tuananh/hyper-mcp/tree/main/examples/plugins/meme-generator
2•tuananh•31m ago•0 comments

Adopting Docs-as-Code at Pinterest

https://medium.com/pinterest-engineering/adopting-docs-as-code-at-pinterest-4f18ad169c25
3•keyworks•34m ago•0 comments

Brain aging shows nonlinear transitions, suggesting a midlife "critical window"

https://www.pnas.org/doi/10.1073/pnas.2416433122
7•derbOac•35m ago•0 comments

Jeff Bezos' risky bet (2006)

https://www.nbcnews.com/id/wbna15536386
2•spking•35m ago•0 comments

Show HN: Humanizeai.fun Free AI Humanizer

https://humanizeai.fun/
2•zaddyzaddy•36m ago•0 comments

RackColo: Find Server Colocation Plans

https://rackcolo.com/
1•da02•37m ago•0 comments

Nintendo Video for 3DS and Lost Media

https://lilysthings.org/blog/nintendo-video/
1•zdw•39m ago•0 comments

About the AI Apocalypse

https://www.x-pose.org/2025/06/03/about-the-ai-apocalypse/
3•xpose2000•40m ago•1 comments

A new cloud serverless database built for the edge

https://zephyrdb.com/
1•victoradventure•42m ago•0 comments

Google Archives Kaniko

https://github.com/GoogleContainerTools/kaniko/pull/3502
1•markmandel•43m ago•1 comments

Experimental evidence for the physical delocalization of individual photons

https://arxiv.org/abs/2505.00336
1•westurner•48m ago•0 comments

Functional unemployment rate soars past 24%

https://newpittsburghcourier.com/2025/06/03/true-unemployment-rate-soars-past-24-black-workers-hit-hardest/
14•MarcoDewey•53m ago•3 comments