Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM

https://blog.vectorchord.ai/how-we-made-100m-vector-indexing-in-20-minutes-possible-on-postgresql

92•gaocegege•2mo ago

Comments

duckbot3000•2mo ago

Kinda makes you wonder why you need cloud for anything besides remote encrypted backups if you can run all that on 12GB

setr•2mo ago

Because getting any hardware out of infra-team on premise is utterly miserable, across the board.

lelanthran•1mo ago

That's not the only alternative.

Rent your VPS and add in extra volumes for like $10 per 100GB.

Imustaskforhelp•1mo ago

Funny thing but netcup has $10 per 1 TB

Netcup is under-rated but there are also other providers too at lowendbox/lowendtalk and I am interested to try out hetzner too sometime.

benjiro•1mo ago

And if you want to go even cheaper, check out Hetzner their EX63 (go to custom) > 4x 7.68TB drives for like 140 Euro.

Not counting the fact that Netcup is raided (also Netcup is limited to 8TB on a VPS).

That is like 4.7 Euro /TB. That is like 4$/TB. 6 Euro / TB in a raid 5 setup.

I do not understand why they are not using this new pricing model on their older servers. There the best you can get is like 10 Euro /TB (for the single 15TB U.2).

lelanthran•1mo ago

> Funny thing but netcup has $10 per 1 TB

Nice to know, but I was just guessing at what a reasonable price would be :-)

riku_iki•2mo ago

what about failover story if server dies? PG failover setup is complicated, and cloud infra handles this for you.

positron26•1mo ago

Do we mean managed or PG on K8s like CNPG? In all cases, I use the infra to simplify things like having disk redundancy and failover nodes, not because 12GB is interesting.

riku_iki•1mo ago

Primary managed PG, since you still need setup/maintenance/monitoring on your K8S own solution.

positron26•1mo ago

You guys are doing monitoring? ;-)

logifail•1mo ago

(Genuine question) What's your current plan for when your cloud provider goes offline? Do you have a failover story, or it a case of "wait for them to come back online"?

riku_iki•1mo ago

I have backups on different cloud provider, so I could bootstrap db if provider goes dark indefinitely.

But realistically, I believe major clouds (google, aws) likely has more robust org and infra for recovery than I can built and maintain.

tjwebbnorfolk•1mo ago

What are you willing to pay for cloud-native failover?

Not every use case requires 100% uptime

riku_iki•1mo ago

Sure, but those who require (99% of major businesses) are ready to pay.

Nextgrid•1mo ago

Is that why most of them go down every time a single provider or even region goes down?

Actual active-active HA of your datastores is really hard to do (CAP theorem and all that). The majority of companies don't do it.

riku_iki•1mo ago

PG doesn't have active-active. Solution is to have multizone failover with replication.

benjiro•1mo ago

https://github.com/multigres/multigres ... when its complete. From the guy that made Vitess for Mysql.

And yes, i agree, the PG failover setup (and especially dealing with a failure afterwards, to restore the ex-master is beyond infuriating).

But its not pay 10x the amount, while eating easily 10x performance infuriating :)

Nextgrid•1mo ago

You don't, but business executives aren't the kind to easily admit they got conned - and if they're getting close to that stage, a nice dinner or golfing session paid by the vendor's representative generally alleviates those feelings very well.

Engineers who started their career during the cloud craze and don't know anything else are also not the kind to rock the boat, lest the cash cow dies and their whole "investment" in their career becomes useless.

nwellinghoff•2mo ago

Too bad aws does not support any of these other vector extensions in managed rds.

ayende•1mo ago

That suffer from a serious issue

You must have the data upfront, you cannot build this in an incremental fashion

There is also bo mention on how this would handle updates, and from the description, even if updates are possible, this will degrade over time, requiring new indexing batch

esafak•1mo ago

How does it compare with paradedb and lancedb?

q3k•1mo ago

> $272 monthly + GPU cost

Imagine paying $250+/mo for 32GB of RAM and 4 VCPUs. No wonder Amazon is swimming in cash, the markup on this is bonkers.

anko•1mo ago

100% this, i've been finding metal is getting very compelling against aws. For example latitude has 4 real cores and 32 GB of ram for $92/month.

https://www.latitude.sh/pricing/c2-small-x86?gen=gen-2

hetzner doesn't even have specs this low from what i can tell!

https://www.hetzner.com/dedicated-rootserver/#cores_threads_...

q3k•1mo ago

It has a VM with 32GB RAM and 4x the cores for 1/10th of the price: 25eur/mo. Effectively even lower because it has 20TB of included traffic, and the overage cost for it is ~1/10th of the AWS egress cost.

Or, for 184eur/mo you can get one of their bare metal GPU offerings with 64GB of RAM, a i5-13500 and an RTX4000.

paulddraper•1mo ago

+ 3.75 TB NVMe

And that’s the per second pricing applied 24/7 for a month. A year commitment takes 30% off.

Still a big markup, but a lot of these comparisons are the the on demand instant on/off price.

Scientists reverse Alzheimer's in mice and restore memory (2025)

Compiling Prolog to Forth [pdf]

Show HN: Cymatica – an experimental, meditative audiovisual app

GitBlack: Tracing America's Foundation

Horizon-LM: A RAM-Centric Architecture for LLM Training

We just ordered shawarma and fries from Cursor [video]

Correctio

Trying to make an Automated Ecologist: A first pass through the Biotime dataset

Watch Ukraine's Minigun-Firing, Drone-Hunting Turboprop in Action

Free Trial: AI Interviewer

FDA Intends to Take Action Against Non-FDA-Approved GLP-1 Drugs

Supernote e-ink devices for writing like paper

We are QA Engineers now

Show HN: Measuring how AI agent teams improve issue resolution on SWE-Verified

Adversarial Reasoning: Multiagent World Models for Closing the Simulation Gap

Show HN: Poddley.com – Follow people, not podcasts

Layoffs Surge 118% in January – The Highest Since 2009

Papyrus 114: Homer's Iliad

DicePit – Real-time multiplayer Knucklebones in the browser

Turn-Based Structural Triggers: Prompt-Free Backdoors in Multi-Turn LLMs

Show HN: AI Agent Tool That Keeps You in the Loop

Why Every R Package Wrapping External Tools Needs a Sitrep() Function

Achieving Ultra-Fast AI Chat Widgets

Show HN: Runtime Fence – Kill switch for AI agents

Researchers surprised by the brain benefits of cannabis usage in adults over 40

Peter Thiel warns the Antichrist, apocalypse linked to the 'end of modernity'

USS Preble Used Helios Laser to Zap Four Drones in Expanding Testing

Show HN: Animated beach scene, made with CSS

An update on unredacting select Epstein files – DBC12.pdf liberated

Was going to share my work

Scientists reverse Alzheimer's in mice and restore memory (2025)

Compiling Prolog to Forth [pdf]

Show HN: Cymatica – an experimental, meditative audiovisual app

GitBlack: Tracing America's Foundation

Horizon-LM: A RAM-Centric Architecture for LLM Training

We just ordered shawarma and fries from Cursor [video]

Correctio

Trying to make an Automated Ecologist: A first pass through the Biotime dataset

Watch Ukraine's Minigun-Firing, Drone-Hunting Turboprop in Action

Free Trial: AI Interviewer

FDA Intends to Take Action Against Non-FDA-Approved GLP-1 Drugs

Supernote e-ink devices for writing like paper

We are QA Engineers now

Show HN: Measuring how AI agent teams improve issue resolution on SWE-Verified

Adversarial Reasoning: Multiagent World Models for Closing the Simulation Gap

Show HN: Poddley.com – Follow people, not podcasts

Layoffs Surge 118% in January – The Highest Since 2009

Papyrus 114: Homer's Iliad

DicePit – Real-time multiplayer Knucklebones in the browser

Turn-Based Structural Triggers: Prompt-Free Backdoors in Multi-Turn LLMs

Show HN: AI Agent Tool That Keeps You in the Loop

Why Every R Package Wrapping External Tools Needs a Sitrep() Function

Achieving Ultra-Fast AI Chat Widgets

Show HN: Runtime Fence – Kill switch for AI agents

Researchers surprised by the brain benefits of cannabis usage in adults over 40

Peter Thiel warns the Antichrist, apocalypse linked to the 'end of modernity'

USS Preble Used Helios Laser to Zap Four Drones in Expanding Testing

Show HN: Animated beach scene, made with CSS

An update on unredacting select Epstein files – DBC12.pdf liberated

Was going to share my work

Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM

Comments