frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Stop Cramming Everything into Postgres

3•saisrirampur•6mo ago
Loved the discussion on this hn post few months ago on Postgres for everything. https://news.ycombinator.com/item?id=42347606 I thought I'd share my thoughts over a separate post. I see a bunch of comments: just don’t do it! I’m glad this is becoming mainstream, and people are realizing that Postgres for everything doesn’t work. Don’t get me wrong—I’m a huge Postgres proponent and have spent 10 years helping customers implement it. However, I’m a strong believer in using Postgres for what it’s designed for in first-place. Postgres was designed as a row-based OLTP database, with over 30 years of effort dedicated to making it robust for that use case.

I know there are many extensions attempting to make Postgres support other use cases, such as analytics, queues, and more. Keep in mind that these extensions are relatively recent and aim to retrofit new capabilities onto a database primarily designed for transactional workloads. It’s like adding an F1 car engine to a Toyota Camry — will that work?

Extensions also have many issues—they are not fully Postgres-compatible. In Citus, for example, we added support for the COPY command 4 years into the company, and chasing SQL coverage was a daily challenge for 10 years. Unable to use the full capabilities of Postgres and having to work around numerous unsupported features defeats the purpose of being a Postgres extension. This was a common feedback across Citus customers - when you say Postgres extension, customers are looking for something that supports all Postgres features! Side note for the Postgres extension companies: Chasing Postgres compatibility and world class performance are ginormous problems and are hard to achieve without laser focus on each of them.

On the other hand, you have purpose-built alternatives like ClickHouse, Snowflake for analytics, Redis for caching, and Kafka for queues. These technologies have benefited from decades of development, laser-focused on supporting specific use cases. As a result, they are highly efficient for their intended purposes.

I often hear that these Postgres extensions are expanding the boundaries of what Postgres can do. While I partly agree, I question the extent to which these boundaries are truly being expanded. In this era of AI, where data is growing exponentially, handling scale is critical for any technology. These boundaries will likely be broken very quickly - A data point here is that in my day-to-day now, I'm seeing AI companies use purpose-built technologies like ClickHouse way sooner. A few years ago, it was a Series A or Series B company that would consider a purpose-built database, now it is Seed stage companies. This is because the amount of data / users to be handled has grown tremendously from the get go and companies are preferring solutions that scale with their workload.

Also I keep hearing these Postgres extension companies say Zero ETL in their positioning, which I don't agree. Let’s take a search or an analytics extension where you want to run analytics on your transactional data. You either need to manage a cron to continuously offload the transactional data to the storage format of the extension or if the extension supports logical replication (not all do), you need to have logical replication setup. And logical replication is ETL! It is painful to manage logical replication - fun fact, at PeerDB, Postgres was the second largest target connector as logical replication was painful to manage, at scale. And yes, you could have capabilities which does the conversion in the background, but that is again a ginormous problem, I think only a few fully fledged databases like Vertica have this feature.

TL;DR: Please think carefully before choosing the right technology as you scale. Cramming everything into Postgres might not be the best approach for scaling your business.

Comments

gjvc•6mo ago
you do not need to use anything/everything you find in there, or anywhere for that matter.
XCSme•6mo ago
Most use-cases and people/companies don't have the traffic amount where scaling matters that much, so performance gains will be negligible (or even worse) when using a more complex "specialized" stack.

Yes, if you have a large team, building for scale in a VC-funded company, go for dedicated stacks, but if you are just building a start-up where moving fast is important and architecture quickly changes, any DB will do and will not be the bottleneck.

I use Postgres to cache some responses from APIs (max 100 different documents per month) where latency doesn't matter, so using Redis instead would provide no benefit (will actually make it worse, due to its "worse" persistency and third-party integrations capabilities)

KDE going all-in on a Wayland future

https://blogs.kde.org/2025/11/26/going-all-in-on-a-wayland-future/
1•todsacerdoti•1m ago•0 comments

There may not be a safe off-ramp for some taking GLP-1 drugs, study suggests

https://arstechnica.com/health/2025/11/glp-1-drugs-improve-heart-health-but-only-if-you-keep-taki...
1•voxadam•2m ago•0 comments

Sophie – Senior Back end Engineer – London (Hybrid, 2 days/week) – Full-time

https://app.welcometothejungle.com/jobs/zgdcjy1T
1•juliosophiedoc•2m ago•1 comments

Traders Are Flooding Markets with Risky Bets. Robinhood's CEO Is Their Cult Hero

https://www.wsj.com/finance/robinhood-ceo-vlad-tenev-04e3ab28
1•thm•3m ago•0 comments

Dyalog v20.0 is now available for everyone

https://www.dyalog.com/dyalog/dyalog-versions/200.htm
1•pillowshift•5m ago•0 comments

Video Reveals How Far Wolves Will Go to Steal a Meal

https://www.nytimes.com/2025/11/17/science/wolf-tool-use-steal-food.html
1•bookofjoe•8m ago•1 comments

Burt Meyer, Inventor of Rock 'Em Sock 'Em Robots and Other Hit Toys, Dies at 99

https://www.wsj.com/business/retail/burt-meyer-toy-inventor-dead-674a37e2
1•fortran77•9m ago•1 comments

ESP32

https://en.wikipedia.org/wiki/ESP32
1•doener•10m ago•0 comments

HP Inc. Reports Fiscal 2025 Full Year and Fourth Quarter Results [pdf]

https://s203.q4cdn.com/918857832/files/doc_financials/2025/q4/Q425_HP-Inc-Earnings-Press-Release.pdf
1•doener•11m ago•0 comments

Metaphysical Priming reduces Gemini 3.0 Pro inference latency by 60%

https://github.com/Cactus-mp4/DATtest_Gemini3.0Pro_BenevolentJailbreak
1•cactus-jpg•13m ago•1 comments

TSMC sues former executive over defection to Intel

https://www.tomshardware.com/tech-industry/semiconductors/tsmc-sues-former-executive-over-defecti...
1•zvr•13m ago•0 comments

FileBrowser Quantum: The best free self-hosted web-based file manager

https://github.com/gtsteffaniak/filebrowser
1•thunderbong•15m ago•0 comments

Fire-blocking chemicals promise safer buildings

https://www.bbc.com/news/articles/ckgkee0pw4ko
1•ksec•15m ago•0 comments

The tech debt elephant: A product perspective

https://www.hyperact.co.uk/blog/tech-debt-a-product-perspective
1•birdculture•16m ago•0 comments

A Government Think Tank Trained the First Generation of US Software Developers

https://www.construction-physics.com/p/how-a-government-think-tank-trained
2•chmaynard•17m ago•0 comments

Show HN: Nasdaq ITCH parser that processes 107M messages/SEC

https://lunyn.com/blog/itch-parser-107m/
1•sundancegh•18m ago•1 comments

Voyager 1 Is About to Reach One Light-Day from Earth

https://scienceclock.com/voyager-1-is-about-to-reach-one-light-day-from-earth/
2•ashishgupta2209•20m ago•0 comments

Ask HN: Best learning path to build real apps with AI tools in 2025?

2•adilmoujahid•21m ago•0 comments

Loss.md

https://tech.lgbt/@graeme/115608824482129660
1•graemefawcett•23m ago•0 comments

Kraken's Standard App Charges Up to 14x More in Fees Than Kraken Pro

https://www.crypto-news.net/kraken-fees-instant-buy-vs-pro-comparison-2025/
1•zoransp•23m ago•1 comments

Show HN: Claude Opus 4.5 plays League of Legends

https://github.com/pravaco/cuaview-releases/tree/v0.2.0
1•sdan•23m ago•0 comments

Robinhood, Susquehanna Escalate Prediction-Market Arms Race

https://www.bloomberg.com/news/articles/2025-11-26/miax-sells-ledgerx-exchange-once-owned-by-ftx-...
2•noitpmeder•23m ago•1 comments

Topological turning points across the human lifespan

https://www.nature.com/articles/s41467-025-65974-8
1•gmays•24m ago•0 comments

Mean Time Between Failures

https://netwars.pelicancrossing.net/2025/11/21/mean-time-between-failure/
1•ColinWright•26m ago•0 comments

Microsoft Signing Transparency: Secure Software Supply Chains

https://azure.microsoft.com/en-us/blog/enhancing-software-supply-chain-security-with-microsofts-s...
2•speckx•26m ago•0 comments

Create and host a telegram bot with go

https://docs.codecapsules.io/tutorials/create-and-host-go-ai-telegram-bot
2•ritzaco•27m ago•0 comments

Forecasting Ability of LLMs Depends on What We're Asking

https://arxiv.org/abs/2511.18394
1•paraschopra•28m ago•0 comments

Show HN: LLM-models – a CLI tool to list available LLM models across providers

https://github.com/ljbuturovic/llm-models
2•ljubomir•28m ago•0 comments

Building a 64-Bit OS from Scratch with Claude Code

https://isene.org/2025/11/SimplicityOS.html
2•todsacerdoti•29m ago•0 comments

eazypm, npm package to reinstall project dep. with malware scanner (safe-chain)

https://www.npmjs.com/package/eazypm
1•nycalexander•30m ago•1 comments