Ask HN: How can I load test PostgreSQL but avoid changing actual data?

1•LawZiL•1y ago

I'm running a load test on my Node.js application and want to simulate realistic write-heavy scenarios to stress test the system — especially the PostgreSQL database.

There's a part of the code that performs UPDATE queries, but during load testing, I don't want these updates to actually change the state of the database. However, I still want the database to experience the full impact of the update — query planning, locking, I/O, WAL writes, etc. — so I can measure how it affects performance under peak load.

Is there a best-practice approach to achieve this?

So far, the most viable option I’ve found is to wrap the UPDATE queries in a transaction and then roll it back — that way, the queries still execute, but the state doesn’t change. Is this the right way to go? Does rollback introduce any performance overhead that would skew my results? Are there better or more realistic alternatives that simulate the full write path without persisting changes?

Thanks in advance!

Comments

sargstuff•1y ago

pgbench[2] / pgreplay-go[0] / python locust[1]

very old school approach:

Misuse sql VIEW[3][4] to generate a temporary parallel table setup. Testing database separate from production database would be 'better', IMHO.

-----

[0] pgreplay-go : https://github.com/gocardless/pgreplay-go

[1] python locust : https://miguel-codes.medium.com/unconventional-load-testing-...

[2] pgbench load testing :

   a) https://medium.com/@c.ucanefe/pgbench-load-test-166bdfb5c75a

   b) https://neon.tech/blog/autoscaling-in-action-postgres-load-testing-with-pgbench

   c) https://hackernoon.com/how-to-create-and-load-test-data-in-postgresql-i41e353m

----------------------------

[3] : a) https://hashrocket.com/blog/posts/materialized-view-strategi...

      b) https://tech.jonathangardner.net/wiki/PostgreSQL/Materialized_Views

      c) https://stackoverflow.com/questions/77603705/what-is-the-use-of-materialized-view-in-postgresql

[4] : https://en.wikipedia.org/wiki/View_(SQL)

LawZiL•1y ago

but again, how can i perform the query, but not actually change the state, i really need the state to keep untouched, but be able to perform the query itself.

MatthiasPortzel•1y ago

> Does rollback introduce any performance overhead that would skew my results?

I would expect it to be the other way around—since the transactions are rolled back and not committed, they would have significantly less performance impact. But I’m working from an academic model of the database.

apothegm•1y ago

Load test against a clone instead of a DB whose contents you care about?

Why Databricks can't match ClickHouse Cloud for real-time analytics

Former German spy chief arrested, suspected of trading state secrets and treason

The methane mega-leaks from UN climate summit host Turkey

Teenager rescued from B.C. 'Widowmaker' after getting stranded following Claude

AI training of copyrighted material not fair use: Third Circuit

Why the Future Doesn't Need Us – Bill Joy (2000)

Subquadratic 3SUM and Subcubic APSP

VMPal – Virtual Machines for Apple Silicon and AI Agents

Show HN: Five Nines – learn cloud design patterns by surviving traffic spikes

Do you pay for failed-payment recovery on Stripe, or is Smart Retries enough?

Software developers are not okay

SAP to Acquire TechWolf

DGX Station GB300 Cluster: Two Towers over 400G DACs

Hermes Agent on Kubernetes: no Helm chart, and the image needs root at init

Lightsaber-like plasma antenna uses laser-ionized air to transmit radio waves

Eating Alone

Horn of Africa fears spillover effect of renewed fighting

Tennessee Emergency Alerts Redirect to a Facebook Page

Show HN: MailAccess – the true Email OSINT framework

With parallel parking turning competitive, one producer gets a lesson

Bordeaux Is Burning – Why?

Liberty AI Project One

A minimal kernel in Swift, running in QEMU

Show HN: ApolloShell, a Caelestia-style desktop shell for macOS

Faster Software Linking with Mold

After the Bishyari

Hofstadter's butterfly turns 50: a fractal hiding in quantum matter

Show HN: Bridglet – a managed SFTP with a web UI for file sharing

Show HN: Data Observability for Supabase

Show HN: Paganel – Data migration with a receipt you can verify later