Ask HN: How can I load test PostgreSQL but avoid changing actual data?

1•LawZiL•10mo ago

I'm running a load test on my Node.js application and want to simulate realistic write-heavy scenarios to stress test the system — especially the PostgreSQL database.

There's a part of the code that performs UPDATE queries, but during load testing, I don't want these updates to actually change the state of the database. However, I still want the database to experience the full impact of the update — query planning, locking, I/O, WAL writes, etc. — so I can measure how it affects performance under peak load.

Is there a best-practice approach to achieve this?

So far, the most viable option I’ve found is to wrap the UPDATE queries in a transaction and then roll it back — that way, the queries still execute, but the state doesn’t change. Is this the right way to go? Does rollback introduce any performance overhead that would skew my results? Are there better or more realistic alternatives that simulate the full write path without persisting changes?

Thanks in advance!

Comments

sargstuff•10mo ago

pgbench[2] / pgreplay-go[0] / python locust[1]

very old school approach:

Misuse sql VIEW[3][4] to generate a temporary parallel table setup. Testing database separate from production database would be 'better', IMHO.

-----

[0] pgreplay-go : https://github.com/gocardless/pgreplay-go

[1] python locust : https://miguel-codes.medium.com/unconventional-load-testing-...

[2] pgbench load testing :

   a) https://medium.com/@c.ucanefe/pgbench-load-test-166bdfb5c75a

   b) https://neon.tech/blog/autoscaling-in-action-postgres-load-testing-with-pgbench

   c) https://hackernoon.com/how-to-create-and-load-test-data-in-postgresql-i41e353m

----------------------------

[3] : a) https://hashrocket.com/blog/posts/materialized-view-strategi...

      b) https://tech.jonathangardner.net/wiki/PostgreSQL/Materialized_Views

      c) https://stackoverflow.com/questions/77603705/what-is-the-use-of-materialized-view-in-postgresql

[4] : https://en.wikipedia.org/wiki/View_(SQL)

LawZiL•10mo ago

but again, how can i perform the query, but not actually change the state, i really need the state to keep untouched, but be able to perform the query itself.

MatthiasPortzel•10mo ago

> Does rollback introduce any performance overhead that would skew my results?

I would expect it to be the other way around—since the transactions are rolled back and not committed, they would have significantly less performance impact. But I’m working from an academic model of the database.

apothegm•10mo ago

Load test against a clone instead of a DB whose contents you care about?

Evan You shows VOID: Vite-native deployment platform [video]

Digg: A Hard Reset, and What Comes Next

Florida's New "Thought Police" Bill Is Real (HB 945) [video]

AI engineer uses ChatGPT+AlphaFold to develop cancer vaccine for his dog

Right to Compute Act (NH HB1124)

GitHub infuriates students by removing some models from free Copilot plan

Who Goes Nazi? (1941)

Reverse-engineering Claude's generative UI – then building it for the terminal

coming soon: fashion critique newsletter

Show HN: I save £300/mo by auto-scaling my staging cluster at night

Claude Visual and Interactive Content

Accidental complexity, essential complexity, and Kubernetes (2022)

US Gas spending increase since Feb 28

Show HN: DJX – Convention over Configuration for Django (Rails-Inspired CLI)

Waller: A game teaching the fundamentals of drystone walling

How do you capture WHY engineering decisions were made, not just what?

Hawkeye – open-source flight recorder

Another AT&T FirstNet user gets $6,200 bill, at $2 per megabyte

Datacenters are becoming a target in warfare for the first time

Amazon customers hate Alexa's new, adults-only 'Sassy' voice: 'Unplug'

Learn Haskell in Two Weeks

How Google is reimagining Maps with Gemini

There's a Class 100 semiconductor cleanroom inside this backyard shed [video]

Adobe settles DOJ cancellation fee lawsuit, will pay $75M penalty

Lightweight Kanban board for Claude Code

After Amazon's Alexa asks creepy questions to tot, Mom pulls plug

Three-Dimensional Bioprinting and Rose-Inspired Medical Applications

Analysis of hydrogen production costs by various methods (2022)

Show HN: Interview scoring app because our feedback was just Slack vibes

The wild six weeks for NanoClaw's creator that led to a deal with Docker