Ask HN: How can I load test PostgreSQL but avoid changing actual data?

1•LawZiL•10mo ago

I'm running a load test on my Node.js application and want to simulate realistic write-heavy scenarios to stress test the system — especially the PostgreSQL database.

There's a part of the code that performs UPDATE queries, but during load testing, I don't want these updates to actually change the state of the database. However, I still want the database to experience the full impact of the update — query planning, locking, I/O, WAL writes, etc. — so I can measure how it affects performance under peak load.

Is there a best-practice approach to achieve this?

So far, the most viable option I’ve found is to wrap the UPDATE queries in a transaction and then roll it back — that way, the queries still execute, but the state doesn’t change. Is this the right way to go? Does rollback introduce any performance overhead that would skew my results? Are there better or more realistic alternatives that simulate the full write path without persisting changes?

Thanks in advance!

Comments

sargstuff•10mo ago

pgbench[2] / pgreplay-go[0] / python locust[1]

very old school approach:

Misuse sql VIEW[3][4] to generate a temporary parallel table setup. Testing database separate from production database would be 'better', IMHO.

-----

[0] pgreplay-go : https://github.com/gocardless/pgreplay-go

[1] python locust : https://miguel-codes.medium.com/unconventional-load-testing-...

[2] pgbench load testing :

   a) https://medium.com/@c.ucanefe/pgbench-load-test-166bdfb5c75a

   b) https://neon.tech/blog/autoscaling-in-action-postgres-load-testing-with-pgbench

   c) https://hackernoon.com/how-to-create-and-load-test-data-in-postgresql-i41e353m

----------------------------

[3] : a) https://hashrocket.com/blog/posts/materialized-view-strategi...

      b) https://tech.jonathangardner.net/wiki/PostgreSQL/Materialized_Views

      c) https://stackoverflow.com/questions/77603705/what-is-the-use-of-materialized-view-in-postgresql

[4] : https://en.wikipedia.org/wiki/View_(SQL)

LawZiL•10mo ago

but again, how can i perform the query, but not actually change the state, i really need the state to keep untouched, but be able to perform the query itself.

MatthiasPortzel•10mo ago

> Does rollback introduce any performance overhead that would skew my results?

I would expect it to be the other way around—since the transactions are rolled back and not committed, they would have significantly less performance impact. But I’m working from an academic model of the database.

apothegm•10mo ago

Load test against a clone instead of a DB whose contents you care about?

TweetStyler – I built a tool to fix the X font problem

Touchscreen MacBook Pro OLED is coming with a 'new interface'

Esoteric EBB is an isometric, Disco-like, TTRPG-turned-CRPG with deep dialogs

CRusTTY: A pedagogical C interpreter with time-travel debugging capabilities

SigilJS – Runtime Types for JavaScript

The Vibe to Production Pipeline

The Evolution of Lego Sorting (2001)

Rails Testing on Autopilot: Building an Agent That Writes What Developers Won't

Distributed Python dataframes and machine learning with Livebook and Elixir

I emailed 70 consulting partners. No replies. What it taught me

Hotpatching goes default in Windows Autopatch whether you like it or not

ICO fines Police Scotland over data-sharing debacle in gross misconduct case

Autopen

Idempotent Slices with Applications to Code-Size Reduction

A Message to Our Customers

Binance sues WSJ, panicked by gov't probes into sanctioned crypto transfers

Is launching a product on here a thing

Iran tells world to get ready for oil at $200 a barrel

Apple Studio Displays have 128 GB of storage

Designing AI agents to resist prompt injection

Code reviews do find bugs

Anthropic GAAP revenue only $5B -not $19B

The Anthropocentric Blind Spot

Show HN: Hyper – A stupidly non-corporate voice AI app for IRL conversations

//go:fix inline and the source-level inliner

Rust is slowly but surely eating PostgreSQL: Deep dive into Neon, and more

Industry reports point to potential farm waste energy boom amid federal scrutiny

Guess I was wrong about Kubernetes. Blame geopolitics

OpenRCA benchmark – Improving Claude's root cause analysis accuracy by 12 pp

Show HN: Social Media, Reset