Ask HN: How can I load test PostgreSQL but avoid changing actual data?

1•LawZiL•8mo ago

I'm running a load test on my Node.js application and want to simulate realistic write-heavy scenarios to stress test the system — especially the PostgreSQL database.

There's a part of the code that performs UPDATE queries, but during load testing, I don't want these updates to actually change the state of the database. However, I still want the database to experience the full impact of the update — query planning, locking, I/O, WAL writes, etc. — so I can measure how it affects performance under peak load.

Is there a best-practice approach to achieve this?

So far, the most viable option I’ve found is to wrap the UPDATE queries in a transaction and then roll it back — that way, the queries still execute, but the state doesn’t change. Is this the right way to go? Does rollback introduce any performance overhead that would skew my results? Are there better or more realistic alternatives that simulate the full write path without persisting changes?

Thanks in advance!

Comments

sargstuff•8mo ago

pgbench[2] / pgreplay-go[0] / python locust[1]

very old school approach:

Misuse sql VIEW[3][4] to generate a temporary parallel table setup. Testing database separate from production database would be 'better', IMHO.

-----

[0] pgreplay-go : https://github.com/gocardless/pgreplay-go

[1] python locust : https://miguel-codes.medium.com/unconventional-load-testing-...

[2] pgbench load testing :

   a) https://medium.com/@c.ucanefe/pgbench-load-test-166bdfb5c75a

   b) https://neon.tech/blog/autoscaling-in-action-postgres-load-testing-with-pgbench

   c) https://hackernoon.com/how-to-create-and-load-test-data-in-postgresql-i41e353m

----------------------------

[3] : a) https://hashrocket.com/blog/posts/materialized-view-strategi...

      b) https://tech.jonathangardner.net/wiki/PostgreSQL/Materialized_Views

      c) https://stackoverflow.com/questions/77603705/what-is-the-use-of-materialized-view-in-postgresql

[4] : https://en.wikipedia.org/wiki/View_(SQL)

LawZiL•8mo ago

but again, how can i perform the query, but not actually change the state, i really need the state to keep untouched, but be able to perform the query itself.

MatthiasPortzel•8mo ago

> Does rollback introduce any performance overhead that would skew my results?

I would expect it to be the other way around—since the transactions are rolled back and not committed, they would have significantly less performance impact. But I’m working from an academic model of the database.

apothegm•8mo ago

Load test against a clone instead of a DB whose contents you care about?

Topic2Manim Now Has a UI

SkyCompute – Satellite-Based Cloud Computing Architecture

Discontinuing the Teensy at Adafruit

Apple Apps Will No Longer Receive All New Features Without a Subscription

PICO-8 Demo from RSync – Demoparty

Love at First Sprite?

The Housing Market Isn't for Single People

Graphite, Free online vector editor and procedural design tool

Access Is the New API

A bounded work queue in C with explicit invariants

A university got itself banned from the Linux kernel

DIY PC maker Framework's desktops succumb to RAM apocalypse

MiniJinja is a powerful but minimal dependency template engine for Rust

What should you write about on your blog?

No management needed: anti-patterns in early-stage engineering teams

GenAI turned producing $1M videos into $100 and dead easy

Hey Sam, where is Stargate Argentina?

Choosing Learning over Autopilot

Tribute: Discover and fund the open source projects your code depends on

Show HN: LeetCode CLI – Interview timer, solution snapshots,collaborative coding

Show HN: Nogic, Turn codebase into a graph to understand how it fits together

Show HN: Timberlogs – Drop-in structured logging for TypeScript

Ask HN: If you had $10M in the bank, would you still show up to your job?

Tenor is shutting down – here's the alternative KLIPY

The $1B AI Drug Lab That Can't Touch Its Own Data

Maps of cities coloured by street/road/ave/etc.

Prosecutors seek death penalty for ex-South Korean president Yoon

Nukitori is a Ruby gem for HTML data extraction

Show HN: Fluid.sh – Make Infrastructure Safe for AI

A Benchmarking Framework for Software-Based GPU Virtualization Systems