Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

PHP2Shell: What Fortirix's External PHP Inventory Reveals

Show HN: ReBirth 338 in Browser

Agent Memory benchmarks should measure task success, not retrieval alone

Exstill: The frontier model's co-processor

Verify, Then Vote: Overturning Wrong Majorities in Multi-Agent LLMs

Show HN: Trifecta Checker – a pre-flight safety check for AI agents

Tech Firms Dismantle Botnet That Turned 1.3M TV Boxes into Proxies

Shutting the Door on the XCPE Botnet

Ask HN: Any tool to remove AI Watermark from image?

How AI is creating a lopsided US economy

Show HN: SFXMint – CC0 game SFX with a keyless API and MCP for coding agents

Proxyman MCP

The worst month for ships in the Strait of Hormuz

The Attack, the Ransom and the Unexpected Outcome

Y Combinator's Garry Tan uses AI agents so much

The Nordic Token Tax

Mav AI | FULL MATCH. FULL INSIGHT. UNDER 30 MIN.

Show HN: Hacker GitHub – the GitHub repos HN links to most

A founding document of mechanistic interpretability [Elhage et al. 2021]

"This Is Fine": How Clean Rooms Train Agents to Close the Books on Fire

Cobbly – Write one line. Get a website, or a 3D object you can print

Show HN: Bitcoin-rs – An independent Bitcoin full node in Rust

Vercel: Computer use CLI for AI agents

A unusual sight catches the eye of those passing through the town

Show HN: Run xv6-riscv(64Bit,MMU) with RP2350

Show HN: Open a 300k-row XLSX in the browser in ~300ms, no server

Test and verification technique effectiveness with GPT-6 Astra

Kenneth Boulding's Sonnets on Numbers

Show HN: MCPgraphy – a proxy that learns when your agent's MCP tools work

Six Companies Adopt the Accessible Games Initiative Tags