Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Show HN: Ytd – an intuitive, free, simple YouTube downloader for Mac

A temp email checker I built for myself that now ranks in Google's top five

SoftBank seeks $100B from Gulf investors to expand AI bet

Why Are Coding Agents So Dumb?

Knowing Enough to Read the Code

Yandex Takes a Second Data Center Hit in 48 Hours

Show HN: Parlaypals group sports parlays with friends: Elixir/Phoenix LiveView

Why Small CPU Caches Make Such a Big Difference

Show HN: eBay sold listings APIs and MCP

Getting old Macromedia Director Games to run on modern Hardware

Mac Shipments Fall, but Apple Still Gains Ground in Shrinking Market

OwpenGram – open-source messenger that speaks the MTProto protocol

Luminum – turn your Raspberry Pi into "focus mode" workstation

The next-gen borrow checker, a drop-in replacement for Rust borrow checking

Court throws out killer's sentence after judge said he loved AI video of victim

We solved SQLite's single-writer limitation

American Airlines extends Starlink Wi-Fi roll-out to mainline fleet

In Race with U.S., China Struggles to Recruit Foreign A.I. Researchers

Guess the football player based on their career

HEIF Heist – One image parser to pwn them all

Abolish Frat Culture

Ask HN: How are you dealing with PR apocalypse?

Living Models pairs Gemma 4 with BOTANIC-1 to help decode plant DNA

An LSM storage engine beat InnoDB on TPC-C at 4k warehouses in MySQL

Step 5 Preview now available on AI Gateway

Portainer GitOps Bypass Enables Host Takeover

Michael I. Jordan on AI: "Superintelligence is science fiction"

Safeguard agents in plain English with decision models

Deepthi Sigireddi from Supabase

Show HN: Tode – Analytics for Figma plugins, which run in a null-origin iframe