Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•12mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Old Reddit Is Down

Digital Public Goods Alliance

Generations of AI applications: conversational, delegative, and collaborative

James Webb Space Telescope discovers one of the universe's first galaxies

"Pets vs. Cattle" in the Agent Age

Show HN: Steamosaic: Generate a mosaic of your Steam account

Sam 2 deep dive: why its FIFO memory eviction bothers me

Curry Paradox: Why a less surprising shot is more impressive than a wilder one

The Truth About GPT Shortcuts and "Secret" AI Commands

Why trust is a big question at the Elon Musk-OpenAI trial

Show HN: 84,000 random Stripe Payment Links you can visit

Show HN: ATO: Manage Chrome tabs with one shortcut

U.S. creates $1.7B 'lawfare' fund in exchange for Trump dropping $10B IRS suit

The Joys of Free Cloudflare

Don't call yourself a Software Engineer, you are an AI Enabled Engineer

Iran Starts Bitcoin-Backed Ship Insurance for Hormuz Strait

Burroughs Large Systems

Transplanting light-dependent reactions for mammalian eye photosynthesis

"I Hacked This Temu Router. What I Found Should Be Illegal." [video]

WWDC26 Developer

Signs That AI-Assisted Vulnerability Discovery Is Reshaping Disclosure Volumes

Companies start getting tariff refunds after Supreme Court decision

Streaming Messages from Temporal Workers to SSE Clients

Show HN: Cubic Doggo, a Open-Source 12-DOF 4-Legged Robot Based on ROS2

Cursor Introduces Composer 2.5

You can predict LLM output sensitivity in closed form

Surprising things I learned putting together a Home Brain

The creator of OpenClaw used $1,300,000 of OpenAI tokens in 30 days

How does the economy work at all if all are laid-off and human jobs disappear?

Intel wants to use China's phone supply chain to build cheaper laptops