Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Not Cool

Pangram Has Emerged as the Gold Standard of AI Detection. Should You Trust It?

Mammut vs. Arc'terx – Brand Comparisons

Simple Is Not Small

Navigating Code Reviews as a Code Author [video]

Stop obsessing about the goddamn robot

Tell HN: The Thoughts and Woes of a Full-Time Founder Part 1

Ant Group open-sources LingBot-Vision for dense spatial perception

Balance of Power Geopolitics in the Nuclear Age (1985)

The Death of Educational Content on YouTube [video]

Microsoft to impose time limits on Xbox cloud gaming subscribers

Hugging Face is too important to fall into Nvidia's hands

18 Ways You Can Use a Domain Name

Nvidia Personal AI Router (Pair)

Show HN: Photosynthesis – iPhone app captures from 2 lenses, stitches to 1 photo

Hanzi Writer: JavaScript library for Chinese stroke order animations and quizzes

56k.rip – the 1996 dial-up internet experience

The Multiplayer AI Manifesto

Show HN: Chrome tab group cleaner for Claude Code created tab groups

NYC mayor Mamdani imposes 1 year ban on AI for schools through 8th grade

GTP-6 Astra

Show HN: If I had to design a nuclear fusion power plant(Idea Sketch)

4K Analog Video Feedback Device

macOS 27 Simulator by OpenAI Astra

Coder's registry infrastructure compromised to push malicious modules

(George) Lucas Museum of Narrative Arts

Star Trek S01e20 "Court Marshall"

Protecting Engineers' Skills in the AI Era

There are many agent harnesses, but this one is mine

Anxious or outgoing? Study links Big Five personality traits to genetic variants