Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•11mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•11mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•11mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•11mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•11mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•11mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

What would make an academic AI assistant trustworthy for students?

Two Maps, One Domain

The Chinese Realtime Deepfake Software Powering Scams Around the World

Tests confirm tilapia in mackerel cans

What Causes Lightning? The Answer Keeps Getting More Interesting

Cloudflare responded to the "Copy Fail" Linux vulnerability

In OpenAI trial, former CTO: Altman sowed 'chaos,' distrust among top executives

Ars Asks: Share your shell and show us your tricked-out terminals

How did 'large' language models get that way?

AgentWrit, a Go broker for task-scoped AI agent credentials

Consuming too much AI can be bad. Data on 'tokenmaxxing' reveals a better way

Go's regular expressions are either slow or even slower than expected

Number. Everyone gets one. (App)

Scripty

Fizz Buzz Through Monoids

Midday Is Joining Ramp

The Mirror Is Part of the Machine

Why So Few Babies? We Might Have Overlooked the Biggest Reason of All

Jobs at mom-and-pop shops are disappearing

Who owns the Wizardry RPGs? We do, say both Drecom and Atari

Scroll-Driven Animations

Φ³−φ⁻³=4 (exact): The transformer's ff/d ratio is algebraic, not empirical

AI in B2B Sales: How Managed Loops Are Replacing CRM Services

Show HN: CacheCore – semantic agent caching with dependency invalidation

A Snapshot of the Performance of WASM Back Ends for Managed Languages [video]

The Great Flattening

Ask HN: I was tired of sharing personal phone number just to get a printout

Show HN: Learn a Language Through Trivia

LLM-driven security reports disrupt coordinated disclosure

Show HN: XLog Static site generator for knowledge bases with automatic backlinks