Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

TikTok Videos: 4.5B posts with engagement metrics

Grassroots Football, Live

We Thought Hubble Was One of a Kind with Its 2.4-Meter Mirror

A dark horse enter China's AI race: StartLux

Federal government surveilling professional lobstermen

Show HN: Play Hide and Seek vs. a Self-Improving Agent Using WebMCP

Review of "The Box"

Returning from the AI brain-rot state, re-take the thinking ownership

Mark Cuban: Why US hospitals "don't know their costs"

Child abuse survivor sues xAI, alleging Grok generated new illegal images of her

AI-assisted mushroom hunting is a recipe for a bad trip

From Click-Ops to IaC: A Safer Workflow with AI

My AI agent kept waiting on me. I built a VS Code extension to fix that

Scaling agentic AI pilots across the enterprise

Qwen-Drive-1.0

A walk across the playa to the Temple, under the sky over it now

Biting the No-Self Bullet

Google Antigravity TOS: 3rd party usage can get Google account suspended

Show HN: KeyKosh(K2) – Self-hosted config and secret manager

Show HN: Cut your AI bill by a third. Same tools, same output

Show HN: Vocab.design – A visual dictionary of UI and design terms

40 years later, are Bentley's "Programming Pearls" still relevant?

Why Is Guangdong New Energy Reporting Negative Electricity Prices?

More than 100 water systems were hit in July cyberattacks

Audacity 4.0

AnnotationSync a KOReader's plugin to sync between devices

Android 17 and higher includes a Memory Limiter

The Perpetual Tourist Experiment

Democrats block constitutional amendment to lock Supreme Court at 9 justices

How Much Pensions Replace Your Salary by Country