Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Raspberry Pi Home Server: Back Up Your Files Locally for Under $100 DescriçãO

Dead Button Syndrome

Boomers are hoarding most of America's wealth and power

What Are Tokens in LLMs?

Jorge Luis Borges Lecture April 9th, 1976 [video]

Criblate – Help your favorite creators speak every language

The Tinker Pledge

Xaml.io Compiles to Native Apps in the Browser

Easter egg in new Lego Batman game contains working C64 code [video]

The architecture of the internet creates risks for democracy

Show HN: Hardbar – compile-time defined i3bar

Ask HN: Job market for SDMs/Engineering Managers. Any reliable data?

Loss of Prefrontal Cortical Higher Cognition with Uncontrollable Stress (2019)

Show HN: Nightwatch, The open-source, read-only AI SRE

Mesoscale carbon fiber lattices with foam-like weight and bulk strength

Behind Every Dad Bod Is a Healthy Dad Brain

Modular morals: Mapping the organization of the moral brain (2024)

I built a Discord status for Claude Code

1982 World Championship Double Decker Bus Racing (1982) [video]

Try out my version of 1M checkboxes

Agentic AI solved coding and exposed every other problem in SE

China has approved the first invasive brain-computer chip

We May Be Entering a Second Axial Age

AI friends too cheap to meter

Oxford Uni student data pwned yet again, this time via career platform breach

Show HN: A List of AI Neolabs

Ask HN: I made an image watermarking tool. What are the issues open-sourcing it?

UK exam watchdog frets over smart specs turning GCSEs into Google searches

Stronger Search Architectures Can Substitute for Larger LLMs

Do GLP-1 pills work as well as injections? Here's what studies show