Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Should AI labs be treated like the owners of dangerous animals?

What counts as cooking? In defense of the store-bought sauce

When Matt Taibbi Met Mike Benz

Classifying Capabilities (Extended Version)

Annessaia – a sandboxed WASM app runtime with its own UI toolkit

Is the IDE Dead?

Solving Legal Problems with Dags

Project Lana attempts to formalize hard to understand Mochizuki's IUT in Lean

Simplest CMS you'll ever need. Manage content right in your GitHub repository

Atlas of Surveillance

The worlds longest song makes a chord change

Am I the problem? Interviewing another team to find out

A quick look at zero-knowledge proofs

First JDK 28 Early-Access Build Including JEP 401: Value Objects

Kona EBMS – energy based models

Laws of Development

Energy-Based Models Explained: The AI Beyond Next-Token [video]

Software as Executable Domain Knowledge

Graphify – Less token use for Claude Code

X changes revenue sharing to reward original content

Show HN: Agent Tunnels – coding agents collaborate across companies

Chilean Supreme Court ruling on the protection of brain activity 2023

Show HN: Tocic – Chatbot table of content browser extension

Ex-Gawker editor AJ Daulerio on life after addiction

Biomes – Exotic Matter Chapter 1 Now Available (Indie Mmorpg)

How and Why I Stopped Buying New Laptops (2020)

Archive of Animal Photography Reveals 18,000 Species and Counting

Right to Repair–For Your Body

Show HN: Dirblock+envblock – tiny whitelist guards for dirs and env secrets

Show HN: More Branchless Optimization