Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Show HN: Bash sandbox script for Claude and codex CLI

Composr – a Rust rewrite of PHP's package manager

Show HN: Pingtastic – heartbeat monitoring for cron jobs, plus HTTP/SSL checks

Renewable Data Center Fantasy

A photo editor where you describe the change instead of using layers

Diplodocus, Long Thought Exclusively American, Turns Up in Spain

DDD matters more when AI writes your code

Quantum Cyclic Cosmology with Sean Carroll [video]

Randomized query complexity can beat certificate complexity

Reality check. This is where we stand

Initial Thoughts on the Social Media Platforms (Ofcom Licensing) Bill

Khronos Group opens EU Entity to support European Projects with open standards

Sugar Clear

Motivation of Vieta's Transformation (2015)

Oblivious HTTP

YC batches got twice as likely to repeat an earlier YC company, from 18% to 47%

Should AI friendliness be a priority for your projects?

A wrong turn become a nightmare

ZTE B860H: Getting Armbian into It

Waspinator

I think roguelikes should steal Noita's philosophy

A live board game where every lot is a billboard, forever

We all wanted to be Netflix, who do we want to be next?

Issues with unsigned long int vs. unsigned long long int on Linux vs. 32-bit OS

Suspected sabotage causes major Netherlands rail disruption

Meta Kicks Muse Off Their Social Handles to Launch New AI Agent

Show HN: 2D and 3D printable QR-code generator (.3MF / STL) with magnets and NFC

V/H/S SCP: When fandom meets law and Creative Commons

Measuring Gauss-Seidel loop-carried dependency and fixing it via loop unrolling

Amazon Bets on Hollow Core Fiber to Keep a Million Chips in Sync