Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•9mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•9mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•9mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•9mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•9mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•9mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Perfect Ottawa Hummus

Show HN: Snake and Foes – The classic snake game but with enemies and power-ups

There Isn't a Hacker Community for Fundamental Physics (and What It Tells Us)

Typed Assembly Language

The UK tourist with a valid visa detained by ICE for six weeks

Ajail: A basic jail for programs you don't trust

Show HN: How much has the ad industry spent targeting you?

Show HN: OffKit – an iOS app blocker that adds friction

LDOS: Toward a Learning-Directed Operating System

PromptSpy ushers in the era of Android threats using GenAI

Colorado moves age checks from websites to operating systems

Pb-ext: Enhanced PocketBase server with monitoring, logging and API docs

Ruby Is the Best Language for Building AI Apps

Back to textbooks: Denmark rolls back digital learning

Show HN: Free tool to migrate OpenAI Assistants

A Galaxy Composed Almost of Dark Matter Has Been Confirmed

Python creator Guido van Rossum asks Elon Musk what SpaceX uses for coding

Infographic of the Navy and Air Force build up nearby Iran

Acme Weather, from the Creators of Dark Sky

Free Shadcn/UI patterns for faster UI delivery

Show HN: Fix-my-mic – stop macOS from switching to AirPods mic every connection

Formula: A VST for coding custom DSP inside your DAW

A 3000W Water-Cooled Power Supply (With GAN and Sic) [video]

OpenClaw Partners with VirusTotal for Skill Security

The Rolling Layoffs at Jack Dorsey's Block

Ask HN: How would you distribute a privacy-first AI chat for teams?

Enable automatic coverage workflow setup

Show HN: Resilient OpenClaw Browser Relay – Survives WS Drops and MV3 Restarts

Show HN: Stop Pasting Credentials in Slack

Show HN: Skill Check CLI for your skill.md