Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•8mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•8mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•8mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•8mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•8mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•8mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

New code connects microscopic insights to the macroscopic world

Presence in Death

Show HN: Express-like, event-driven minimalist TS framework

Asciinema: Making Movies at the Command-Line

SFC vs. VIZIO: who can enforce the GPL?

Mental sundhed og personlig trivsel

David Webb (Webb-site.com) has died

FTC Appeals Loss in Meta Antitrust Case

A Third Conversational Pattern in BDD

How to Leave Germany

Show HN: BetterDB – OSS Valkey/Redis monitoring with historical data

The threat eating away at museum treasures

Liberals have to reckon with the limits of protests

Locked out of my GCP account for 3 days, still charged, can't redirect domain

Announcing Vortex support in DuckDB

How to tell where a file or folder is on your Mac

Plausible Analytics – Simple, privacy-friendly Google Analytics alternative

AI bot swarms threaten to undermine democracy

What I learned building an opinionated and minimal coding agent

Show HN: Whosthere: A LAN discovery tool with a modern TUI, written in Go

The Perfect Minimalist Wi-Fi-Connected LED Clock/Weather Display ESP32/ESP8266

YouTubers will be able to make Shorts with their own AI likenesses

A cosmic ring may challenge a key assumption about the universe

How do I make $10k (What are you guys doing?)

The Trump Administration Admits More Ways DOGE Accessed Sensitive Personal Data

Show HN: Carlton × CMP Signature AR NUME

The Inverse DevOps Principle

Major Canadian computer hardware online store compromised for months

Hyundai Motor's Korean union warns of humanoid robot plan, sees threat to jobs

A Management Philosopher with Heady Ideas About Beer (2009)