Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Testing with Agents in Apple platform development [video]

ForumNOX Hacking Forums

Medical volume renderer with transparent 3D anatomy

How to Setup Gentlemail

WSJ Fabricated Statements from the Singapore Gov. On Jensen Huang and China Link

AWS made an official local emulator

Sub-Planck structure in phase space and its relevance for quantum decoherence

I was wrong about dark mode

Stock value as a distribution, not a price target

Automated High-Density Knife-Edge Laser Beam Profiler

Show HN: Saylark – Open-source voice dictation for Mac, like Wispr Flow

Brain Implants Give ALS Patients the Voice to Speak and Sing

Show HN:Learn Chinese Through Mythology and HSK Graded Stories

Cloudflare: Spending Limits and Alerts

Show HN: Dynaura – Dynamic Island toasts for the web

New tech allows public, law enforcement to identify drones, operator locations

Baltimore County schools phase out AI reading program

UPS cargo plane collides with passenger jet at Miami International Airport

Mirepoix

Reading JSON at 277 GB/s in Python

Show HN: IndexFast – see which of your pages search engines actually know about

Show HN: Cshoal – A school of fish, hunted by predators, in your terminal

Book list for streetfighting computer scientists

ICC stops probe into US troops, continues investigating Taliban

I tested an AI dance edit on five seconds of footage, then tried the whole clip

Show HN: ShadowDiff – Shadow testing and SQL diffing for AI-migrated back ends

China's COMAC electric plane completes first crewed flight

Show HN: Hello Triangle, a puzzle game where you build a GPU

PDF tools that run in the browser – nothing is uploaded

Show HN: Offline quoting, receipts, and expense tracking for entrepreneurs