Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•11mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•11mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•11mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•11mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•11mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•11mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Colabro: AI Employee for Your Computer

Chewing gum releases microplastics into your saliva, UCLA research shows

How do I make painful lyrics feel less generic?

Task Paralysis and AI

Local Models Are Not Frontier. They Are Enough

Show HN: I built a 500K LOC production app alone in 7 months. Here is the proof

Private Credit Isn't a Major Threat–Probably

Philosophy of the Left-Hand Path

Miniature Armoured Train Fought Hitler's Luftwaffe [video]

Show HN: TokReach – US TikTok as a Service

tsz: TypeScript checker and LSP written in Rust, designed to outperform tsgo

Programming as Theory Building-Peter Naur[pdf]

Epupp – Browser Extension to Tamper with Web Pages, Live and with Userscriptss

History and Science of the Hanta Virus

Fusion's cost floor: what if the core were free?

Multiple universities forced to reschedule final exams after Canvas incident

Plants can 'hear' rain coming, spurring them into action

Tracing tokens through Llama 3.1 8B inference on H100s

Show HN: I audited my own back ends on 5 BaaS – leak in every one

Notes on using GNU Emacs' Tramp system in an unusual shell environment

Best AI coding plan alternative to Claude and ChatGPT

Debian must ship reproducible packages

Agent Harness Engineering

Late-interaction rerank made our F1 worse, not better – a negative result

A Field Study of Institutional Control in an AI-Staffed Prediction-Market Desk

When life gives you lemons, write better error messages

Zeta2.1: 3x Fewer Tokens, 50ms Faster

Scouting's Real Crisis Is Not Marketing. It Is Decades of Neglect.

Giant Virginia Data Center Project Upended by Clerical Error

NYC School District Hit by Malware Attack as Well as Canvas Hack