Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Screen Forge – Pro screen recording in minutes

Iran’s precision strikes picked apart Gulf infrastructure, blunting US war plans

What Nvidia's CEO thinks about the UK's AI future

TypeSafe's Jev more susceptible to attack than LLMs, says security vendor

Show HN: Sjq – Jq, but for AI Streaming

HOL Light Tutorial

I'm not leaving this apartment

Analyzing technical documents with Deep Review

Lunar fault maps reveal how much the moon is shrinking

New spectroscopy method enables comparisons of nuclear sizes

Newly discovered viruses reveal an evolutionary missing link

PureDarwin

Subversion of clinical judgment by conversational artificial intelligence

How hard have we looked? Measuring public cryptanalytic effort

Show HN: Rad PDFs – Hacker News for PDFs Only

Sealenv encrypt .env files and run commands without writing them to disk

Microplastics are chemically active, and could cause biological harm

Elon Musk Hopes His New Factory Will Help AI Supplant Life on Earth

InkBoy, 30-frame-per-second grayscale Game Boy, open sourced

Proof-based general-purpose computing with Magnetar

45 years later, the Sinclair ULA design documents surface

Show HN: Pasteface - Record, transcribe and copy speech locally in your terminal

Xbox Labs

End-to-end encrypted relays for OCapN

Mosquito Joe FDD teardown: 66% fee load, 380% termination spike

What causes AI fatigue for engineers and how to ease the strain

Argon now avaliable for pro users on ANTIGRAVITY

Timestral

Free-AI-tools – Curated list of free and low cost AI tools

Pace of Global CO2 Emissions Continue Dropping