Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Whoisinspace.com/

Victory Appeals Court Rejects Expansive New Copyright Claim

New evidence for hidden chambers beyond Tutankhamun's tomb

New wild cat species is identified for first time in 100 years, researchers say

Americans Shrugged Off Surveillance. Then Came Flock and Data Centers

Show HN: The Heilbronn Problem – packing points to avoid small triangles

How hard can it be to cache a Git checkout?

Go-based Robotics Framework built around NATS.io

Robotaxi Might Be a Narc

Open Source Lightroom

Escalating Battle Against AI Deepfakes Mandates Smart Streaming Decisions

Wilsonian Idealism

Homo Rodans

University Rescinds Offer to Activist Allegeded to Wipe Phone Before DHS Search

My Office Has an On-Air Light (and Yes, It's a Robot)

JDK 27 is now available

Abstract Machines Launches Synth

Ask HN: HIPAA for AI vs. Licensed Providers, your thoughts?

A New Equal-Area Map for Interactive Computer Use

Why Europeans save differently, and how to put those savings to work

Vinix – A modern operating system written in V

Rabbit Hole: Minimum L-seams

LLM Classification Is Feature Engineering

Benchmarking Local LLM Servers: Llama.cpp, Llamafile, LM Studio, and Ollama

Carlo Rovelli book challenges science's understanding of reality and universe

Show HN: Pelmet – menu bar manager for macOS 27 that hides icons on demand

Prompting large language models for quality ecological statistics

Show HN: Open-source AI teammates with their own computer

Show HN: Live one minute of a stranger's memory, then leave one for the next

If a Lion Could Speak