Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•8mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•8mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•8mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•8mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•8mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•8mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Link Shortening Tools Are High Risk

Microsoft Has Killed Widgets Six Times. Here's Why They Keep Coming Back

39C3 – Celestial navigation with little math

Embedded Vector and Graph Database in Pure Go

French government may consider restricting VPNs

A few thoughts about PayPal, nearly 12 years after I left

Nvidia RTX 5070 Ti with a hole in the PCB manages to score a world record

Show HN: DeepInsight HITL AI research with collaboration and podcast generation

Code is getting cheaper. Building is not

The debt I cannot repay, by Claude

Is there a good way to manage GTM experiments, or is it inevitably ad-hoc?

Show HN: Iterio – Study timer with spaced repetition built in

Ask HN: Where does modern geometry survive contact with SGD?

If you tell AI not to do something, it's more likely to do it

We added TOON compression to our LLM gateway – compress prompts, saves tokens

Show HN: A personal feed that turns videos/podcasts/blogs into Twitter-y threads

Hexapawn: Variant of Chess with 6 Pieces

Show HN: Chitram – Open-source image hosting with automatic AI tagging

Show HN: Video2docs – Turn Screen Recordings into Step-by-Step Instructions

Show HN: Trappsec – detect attackers probing API business logic

Show HN: Continuity Capsule – Deterministic restarts for LLM agents

Show HN: Continuity Capsule – deterministic restarts for long-running LLM agents

Do Retention Ponds Work?

Show HN: Free Wealth management in one app (gold, stock, MF, budget etc.)

"This Job Sucks": DOJ Attorney Asks Judge to Hold Her in Contempt

Show HN:OpenClaw Skills-Discover, compare skills with clear risk signals

Sudo maintainer is looking for help

Catalina Island's private landowner moves forward on killing all its deer

My Hardest Bug Ever (2013)

A copyleft draft license for datasets. You take my data, you give your data