Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Show HN: Riftri – copy-on-write Git worktrees for running agents in parallel

The JavaScript Midlife Crisis

Ask HN: Ideas for getting more GitHub stars?

Open source tool for building hierarchical agent loops

How the Barcode Was Invented

I built a tool that reverse engineers competitors SEO

Egress Testing – Server that records inbound TCP and UDP packets

A16Z is challenging Silicon Valley's love for drop-outs by launching a school

Reading specs beats reading code

Native apps written in TypeScript and CSS

Agent manager now with mouse support

Obscura: The first VPN that can't log your activity

AI Leaders Are Standing on a Liability Landmine

WebMCP Integration at Stripe

Show HN: Which of your secrets did your coding agent send?

ShinyHunters hackers say they breached FBI

Meta testing a 'human concierge' for its new personal AI agent, Muse

Show HN: ClassD-VHF-Transmitter – Covert RF Transmission via Phone Speaker PWM

The human brain is two separate organs, study finds

I built the Jev architecture one year ago and open-sourced it

He Said AI? Sharpen the Pitchforks

Show HN: junkDrawer.ai – Browse eBay with AI Agent and Dynamic Filtering

DiscoBox: AI Coding Agents in Disposable Sandboxes

Why I'm deciding to go ad-free to support my product

A Faster Shortest Path Algorithm

New time zone code: PCT for British Columbia

GPT-6 Sol and Luna push the cost-efficiency frontier

How Scared Should We Be of A.I.?

Show HN: Slivingdoc – High scale durable UTF-8 context manager for agents

A CPU Runs a Program [video]