Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Learn about Google's Project Suncatcher to put ML infrastructure in space

WalShadow: Replicating Postgres from Physical WAL

Bad bot traffic is growing 9 times faster than human web traffic

Our EU AI Act compliance engine has zero LLM calls, and CI blocks adding any

Show HN: Secure and Private Decentralized Messaging over Git and WebRTC

Hard Stop: Out-of-band kernel preemption for rogue AI agents

In Defence of the Solitary Practitioner and Self-Initiation

Flock, Axon dodge Senate hearing after invite from Chair Josh Hawley

Apple Charging Guide

Show HN: ComfyUI Extension for OpenRouter Models

Meta made a Tamagotchi-like wearable for its Muse AI agent

Show HN: Kana – A terminal agent where the human stays in the loop

I judged my mum for using AI, until I caught myself doing worse

Bugpocalypse, or reporting bugs in an AI age

Scan for Good: Wiz and DeepMind use AI to help protect critical infrastructure

Oracle sent 'force majeure' notice about data center project

KubeSolo – Ultra-lightweight, single-node Kubernetes from Portainer

Show HN: I built a Tooling gateway for Claude Code that manages Approvals for me

Is A.I. Above the Law?

Show HN: Agnetlearn; From first principles to reliable agents

Fire breaks out at Starlink station in Poland, Russians suspected

The Group Chat Where World Leaders Are Racing to Create AI Controls

Two and a half years without a gallbladder

Trump's US no longer a reliable ally, warns Belgium in leaked document

RSI and the Beginning of History

Measure Distant Asteroids with a DIY Rig

Show HN: Cbjev – typed decisions about text from one encoder pass

She HN: Quick route, a simple single page route planning tool

Jev Does Not Play Dice: 83% probability, 19% accuracy on a hidden fair die roll

Amazon to Expand Robot-Making Capacity with New, $100M Indiana Hub