Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•11mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•11mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•11mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•10mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•11mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•11mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

I analyzed the $60B Treasury Judgment Fund – 2020 was 10x a normal year

Is Woody Brown the Author of His Novel?

We rebuilt a mobile app from scratch. What it means for work with AI

Plain Text Accounting and Financial Reporting

Live Nation Illegally Monopolized Ticketing Market, Jury Finds

Cinematic Motion, Stuttery Motion, and the Soap Opera Effect

Show HN: BPR – deriving 87 physical constants from 2 integers (MIT, 1,225 tests)

The Bra-and-Girdle Maker That Fashioned the Impossible for NASA

I wrote a open source iMessage for your AI agents

The Internet Is a Place

Don't Use A.I. To Do This

Interval-Aware Caching for Druid at Netflix Scale

AI Could Democratize One of Techs Most Valuable Resources

Meta commits to 1 GW with Broadcom, Hock Tan to leave board

Ask HN: Sanity-check my numbers on EVs and solar power

H.R.8250 – To require operating system providers to verify the age of any user

Show HN: Lookas – Terminal audio visualizer that's aligned for human perception

Node.js bindings for Nvidia cuVS > GPU-accelerated vector search

A Survey of Workflow Optimization for LLM Agents

Intel Desk – a live geopolitical and market desk with replayable source chains

Taxpayers to spend $477B on tax season

Allbirds shares jump over 400% on plans to pivot to AI from sneakers

Escaping the Fork: How Meta Modernized WebRTC Across 50 Use Cases

Empedocles fragments found in Egypt

Tesla 'Full Self-Driving' crashed through railroad gate seconds before train

Thomson Reuters Fired Worker for Speaking Out About ICE, Former Employee Says

Simdutf Can Now Be Used Without Libc++ or Libc++ABI

Show HN: Playbach.io, browser rhythm game (desktop)

Arm comes to the Framework 13 [video]

Comparing Compression Tools