Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•6mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•6mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•6mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•6mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•6mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•6mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

Show HN: A TSP game I wanted for 10 years - built in 4 hours

Options Are Not Constraints

Zero users after 30 days launching my first ever Chrome extension

DuckDB 1.4.3 LTS with Native Windows ARM64 Support

When AI will browse the web for me

Rahm Emanuel says U.S. should follow Australia's youth social media ban

AI and Human Co-Improvement for Safer Co-Superintelligence

1954's Atomic Act Stifling American Innovation in the Race for Energy Dominance

Oliver Sacks Put Himself into His Case Studies. What Was the Cost?

Why RSS Matters

Induction Variables and Loops

US authorities shut down major China-linked GPU smuggling operation

Show HN: Hardwaretest.org – Browser-based peripheral diagnostics (no install)

Trump EPA Nearly Doubles Amount of Formaldehyde Considered Safe to Inhale

Use AI to Stand in for a Domain Expert

PHP 8.5: Boost Your App Performance

Show HN: OpenDataLoader – Safe, Open, High-Performance PDF Loader for AI

You Need an Ideation Channel

Nested Tags in OpenAPI 3.2

A 101-year-old runs the largest nutcracker museum in the U.S.

The Bubble Is Labor

All good things must come to an end

Seeing Like an Agent

Why are leftists so pessimistic about school reform?

Linkwarden for iOS and Android

Date-fns 3.6.0 increased install size from 4.7MB to 21.1MB

Oracle is the canary in the coal mine for Big Tech's debt-fueled AI spending

Show HN: Coached – All-in-one platform for fitness coaches to ditch spreadsheets

Degradation of Multi-Task Prompting Across Six NLP Tasks and LLM Families

Show HN: Dashfrog – Customer-scoped observability for B2B SaaS