Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•1y ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•1y ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•1y ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•1y ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•1y ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•1y ago

Oh yes I agree with you. It may become a big push to convince my org to do that

The largest privately owned laser just turned on

Google will allow websites to exclude themselves from AI search results

Show HN: DAGraph – reactive analytics graph in the browser (Rust/WASM)

Shopify Is Down

Scripps Novel HIV Vaccine 97% Effective in Phase 1 Human Trials

Show HN: Uno – Us vs. Them. Humans vs. AI version of the card game

Europe unveils tech sovereignty package amid concerns over reliance on U.S. tech

Ceiling projection of SFO flight paths

Show HN: GreenKube – Open-source K8s cost and CO2 optimization engine

Generations of AI applications: conversational, delegative, and collaborative

Show HN: Conversations as a first class citizen in AI coding agent

Get paid by Agents if they choose a competitor – Safe Agentic Commerce x402 Mesh

NASA Drains 66 Million Gallon Reservoir to Upgrade Critical Water System

Major Outage at Modal

REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image

Mexican Receipts

Modal Major Outage

X402 Batch Settlement: High-Velocity Agentic Commerce

Implicit Surface Rendering for CAD

Why does ASTC use ISE when almost nothing else does?

Show HN: Instant DBML Schema to Database Diagram PNG Tool

Shopify Storefronts Are Down

Strapkit – Node.js Compiled to WASM

St Petersburg Burns as Drones Hit Oil Terminal During Russias Economic Showcase

Uber Caps Usage of AI Tools to Manage Costs

Jam – Programming Language (C-like, safe, no lifetime syntax)

Virtual reality for treating anxiety disorders

Show HN: Lint Your Markdown with ESLint

A weekend benchmarking Copilot CLI's /security-review across 5 LLMs

Aura: Action-Gated Memory for Robot Policies at Constant VRAM