Ask HN: Any good tools to pgdump multi tenant database?

3•polishdude20•11mo ago

Just joined a new company and they run a multi tenant database in postgres where each tenant is distinguished by their account ID. I'd like to be able to dump the data of a single account to my local instance to assist in debugging.

Problem is, many of the entities do not include an account ID. For example, a user can have an account ID but a user post will not but it will be tied to a user ID.

Also foreign keys aren't really implemented fully.

Are there any tools or techniques that could help make this process easier to do?

Comments

tudorg•11mo ago

You can try with data subsetting tools, a few that I know are: greenmask, jailer, tonic condenser, and I think there are more. They are not exactly for your use case, but might help you a bit. The problem is most of these tools can walk foreign keys, but only in one directions.

Also, since you said FK are not fully implemented, then there just won't be enough information for them to work with. So you can either work on fixing the foreign keys or have more complex scripts.

polishdude20•11mo ago

Thanks for the suggestions!

Yeah due to the unavailability of FK's, I'd have to somehow map certain ID columns to the tables they're for, accounting for slight naming convention differences.

woyten•11mo ago

In case you don’t have FKs you could specify virtual foreign keys in Greenmask.

Check out docs for details

https://docs.greenmask.io/latest/database_subset/#virtual-re...

abhisek•11mo ago

This is poor design. Multi-tenant data model design must have a tenant or segment ID for every tenant segmented tables. While it may not be a problem initially but as the business grows, you may need to move tenant data to separate DBs or even different regions based on compliance requirements. IMHO it is a good idea to run DB migrations and have a tenant ID populated in all tenant segmented tables

polishdude20•11mo ago

Oh yes I agree with you. It may become a big push to convince my org to do that

The Professors Are Using ChatGPT, and Some Students Aren't Happy About It

Show HN: Routiium – self-hosted LLM gateway with a tool-result guard

Agent-World: Scaling RW Environment Synthesis for General Agent Intelligence

Context Is Finite. Who Maintains It?

Release PiClaw v2.0.1 – Ferrix

Trump ousts National Science Board members

Is the World Ready for a Car Without a Rear Window?

Why your AI assistant is suddenly selling to you

Automate TLS for Dynamic Domains with Traefik and Hetzner DNS

AI Might Be Lying to Your Boss

Go quirks: function closures capturing mutable references

Can you stop beans from making you gassy?

Show HN: The Order of the Agents – Make Codex and Claude Create the Perfect PRD

RFC: Oden: The Server-First, JavaScript-Esque Runtime

The U.K. Smoking Ban Is Illiberal

Building Semantic Version Control in Rust

Logs say success. The system says otherwise

Show HN: Good AI Task – a tool for asking AI what it can and can't do

Nicholas Carlini – Black-hat LLMs [video]

Show HN: Useknockout open source background removal API 40× cheaper -remove.bg

Show HN: AI Visibility Monitor – Track if your site gets cited by GPT/Claude

Check Cloudflare D1, R2, Workers usage – see remaining limits for today/month

LLM-Rosetta: Zero-Dep API Translator for OpenAI, Anthropic, Google and Streaming

Artifacts Are Alive (and Photographs Are Dead)

Show HN: Mapping Sonnet's thinking process via flame charts

You're about to feel the AI money squeeze

Adding a team was the wrong strategic decision

The Stanford Freshmen Who Want to Rule the World

Zerodep: Performant single-file, zero-dep Python modules (protobuf, YAML, etc.)

Self-Hosted AI Red Team Tools