frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: Tabsdata – Pub/Sub for Tables to Replace ETL Pipelines

3•immortan_dag•3mo ago
Hi HN,

I am one of the founders of Tabsdata, a new system for data integration built around publish/subscribe for tables.

Tabsdata is a self-managed system you can deploy in your own environment. It is built in Rust for performance and safety, with Python bindings for expressing data flows. You get both a browser-based UI and a CLI that covers the full surface area of the platform.

We started this project after spending nearly two decades in data integration. Over that time, we have seen the modern data stack emerge in layers: ingestion, preparation, quality, productization, and so on. Many of those layers were designed to handle semi-structured data and schema drift. But that complexity often left data teams with brittle workflows and limited visibility.

One of the key lessons for us was this: no matter how data starts out, it always turns into tables. APIs, logs, Parquet files, event streams - everything eventually lands in tabular form. So we made tables the first-class unit in the system, right from ingestion.

The second lesson was about semantics and metadata. Every layer between producer and consumer tends to dilute meaning, reshaping schemas, masking lineage, or dropping ownership context. This forces teams to build new layers just to patch over what was lost. We believe a better approach is to carry the table, its metadata, and its semantic intent all together from start to finish. Tabsdata makes that default.

Instead of stitching together ingestion, transformation, orchestration and governance, across fragmented tools and platforms, Tabsdata provides a single declarative system where producers publish, transformers enrich, and consumers subscribe. Every step is versioned and every change is explainable.

If you are curious, here is a short overview and demo we shared on Practical Data Community:

https://www.youtube.com/watch?v=qCZIRC9khmA

You can also learn more here:

https://tabsdata.com

Typical Use Cases

* Instant ETL - No jobs to schedule. Every update flows through the dependency graph immediately, so consumer-facing tables are always in sync with the latest from producers.

* Instant Lineage - Each table refresh results in a lineage graph that includes versions of inputs, outputs, and the transformations that connected them.

* Declarative DataOps - No pipelines to wrangle. Transformations are attached to tables directly, using declarative steps with clear inputs and outputs. All changes to tables are fully reproducible.

* Legacy ETL Modernization - Tabsdata maps cleanly to Informatica and Talend-style mappings. You can migrate without rewriting logic from scratch or disrupting downstream users.

What Tabsdata Is Not

* It is not a message broker or event system. You should still use Kafka, Kinesis, or equivalent if you are building real-time streaming applications.

* It is not a database or lakehouse. Tabsdata works with the data platforms you already have, delivering versioned, trusted tables into them as outputs.

We are still early and are looking for feedback. If you have dealt with pipeline sprawl, slow reconciliation, or unclear ownership across data teams, we would love to hear your perspective. What's missing? What doesn't make sense? What would make this more useful in your setup?

Best regards,

Arvind

Sem – Semantic diffs and patches for Git

https://ataraxy-labs.github.io/sem/
1•rs545837•2m ago•1 comments

Hello world does not compile

https://github.com/anthropics/claudes-c-compiler/issues/1
1•mfiguiere•7m ago•0 comments

Show HN: ZigZag – A Bubble Tea-Inspired TUI Framework for Zig

https://github.com/meszmate/zigzag
2•meszmate•10m ago•0 comments

Metaphor+Metonymy: "To love that well which thou must leave ere long"(Sonnet73)

https://www.huckgutman.com/blog-1/shakespeare-sonnet-73
1•gsf_emergency_6•12m ago•0 comments

Show HN: Django N+1 Queries Checker

https://github.com/richardhapb/django-check
1•richardhapb•27m ago•1 comments

Emacs-tramp-RPC: High-performance TRAMP back end using JSON-RPC instead of shell

https://github.com/ArthurHeymans/emacs-tramp-rpc
1•todsacerdoti•31m ago•0 comments

Protocol Validation with Affine MPST in Rust

https://hibanaworks.dev
1•o8vm•36m ago•1 comments

Female Asian Elephant Calf Born at the Smithsonian National Zoo

https://www.si.edu/newsdesk/releases/female-asian-elephant-calf-born-smithsonians-national-zoo-an...
2•gmays•37m ago•0 comments

Show HN: Zest – A hands-on simulator for Staff+ system design scenarios

https://staff-engineering-simulator-880284904082.us-west1.run.app/
1•chanip0114•38m ago•1 comments

Show HN: DeSync – Decentralized Economic Realm with Blockchain-Based Governance

https://github.com/MelzLabs/DeSync
1•0xUnavailable•43m ago•0 comments

Automatic Programming Returns

https://cyber-omelette.com/posts/the-abstraction-rises.html
1•benrules2•46m ago•1 comments

Why Are There Still So Many Jobs? The History and Future of Workplace Automation [pdf]

https://economics.mit.edu/sites/default/files/inline-files/Why%20Are%20there%20Still%20So%20Many%...
2•oidar•49m ago•0 comments

The Search Engine Map

https://www.searchenginemap.com
1•cratermoon•56m ago•0 comments

Show HN: Souls.directory – SOUL.md templates for AI agent personalities

https://souls.directory
1•thedaviddias•57m ago•0 comments

Real-Time ETL for Enterprise-Grade Data Integration

https://tabsdata.com
1•teleforce•1h ago•0 comments

Economics Puzzle Leads to a New Understanding of a Fundamental Law of Physics

https://www.caltech.edu/about/news/economics-puzzle-leads-to-a-new-understanding-of-a-fundamental...
3•geox•1h ago•0 comments

Switzerland's Extraordinary Medieval Library

https://www.bbc.com/travel/article/20260202-inside-switzerlands-extraordinary-medieval-library
2•bookmtn•1h ago•0 comments

A new comet was just discovered. Will it be visible in broad daylight?

https://phys.org/news/2026-02-comet-visible-broad-daylight.html
3•bookmtn•1h ago•0 comments

ESR: Comes the news that Anthropic has vibecoded a C compiler

https://twitter.com/esrtweet/status/2019562859978539342
2•tjr•1h ago•0 comments

Frisco residents divided over H-1B visas, 'Indian takeover' at council meeting

https://www.dallasnews.com/news/politics/2026/02/04/frisco-residents-divided-over-h-1b-visas-indi...
4•alephnerd•1h ago•5 comments

If CNN Covered Star Wars

https://www.youtube.com/watch?v=vArJg_SU4Lc
1•keepamovin•1h ago•1 comments

Show HN: I built the first tool to configure VPSs without commands

https://the-ultimate-tool-for-configuring-vps.wiar8.com/
2•Wiar8•1h ago•3 comments

AI agents from 4 labs predicting the Super Bowl via prediction market

https://agoramarket.ai/
1•kevinswint•1h ago•1 comments

EU bans infinite scroll and autoplay in TikTok case

https://twitter.com/HennaVirkkunen/status/2019730270279356658
6•miohtama•1h ago•5 comments

Benchmarking how well LLMs can play FizzBuzz

https://huggingface.co/spaces/venkatasg/fizzbuzz-bench
1•_venkatasg•1h ago•1 comments

Why I Joined OpenAI

https://www.brendangregg.com/blog/2026-02-07/why-i-joined-openai.html
25•SerCe•1h ago•18 comments

Octave GTM MCP Server

https://docs.octavehq.com/mcp/overview
1•connor11528•1h ago•0 comments

Show HN: Portview what's on your ports (diagnostic-first, single binary, Linux)

https://github.com/Mapika/portview
3•Mapika•1h ago•0 comments

Voyager CEO says space data center cooling problem still needs to be solved

https://www.cnbc.com/2026/02/05/amazon-amzn-q4-earnings-report-2025.html
1•belter•1h ago•0 comments

Boilerplate Tax – Ranking popular programming languages by density

https://boyter.org/posts/boilerplate-tax-ranking-popular-languages-by-density/
1•nnx•1h ago•0 comments