frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ReJot – Database replication framework aimed at developers

https://github.com/rejot-dev/rejot
9•WilcoKruijer•1y ago
Hi Hacker News! We're Jan & Wilco from ReJot (https://rejot.dev). With ReJot we're building a framework that turns the write-ahead log of your database into an asynchronous communication channel for your services. ReJot enables application developers to define how the database tables they own should be replicated to other databases. Something we wish we had at in our previous job at a large fintech.

There is a gap between building internal (REST) APIs and Kafka (event streaming) to share data between services.

Internal APIs start to break down when you have more than a couple services communicating. Their synchronous nature makes them brittle in a distributed system: failures cascade and latency adds up. Companies operating internal APIs at scale often face challenges like managing implicit schemas and versioning. They also need to write significant amounts of code to implement features like circuit breakers and internal load balancing.

Event streaming addresses these issues by using asynchronous communication, but it also introduces significant drawbacks. Kafka is known for its operational complexity and high cost. Engineers must manage outbox tables, outbox processors, and consumers, which makes the system more difficult to understand and maintain.

ReJot is the middle ground solution that re-uses a database system's write-ahead log as an asynchronous communication channel. The WAL is well-suited to double as an outbox, this has been proven by CDC systems like Debezium. ReJot is a lightweight addition to existing infrastructure, and even re-uses existing (relational) database systems to store messages (temporarily) before sending them to the destination/sink databases.

We're developer focused, as opposed to being infrastructure focused. Much like how developers define the database table schemas they use, we enable developers to say how their data should be published to others in the distributed system. This is done through something we call "Public Schemas", they consist of a schema and a (SQL) query. When an item in the underlying table changes, the query is executed to produce an object conforming to the schema. This data is then forwarded through ReJot, ready to be consumed by a different service using a "Consumer Schema". This is again a simple (SQL) query that contains an INSERT statement. All of this is defined from within the codebase of the application, much like how ORMs or query builders work.

In short, ReJot re-uses your database in two ways: by consuming the WAL, and also by using queries to encapsulate and integrate data. This makes ReJot a good middle-ground between the brittleness of synchronous communication and the complexity of event streaming.

Excited to hear what you think!

Comments

raoulritter•1y ago
I'm thinking that now with all these agent to agent frameworks this could potentially work for that. If you send off one agent you want them to keep up to date and sync / talk to each-other. Could your solution work for something like A2A by google or similar to enhance the synchronization across the different agents doing their tasks and prevent them from landing in a loop or similar.
WilcoKruijer•1y ago
I'm not too familiar with how people store the state of AI agents, but I do think there's some opportunity to use ReJot for this use case. Hooking up an agent to ReJot and giving them access to all available Public Schemas could be an interesting way of letting an agent explore and use the data in a distributed system.
jasonthorsness•1y ago
If the consumers stall, doesn't the WAL have to grow in unbounded fashion? Does it place any backpressure on the writers?
WilcoKruijer•1y ago
You're right. Since we don't want to put too much pressure on the source database, we do save the (transformed) WAL items in an intermediary database (we call this the event store), so the source can clear its WAL.

This does mean the intermediary database can grow in an unbounded fashion. The use case really determines if this is fine or not. Since our focus right now is on (micro)service communication, we think this is fine in most cases, as the throughput usually is not gigantic.

Since the event store is just a Postgres database, it's easy to set up partitions to only retain data for a certain amount of time. On the near-term roadmap we also have back-fill support which will make it easier to work with shorter retention windows.

Supertoast, Redux

https://hatchet.run/blog/supertoast-wasnt-enough
1•abelanger•49s ago•0 comments

Show HN: I built the Apple Screen Time I needed to stop doomscrolling / phubbing

https://www.lightscroll.app/
1•juanferreras•58s ago•0 comments

Vue Flow joins xyflow

https://xyflow.com/blog/vue-flow-joins-xyflow
1•moklick•2m ago•0 comments

Gears (2020)

https://ciechanow.ski/gears/
1•dverlaeckt80•2m ago•0 comments

Vera Rubin NVL72: 2x Blackwell Ultra Performance in MLPerf Training v6.1

https://developer.nvidia.com/blog/nvidia-vera-rubin-nvl72-achieves-up-to-2x-blackwell-ultra-perfo...
1•wondersky•2m ago•0 comments

Efficacy of exercise therapies in knee osteoarthritis (network meta-analysis)

https://pmc.ncbi.nlm.nih.gov/articles/PMC13762337/
1•chavasorani•3m ago•0 comments

Show HN: Kalka – An open-source design tool where every layer is real HTML/CSS

https://github.com/leyscore/kalka
1•bauriceley•3m ago•0 comments

Show HN: LooPo – A word completion game run in the browser

https://loopo.online
1•yuzman•3m ago•0 comments

Using Tries to resolve bash command effects in 343 nanoseconds

https://dirac.run/posts/braket
1•GodelNumbering•5m ago•0 comments

Show HN: A base language model in Kannada (435M)

https://huggingface.co/SuhasBhairav/kalike
1•techappsdev•5m ago•0 comments

Show HN: Rewrite, a free editor that rewrites text and edits Word, LaTeX and PDF

https://github.com/SamratDuttaOfficial/Rewrite
1•TheDutta•6m ago•0 comments

Show HN: Skiss – Save websites with their real CSS, fonts and full-page shots

https://skiss.co/
1•tmaxxco•6m ago•0 comments

S. Korea to send nationwide emergency alerts over college entrance exam cheating

https://apnews.com/article/south-korea-exam-cheating-ai-college-e25b5612dbf4bd09fdf9197254c4547e
2•parksb•7m ago•0 comments

Show HN: An open virtual office to cowork with humans while your agents work

https://flat.social/virtual-office-platform
4•pawelwentpawel•7m ago•0 comments

InvizCrypt Interactive Docs Demo

https://www.invizcrypt.com/docs/privacy-demo
1•htewari•7m ago•0 comments

Saving money for the distant future is pointless with the advent of super intell

https://elonmuskarchive.org/posts/2115686311134744736
1•mudiadamz•9m ago•0 comments

The Useless Computer

https://bitfieldconsulting.com/posts/useless-computer
1•dxs•9m ago•0 comments

Keep your primary GPG key offline – Part 2

https://marcofranssen.nl/keep-your-primary-gpg-key-offline-part-2
1•marcofranssen•9m ago•0 comments

Larkdown: New default "open with" app for .md files on Mac

https://github.com/mikeokner/Larkdown
1•mikeokner•9m ago•0 comments

A shared AI works for the meeting. Yours works for you

https://ethanflow.com/writing/whose-ai-in-the-meeting/
2•ethan-ys•12m ago•0 comments

Pinecall – Open-source framework for voice apps, built on LiveKit

https://github.com/pinecall/pinecall
2•bernatch•12m ago•0 comments

SpaceX launched more mass to orbit this year than Europe in its history

https://www.kadoa.com/companies/insights/spacex-europe-payload
1•hubraumhugo•13m ago•1 comments

When Jorge Luis Borges Co-Wrote a Surreal Sci-Fi Noir Film: Invasión (1969)

https://www.openculture.com/2026/11/when-jorge-luis-borges-co-wrote-a-surreal-sci-fi-noir-film-in...
2•Brajeshwar•17m ago•0 comments

The Dark Side of the Moon Was the Brightest Part of 2026

https://www.wired.com/story/wired-yearbook-2026-artemis-crew/
2•Brajeshwar•17m ago•0 comments

Show HN: Tom – meeting recording and feedback specs, all locally on Mac

https://github.com/automatics-dev/mac-tom
3•mirceapreotu•17m ago•0 comments

Why was that backup so large?

https://eclecticlight.co/2026/11/17/why-was-that-backup-so-large/
4•Brajeshwar•17m ago•0 comments

ISO coding agent power users to try a new cloud – VC Backed company

https://console.openinfer.ai/register
1•cjbuffington•18m ago•0 comments

BlameGraph – Know which step broke your multi-agent run

https://agentschecked.com/try/
1•nickzoomer•19m ago•0 comments

Fact-Checking at Scale: Building a More Accurate Synopsis Factuality System

https://netflixtechblog.com/fact-checking-at-scale-building-a-more-accurate-and-efficient-synopsi...
1•torutofu•19m ago•0 comments

European Commission to Give Border Agency Frontex “Trusted Flagger” Status

https://www.eff.org/deeplinks/2026/11/european-commission-plan-give-frontex-trusted-flagger-statu...
1•iamnothere•21m ago•0 comments