frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ReJot – Database replication framework aimed at developers

https://github.com/rejot-dev/rejot
9•WilcoKruijer•1y ago
Hi Hacker News! We're Jan & Wilco from ReJot (https://rejot.dev). With ReJot we're building a framework that turns the write-ahead log of your database into an asynchronous communication channel for your services. ReJot enables application developers to define how the database tables they own should be replicated to other databases. Something we wish we had at in our previous job at a large fintech.

There is a gap between building internal (REST) APIs and Kafka (event streaming) to share data between services.

Internal APIs start to break down when you have more than a couple services communicating. Their synchronous nature makes them brittle in a distributed system: failures cascade and latency adds up. Companies operating internal APIs at scale often face challenges like managing implicit schemas and versioning. They also need to write significant amounts of code to implement features like circuit breakers and internal load balancing.

Event streaming addresses these issues by using asynchronous communication, but it also introduces significant drawbacks. Kafka is known for its operational complexity and high cost. Engineers must manage outbox tables, outbox processors, and consumers, which makes the system more difficult to understand and maintain.

ReJot is the middle ground solution that re-uses a database system's write-ahead log as an asynchronous communication channel. The WAL is well-suited to double as an outbox, this has been proven by CDC systems like Debezium. ReJot is a lightweight addition to existing infrastructure, and even re-uses existing (relational) database systems to store messages (temporarily) before sending them to the destination/sink databases.

We're developer focused, as opposed to being infrastructure focused. Much like how developers define the database table schemas they use, we enable developers to say how their data should be published to others in the distributed system. This is done through something we call "Public Schemas", they consist of a schema and a (SQL) query. When an item in the underlying table changes, the query is executed to produce an object conforming to the schema. This data is then forwarded through ReJot, ready to be consumed by a different service using a "Consumer Schema". This is again a simple (SQL) query that contains an INSERT statement. All of this is defined from within the codebase of the application, much like how ORMs or query builders work.

In short, ReJot re-uses your database in two ways: by consuming the WAL, and also by using queries to encapsulate and integrate data. This makes ReJot a good middle-ground between the brittleness of synchronous communication and the complexity of event streaming.

Excited to hear what you think!

Comments

raoulritter•1y ago
I'm thinking that now with all these agent to agent frameworks this could potentially work for that. If you send off one agent you want them to keep up to date and sync / talk to each-other. Could your solution work for something like A2A by google or similar to enhance the synchronization across the different agents doing their tasks and prevent them from landing in a loop or similar.
WilcoKruijer•1y ago
I'm not too familiar with how people store the state of AI agents, but I do think there's some opportunity to use ReJot for this use case. Hooking up an agent to ReJot and giving them access to all available Public Schemas could be an interesting way of letting an agent explore and use the data in a distributed system.
jasonthorsness•1y ago
If the consumers stall, doesn't the WAL have to grow in unbounded fashion? Does it place any backpressure on the writers?
WilcoKruijer•1y ago
You're right. Since we don't want to put too much pressure on the source database, we do save the (transformed) WAL items in an intermediary database (we call this the event store), so the source can clear its WAL.

This does mean the intermediary database can grow in an unbounded fashion. The use case really determines if this is fine or not. Since our focus right now is on (micro)service communication, we think this is fine in most cases, as the throughput usually is not gigantic.

Since the event store is just a Postgres database, it's easy to set up partitions to only retain data for a certain amount of time. On the near-term roadmap we also have back-fill support which will make it easier to work with shorter retention windows.

The Grammar of Simulation

https://simgrammar.com/
1•bpierre•4m ago•0 comments

Show HN: NestDaddy Memory, one memory shared by ChatGPT, Claude and Cursor

https://nestdaddy.com/memory
1•nestdaddy•4m ago•0 comments

Cloudflare WAF protects against ruby2shell (CVE-2026-132825)

https://blog.cloudflare.com/ruby2shell-waf-protection/
1•motolibre•6m ago•0 comments

AI Explorables: Big Ideas in Machine Learning (People and AI Research (Pair))

https://pair.withgoogle.com/explorables/
1•vismit2000•7m ago•0 comments

The Beautiful but Annoying Rigidity of Dead Languages

https://nntaleb.substack.com/p/on-the-beautiful-but-annoying-rigidity
1•Michelangelo11•9m ago•0 comments

I won't leave mathematics, despite AI solving centuries-old problems

https://www.theguardian.com/commentisfree/2026/nov/22/why-i-wont-leave-mathematics-despite-ai-sol...
1•artninja1988•12m ago•0 comments

Intel says its graphics-free GPU beats Nvidia's by up to 5.9x in benchmarks

https://www.techspot.com/news/114624-intel-graphics-free-d270-gpu-beats-nvidia-rtx.html
1•theanonymousone•12m ago•0 comments

Show HN: Marketing Can Ship to Production

https://appos.build/kitewell/
1•KingOfCoders•15m ago•0 comments

AI is becoming a disaster for the climate

https://www.bloodinthemachine.com/p/ai-is-becoming-a-disaster-for-the
2•Brajeshwar•22m ago•0 comments

I know who's popping the AI bubble now [video]

https://www.youtube.com/watch?v=YNTpOLbvKTs
2•Bender•23m ago•0 comments

Show HN: Grassline, a simple alternative to Paseo for talking to agents remotely

https://github.com/andunieee/grassline/blob/master/README.md
2•andunieee•24m ago•1 comments

Fornax's Guide to Fast Ethernet

https://docs.pixeldrain.com/posts/2024-03-07_network_optimizations/
2•signa11•27m ago•0 comments

Linux Time Machine – A trip through Linux history in the browser

https://linuxtimemachine.org/
1•hamdyaea•28m ago•0 comments

Mibz2: A bzip2 decoder built for memory-level parallelism

https://lmmx.github.io/mibz2/
1•mariuz•31m ago•0 comments

National Book Award 2026

https://www.betterreads.dev/collections/national-book-award-2026
1•zlu•33m ago•0 comments

16-year-old awarded $500k by Y Combinator for AI-guided-missile startup

https://www.wired.com/story/henrijs-dandzbergs-polemos-missiles-ai-warfare/
3•bookofjoe•35m ago•1 comments

Make your team's workflows run themselves. Define a workflow in code

https://factory.redbeardlab.com/
1•Bluestein•37m ago•0 comments

Discombobulated?

https://discuss.google.dev/t/trusted-automation-with-google-antigravity-scaling-secure-finance-in...
1•simontwiggukggg•38m ago•0 comments

Show HN: A free website check that starts from what your buyers search

https://meetadmiral.com/website-seo-checker
1•4ugusta•39m ago•0 comments

Show HN: Multiplayer paper planes with simulated aerodynamics in WebGL

https://github.com/michidk/paperfold
2•michidk•42m ago•0 comments

Marren Akeyo: 8-Year-old Kenyan Girl Impresses World with Powerful COP31 Speech

https://www.tuko.co.ke/world/asia/647513-marren-akeyo-8-year-kenyan-girl-impresses-world-leaders-...
1•Bluestein•43m ago•0 comments

Show HN: Codeint – Measure duplication and complexity drift in AI-written code

https://github.com/avidianity/codeint
1•avidianity•44m ago•0 comments

Show HN: SettledByAI, a neutral second opinion for everyday disputes

https://settledbyai.com/
1•ComputeCompare•44m ago•0 comments

Looking for the Formula to Stop an Apocalypse

https://www.nytimes.com/2026/11/22/magazine/looking-for-the-formula-to-stop-an-apocalypse.html
2•enoint•45m ago•0 comments

CPU-Arc: Agentic Reasoning Caching for On-CPU Reasoning Reuse

https://arxiv.org/abs/2611.09891
1•vermorel•46m ago•0 comments

Show HN: Dawdle, compete with friends and family in a daily 5 minute word puzzle

https://playdawdle.com
1•yahmez•47m ago•0 comments

Like Netflix for Hacker News stories

https://hndocs.org/
2•recuerdala•50m ago•0 comments

Neil the Seal Management Plan November 2026 [pdf]

https://nre.tas.gov.au/Documents/Neil%20the%20Seal%20Management%20Plan.pdf
1•susiecambria•51m ago•0 comments

Indian mathematician cracks 70-year-old maths problem earns spot on TIME100 Next

https://indianexpress.com/article/trending/trending-in-india/indian-mathematician-neena-gupta-cra...
1•fork-bomber•52m ago•0 comments

Show HN: Coma – Bilingual ES/EN language with LLVM back end and C runtime

1•Agmine•53m ago•0 comments