frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Litestream Writable VFS

https://fly.io/blog/litestream-writable-vfs/
20•emschwartz•1h ago

Comments

vivzkestrel•4d ago
- anyone knows what is the equivalent of litestream for postgres? - i want to be able to pg_dump and barman my database to s3 by streaming it. is that possible?
pbrumm•4d ago
There is wal-g that moves the wal files to s3 and you can spin up any number of instances off of that. Works great for catching up secondary servers
vivzkestrel•3d ago
just a quick look on it, is that more like pg_dump or barman?
Eikon•2h ago
You might be interested in ZeroFS [0], it works great with Postgres [1].

To achieve what you describe, you should be just able to setup a Postgres replica that’s setup on top of ZeroFS.

[0] https://github.com/Barre/ZeroFS

[1] https://github.com/Barre/ZeroFS?tab=readme-ov-file#postgresq...

direwolf20•2h ago
Did Postgres's WAL archiving feature not work for you?
xrd•2h ago
I love litestream. I've used it with pocketbase and it works. sqlite is a great building block for almost everything.

Does anyone know whether you could use this to stitch together a bunch of .db files (that share the same schema) in an ad-hoc way?

For example, if I decided I wanted to synchronize my friend's .db file, could I enable this using litestream? And, what if my friend wanted to sync two of his friends' .db files, but I'm only interested in his changes, not theirs? I assume this kind of fan out is not possible, but it would be fun if so.

benbjohnson•1h ago
If you can have multiple writers to a single database then you'd need to look at something like cr-sqlite[1] that uses CRDT to figure out conflicts. If you're just replicating separate databases then you might be able to replicate each one using Litestream and then use SQLite's ATTACH[2] to connect them together. There is a limit on how many databases you can attach together in a session though.

[1]: https://github.com/vlcn-io/cr-sqlite

[2]: https://sqlite.org/lang_attach.html

ncruces•2h ago
I need to bring writes to my version of the VFS.

I'm still waiting on how they'll prevent accidental corruption from multiple writers; there's a PR implementing write leases, not sure if that's the direction they'll take.

That said, pausing local polling when writes are enabled - i.e. assuming you're the only writer - makes sense, it's a good idea; hadn't occurred to me.

Ideally, I'd like to offer durability on fullfsync. I think this is feasible. In a concurrent system (single host), while a writer is waiting for durability confirmation, readers can continue reading the previous state, and the next writer can read the committed - but not yet durable - data and queue its writes to be batched. You can have as many pending writes as you're willing to have connections.

benbjohnson•1h ago
Litestream author here. Currently we're handling the "single writer" issue outside of Litestream. We have controls in our internal systems that make it work well. But yes, the lease PR is the direction we're looking at going.

I'm not sure you can have readers see something separate than writers. When SQLite promotes a read lock to a write lock under WAL then it checks if any of the data has changed and then fails the transaction if it has.

dang•1h ago
[sorry for the weird timestamps - the OP was submitted a while ago and I just re-upped it and it hit a dumb bug which I haven't gotten around to fixing yet]
skybrian•1h ago
I’m a hobbyist who doesn’t have any s3-compatible storage. (That I know of, anyway.) What’s the easiest way to try it out?
hnrayst•1h ago
Easiest is probably a local S3-compatible like MinIO (docker) and point Litestream at that endpoint. If you want hosted, R2/B2 free tiers work too. It only needs S3 creds + endpoint.
benbjohnson•1h ago
Litestream author here. You can use the built-in file replication. It'll replicate all your database changes to another path on disk. I use it a lot for testing things out:

https://litestream.io/guides/file/

joshstrange•50m ago
I glad this got re-upped, I was sad there wasn't much (any?) discussion when this was posted a few days ago.

I find the ways people extend or build on top of Sqlite to be fascinating. I use it in a few apps but not on the server (yet). Multi-writer for something like would be amazing (incredibly difficult to do well, obviously). I work on a home-rolled distributed database (multi-writer) but it has numerous downsides/issues so I love seeing how other people approach and solve these things.

Using React and Claude Code to make slides awesome and easy

https://newsletter.aimuscle.com/p/using-ai-agents-to-make-better-slides
1•Sherveen•20s ago•0 comments

Show HN: Moonlit – Slowed and nightcore web player for YouTube and TikTok

https://moonlit.wastu.net
1•wastu•5m ago•0 comments

How AI Changed This Olympic Snowboarder's Signature Trick

https://www.wsj.com/articles/how-ai-changed-this-olympic-snowboarders-signature-trick-029f0c5d
1•bookofjoe•8m ago•1 comments

Show HN: All in One AI Assistant

https://fluxchat.org/
1•rainel•11m ago•0 comments

New York poised to legalize medical aid in dying

https://www.politico.com/news/2026/02/04/medical-aid-in-dying-new-york-00766413
1•JumpCrisscross•12m ago•0 comments

Triangle: A Two-Dimensional Quality Mesh Generator and Delaunay Triangulator

https://www.cs.cmu.edu/~quake/triangle.html
2•MassPikeMike•13m ago•0 comments

Alphabet expects 2026 capex in the range of $175B to $185B

https://www.cnbc.com/2026/02/04/alphabet-googl-q4-2025-earnings.html
2•mfiguiere•14m ago•0 comments

Against the Orthogonality Thesis

https://jonasmoman.substack.com/p/against-the-orthogonality-thesis
2•paulpauper•15m ago•0 comments

Making Sense of Madness: Stress-Induced Hallucinogenesis

https://mad.science.blog/2021/11/30/making-sense-of-madness-stress-induced-hallucinogenesis/
1•paulpauper•16m ago•0 comments

Ask HN: Have any 100% AI companies been founded yet?

1•LPisGood•18m ago•1 comments

Language Modeling, Part 5: Reverse Engineering LSTM Cells

https://connorjdavis.substack.com/p/language-modeling-part-5-reverse
1•cjamsonhn•18m ago•0 comments

Show HN: MEDF – Mutable Expression Description Format

https://github.com/maskin/medf
1•maskin•19m ago•1 comments

Ask HN: Have LLMs improved the lives of the blind?

3•xupybd•19m ago•0 comments

OpenClaw Is What Apple Intelligence Should Have Been

https://www.jakequist.com/thoughts/openclaw-is-what-apple-intelligence-should-have-been
3•jakequist•21m ago•2 comments

Show HN: Replacing NotNull and Preconditions with fluent Java assertions

1•symplice•24m ago•0 comments

Idiots just like you and I: AI and the people that make it

https://vidurabr.com/essays/idiots-just-like-you-and-i-ai-and-the-people-that-make-it
1•treavorpasan•26m ago•0 comments

Steam Hardware: Launch timing and other FAQs

https://store.steampowered.com/news/group/45479024/view/625565405086220583
4•Philpax•28m ago•1 comments

From magic to malware: How OpenClaw's agent skills become an attack surface

https://1password.com/blog/from-magic-to-malware-how-openclaws-agent-skills-become-an-attack-surface
1•birdculture•31m ago•0 comments

Simple LLM Native Todo System on OpenCode

https://danielwkiwi.mataroa.blog/blog/simple-llm-native-todo-system-on-opencode/
1•xupybd•36m ago•0 comments

Air in Indoor Ice Rinks a Health Risk for 2026 Olympians

https://www.medscape.com/viewarticle/indoor-ice-air-health-concern-ahead-2026-olympics-2026a10002ou
1•wjb3•39m ago•0 comments

Show HN: Local AI – Curated resources for running LLMs on consumer hardware

https://github.com/msb-msb/awesome-local-ai
1•insiderllm•40m ago•0 comments

Watch Club's producing short video dramas and building a social network for them

https://techcrunch.com/2026/02/03/watch-club-microdrama-video-social-network/
1•nadis•42m ago•0 comments

Show HN: Toktrack – 1000x faster AI CLI cost tracker (Rust and SIMD)

https://github.com/mag123c/toktrack
3•mag123c•42m ago•1 comments

Kyiv bureau among those axed by Jeff Bezos' Washington Post,journalists laid off

https://kyivindependent.com/jeff-bezos-washington-post-shuts-down-kyiv-bureau-fires-staff/
6•wslh•43m ago•0 comments

Senators Accuse Equifax of 'Price-Gouging' Medicaid Programs

https://www.nytimes.com/2026/02/04/health/equifax-medicaid-states-senators.html
2•geox•45m ago•0 comments

New Source Performance Standards Review for Stationary Combustion/Gas Turbines [pdf]

https://www.epa.gov/system/files/documents/2026-01/for-website_preamble-clean-san11542-combustion...
1•wjb3•46m ago•1 comments

The Prompt That Makes My Local Coding Agent Possible

https://www.robpanico.com/articles/display/?entry_short=the-prompt-that-makes-my-local-coding-age...
1•retrocog•47m ago•1 comments

Mouthbreathing Machiavellis Dream of a Silicon Reich (2014)

https://thebaffler.com/latest/mouthbreathing-machiavellis
12•lbrito•47m ago•3 comments

Show HN: AI that prepares you for meetings automatically

https://forms.zams.com/t/gN4eXz3mMgus
1•nddave•48m ago•1 comments

Show HN: Fundamental financial data directly in Google Sheets

https://workspace.google.com/marketplace/app/finqual/218031317945
1•myztika•50m ago•0 comments