frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

SQLite's Durability Settings Are a Mess

https://www.agwa.name/blog/post/sqlite_durability
56•ciconia•2h ago

Comments

topspin•1h ago
45 minutes and zero comments.

That is notable and revealing. I know there is a lot of love for SQLite, and I know it's well deserved. However, I also know that anyone that has ever had to navigate the thicket of SQLite's ever evolving durability story has at least some alignment with the basic point here, and a little open discussion of this might not be the worst idea.

3eb7988a1663•59m ago
It is the weekend. Most people use this site to avoid doing work.

Edit: whoops, it is Friday! Gave myself a long weekend, and was just default thinking it is Saturday.

lyjackal•56m ago
it's Friday, and I'm avoiding doing work
3eb7988a1663•52m ago
Ha! Whelp, it is my weekend.
cenamus•1h ago
So this article ask exactly the same as the reply do Dr Hipps comment, just in a 1000 words, instead of 10? Whether the docs are out of sync?
topspin•40m ago
> Whether the docs are out of sync?

Were this a one off, you would have a point. It isn't, however. My experience over many years has been that you can't ever be certain about what is actually going on, based on the documentation alone, and that you wind up in Reddit and Stack Overflow and a plethora of blog posts attempting to figure it out. With LLMs, we have only more sources of contradictory and chronically obsolescent input.

There is an actual problem here. However I can see that, based on the contributions from the SQLite downmod mafia, this talk isn't welcome, so I'm off to some other thing. Have a nice weekend, I suppose.

mtmail•37m ago
> the SQLite downmod mafia

Oh, come on. There's no open or secret attempt at censoring talk about sqlite on HN. (The story is #11 on the frontpage the minute the comment was made.)

NewsaHackO•27m ago
> By default, SQLite is not durable, because the default value of journal_mode is DELETE, and the default value of synchronous is FULL, which doesn't provide durability in DELETE mode.

From the documentation, it seems like synchronous being FULL does provide durability of the database in DELETE mode, as FULL means it calls fsync after the transaction is completed. I think you may be confusing durability of the journal file with durability of the database. I don't think WAL can ever really have a durable transaction; it is essentially based on leaving a transaction open until it gets "check-pointed" or actually committed to the database file.

mlyle•22m ago
> I don't think WAL can ever really have a durable transaction; it is essentially based on leaving a transaction open until it gets "check-pointed" or actually committed to the database file.

In general: WAL means you write the transaction to the WAL, fsync (in sqlite, this depends upon the sync mode], and then return it's done to the application. The transaction is then durable: even if the database crashes, the contents of the WAL will be applied to the database file.

Checkpointing later just lets you throw away that part of the WAL and not have to replay as much to the database file.

agwa•21m ago
My understanding of DELETE mode is that the transaction is not committed until the rollback journal file is deleted - if the rollback journal is present when sqlite opens a database, it applies the rollback journal to undo the changes that the transaction made. See https://www.sqlite.org/atomiccommit.html#1_deleting_the_roll...

If the directory containing the rollback journal is not fsynced after the journal file is deleted, then the journal file might rematerialize after a power failure, causing sqlite to roll back a committed transaction. And fsyncing the directory doesn't seem to happen unless you set synchronous to EXTRA, per the docs cited in the blog post.

bawolff•16m ago
I can't help but feel that the difference to other DBs is that they just don't have these knobs or tell you at all.
agwa•14m ago
PostgreSQL has the knobs and I find the documentation about them very clear: https://www.postgresql.org/docs/current/wal-async-commit.htm...
d1l•11m ago
This is disingenuous and probably was written this way for HN cred and clicks. Sqlite's test suite simulates just about every kind of failure you can imagine - this document is worth reading if you have any doubts: https://www.sqlite.org/atomiccommit.html
agwa•5m ago
That document addresses atomicity, not durability, and is thus non-responsive to my concerns.
tiffanyh•11m ago
SQLite is an incredible piece of software, and its commitment to backward compatibility is deeply admirable. But that same promise has also become a limitation.

v3.0 was first released in 2004—over 20 years ago—and the industry has changed dramatically since then.

I can’t help but wish for a “v4.0” release: one that deliberately breaks backward compatibility and outdated defaults, in order to offer a cleaner, more modern foundation.

Note: I'm not asking for new functionality per se. But just a version of SQLite that defaulted to how it should be used, deployed in 2025.

Musk's xAI sues engineer for allegedly taking secrets to OpenAI

https://www.aol.com/news/musks-xai-sues-engineer-allegedly-172425255.html
1•amrrs•4m ago•0 comments

Cloudflare confirms downtime on August 23rd, silently posts it on status page

2•Kal2ef•7m ago•1 comments

An Open Letter to Everyone I've Butted Heads With

https://andrewkelley.me/post/open-letter-everyone-butted-heads.html
1•brson•7m ago•0 comments

Whodunit: LLM Murder Mysteries

https://blog.apartment304.com/whodunit-llm-murder-mysteries/
1•selljamhere•7m ago•0 comments

The No-CPU Amiga Demo Challenge

https://github.com/askeksa/NoCpuChallenge
2•doener•10m ago•0 comments

End of de minimis shipping could be Trump's biggest tariff of all

https://www.cnbc.com/2025/08/29/trump-de-minimis-shipping-trade-war-tariffs.html
1•speckx•12m ago•0 comments

How did .agakhan, .ismaili and .imamat get their own TLDs?

https://data.iana.org/TLD/tlds-alpha-by-domain.txt
9•aerodog•14m ago•7 comments

Show HN: NotifyThem – Real-Time Website Notifications for User Engagement

https://www.notifythem.app
1•mrmountassir•14m ago•0 comments

What Is an Entrepreneur?

https://medium.com/@khalilliouane/what-no-one-tell-you-about-being-entrepreneur-40d19a72e16f
2•liouanos•16m ago•0 comments

Cosplay Pro – A Place for Cosplayers

https://cosplaypro.app/
1•ForceEchoMaster•20m ago•0 comments

A Keystore Companion for MetaMask

https://lodgelock.org/
2•Robert_MacWha•21m ago•2 comments

New reMarkable "Paper Pro Move" leaked to Reddit ahead of Sep 3 launch

https://old.reddit.com/r/Remarkable/comments/1n3f3ww/exclusive_remarkable_will_announce_the_paper...
2•davisr•23m ago•1 comments

Thoughts on AI, Intelligence, and Knowledge

https://kudmitry.com/articles/thoughts-on-ai-intelligence-and-knowledge/
1•skwee357•24m ago•0 comments

What AI chatbots are doing under the hood

https://www.gilesthomas.com/2025/08/what-ai-chatbots-are-doing-under-the-hood
2•gpjt•24m ago•0 comments

Do the simplest thing that could possibly work

https://www.seangoedecke.com/the-simplest-thing-that-could-possibly-work/
2•dondraper36•25m ago•0 comments

Modern-Day Auto Design Is Increasing Forward Blind Spots

https://www.core77.com/posts/138324
1•sizzle•27m ago•0 comments

Matrix Multiplication on Nvidia's Blackwell: Part 1 – Introduction

https://www.modular.com/blog/matrix-multiplication-on-nvidias-blackwell-part-1-introduction
2•timmyd•30m ago•0 comments

Vitraux

https://github.com/sebastiantramontana/Vitraux
1•sebatramontana•30m ago•0 comments

Tesla challenges $243M verdict in Autopilot death trial

https://techcrunch.com/2025/08/29/tesla-challenges-243-million-verdict-in-autopilot-death-trial/
1•fortran77•31m ago•0 comments

Show HN: BrowserTotal – Free, real-time AI scanner for browser extensions

https://browsertotal.com/analysis/live
2•minche•31m ago•0 comments

AI Models Need a Virtual Machine

https://blog.sigplan.org/2025/08/29/ai-models-need-a-virtual-machine/
2•reshabh•33m ago•0 comments

Anthropic changing privacy policy [Email]

2•dsalzman•35m ago•0 comments

What Is Threat Modeling?

https://shehackspurple.ca/2025/08/15/what-is-threat-modeling/
1•shehackspurple•36m ago•1 comments

Is algorithmic mediation always bad for autonomy?

https://blog.cosmos-institute.org/p/is-algorithmic-mediation-always-bad
1•simonpure•37m ago•0 comments

Spouses tend to share psychiatric disorders, massive study finds

https://www.nature.com/articles/d41586-025-02772-8
6•rntn•37m ago•0 comments

Zuckerberg's AI hires disrupt Meta with Swift exits and threats to leave

https://arstechnica.com/ai/2025/08/zuckerbergs-ai-hires-disrupt-meta-with-swift-exits-and-threats...
5•whiteboardr•38m ago•2 comments

WhatsApp fixes 'zero-click' bug used to hack Apple users with spyware

https://techcrunch.com/2025/08/29/whatsapp-fixes-zero-click-bug-used-to-hack-apple-users-with-spy...
1•OutOfHere•41m ago•0 comments

Voice of Sigchi

https://drive.google.com/file/d/1Ns-eG9MgVZxx_zPeKi2fF8zMWPXA38ey/view
1•wslh•41m ago•0 comments

Everybody Imitates Hypnotoad (History of and Recreating the Hypnotoad Sound)

https://www.scottsmitelli.com/articles/everybody-imitates-hypnotoad/
2•jszymborski•43m ago•0 comments

Linus Torvalds Marks Bcachefs as Now "Externally Maintained"

https://www.phoronix.com/news/Bcachefs-Externally-Maintained
5•database64128•44m ago•0 comments