Ask HN: Why Databases Instead of Filesystem?

3•uticus•1h ago

A database could be described crudely as a program for interfacing with data on disk. Most software is built to interface with databases although the software also has (often very capable) ways of interfacing with data on disk via filesystem interaction.

My question is, what historically has driven the industry to focus on database-specific solutions, rather than on filesystem-specific solutions?

This is not a rant against databases, but I do wonder why many major programming languages and frameworks (RoR Active Directory, C# EF, etc) have put much effort into making database interaction smooth from the perspective of the programming language, instead of putting effort into interacting with data on disk. Kind of an alternate reality sort of musing.

Comments

codingdave•1h ago

A database is a file system when you get down to it. The reason people use them is to abstract up a layer so you can query the data and get the results you want instead of having to iterate through direct reads of a disk, then having to read, parse, and filter what you want from those reads. You could always write code to help do those things direct from disk, but you know what you have just written if you do so? A database!

PaulHoule•1h ago

I'd say the filesystem is a database.

It would be straightforward, for instance, to implement a lot of the functionality of a filesystem in a database with BLOBs. Random access might be a hassle, but people are getting used to "filesystem-like" systems which are bad at random access like S3.

uticus•1h ago

> You could always write code to help doing those things direct from disk, but you know what you have just written if you do so? A database!

Yes, but that's my point. Why is this not a part of the standard library / typical package with very little friction with the rest of the code, instead of a separate program that the standard library / typical packages provide in an attempt to reduce the friction?

Or are you making the general point that databases already existed prior to the standard libraries etc, and this is just a case of interfacing with an existing technology instead of rebuilding from scratch?

lgeorget•1h ago

More of a sidenote than an answer but a database system can be faster than using the disk directly: https://sqlite.org/fasterthanfs.html#approx.

It turns out having a defined abstraction like a database makes things faster than having to rely on a rawer interface like filesystems because you can then reduce the number of system calls and context switches necessary. If you wanted to optimize that in your own code rather than relying on a database, you'd end up reinventing a database system of sorts, when (probably) better solutions already exist.

FrankWilhoit•1h ago

It turns out to be quite unreasonably difficult to put something aside for a time -- from milliseconds to decades -- and then go back and find it again. The difficulty is all in the "find", because things that anyone might care about finding have various different aspects that different people may care about. There is no middle ground between the electronic equivalent of a pile of papers on one's desk and the full capabilities of the relational model. Filesystems are somewhere in between; but there is no useful place in between.

Federal Court Denies Anthropic's Motion to Lift 'Supply Chain Risk' Label

Show HN: BNNR – a closed-loop pipeline for improving vision models

Names and faces of those killed by Israel in its April 8 massacre

You're Looking at the Wrong Pretext Demo

Rolling your own crypto can make sense (sometimes)

Show HN: Haven – persistent SSH sessions without tmux

Status: Tariff Refunds

I gave every train in New York an instrument

France to ditch Windows for Linux to reduce reliance on US tech

Show HN: Figma for Coding Agents

Show HN: I built a project board where AI agents join as real teammates

eBPF-based PostgreSQL wait event tracer using hardware watchpoints

Physics stippling with headless simulation and batched rendering [video]

Will Lower Courts Find Ways Around Cox vs. Sony? You Betcha

Florida AG launches investigation into OpenAI

Writer Survey: 60% of Companies Plan to Lay Off Employees Who Won't Adopt AI

Show HN: Skilldeck – Desktop app to manage AI agent skill files across tools

We analyzed 5M App Store rankings – here's what moves the needle

Yikes, Encryption's Y2K Moment Is Coming Years Early

RemembrallMCP – persistent memory and code graph for AI agents

What does it mean to create with AI?

Wisconsin city passes nation's first anti-data center referendum

The Gentle Seduction [pdf]

Framework founder says that 'personal computing as we know it is dead'

GBrain – The memex, built for people who think for a living

Some Movement of Models

Honeywell and Odys Develop Laila VTOL Anti-Drone Platform

Helium Is Hard to Replace

Show HN: I created a leaderboard converting your LOC into garrytans. COPE

Born Private: Reserve your child's first email address with Proton