Ask HN: Should I implement my own integrity checks on my fileserver?

2•jacobwilliamroy•2h ago

So I have an SFTP server [Ubuntu 24.04.2 LTS (GNU/Linux 6.8.0-55-generic x86_64)] and an SFTP client (Windows 11): the client downloads files from the SFTP server. I had an idea to implement integrity checks by hashing the file on server side and also hashing the client's copy of the file after it is downloaded, then comparing the hashes to ensure the data was downloaded correctly. My question is: should I spend time implementing this? Does the OS already do this? This seems like something an OS should do.

Comments

PaulHoule•2h ago

It could be expensive for the OS to update a secure hash for a file every time you write() to it.

daveguy•1h ago

SFTP protocol includes checksum hashing on each packet sent. So corruption from the network is very unlikely (as it is also encrypted).

On the write to disk side, you are probably best off using ZFS or btrfs as the filesystem. These contain the option for similar integrity checks / error correction on write.

What is your threat model? Are you concerned about adversarial changes to the data or just prevention of corruption? Either way an adversary would have to be deep in your system or mitm to get around the transfer protocol protections. And the transfer protocols used by SFTP should handle random network corruption.

GPT-4.1 will be available directly in ChatGPT starting today

Details about Lava: Airbnb's new animation format

Oniux: Kernel-level Tor isolation for any Linux app

Kids Online Safety Act is back

Launch day for Maple AI – a new privacy AI in the Apple App Store with E2EE

Dropbox Is Down

My Microsoft MultiMedia Keyboard 1.0A is dead

Yume – Transform your content with GPU shaders

Unhappy Meals (2007)

How to systematically secure anything (2023)

A Framework for Defining and Refining Your ICP

Keeping Time on a Stream

Beyond the Wrist: Debugging RSI

54 years ago, a computer programmer fixed a bug, created an existential crisis

How the 'end of history' illusion shapes your life choices

Warners Reverses Course: Changes Max's Name Back to HBO Max

How we (re)built our AI agent for code reviews in IDEs

In search of a dynamist vision for safe superhuman AI

ONOX: The all-electric tractor with swappable battery packs

Trump admin ends extreme weather database that has tracked cost of disasters

Learning pointers 10 years too late

CISA changes vulnerabilities updates, shifts to X and emails

TikTok is using AI-generated alt text to describe photos

Students Are Short-Circuiting Their Chromebooks for a Social Media Challenge

Show HN: I made a client MCP react app for Supabase's MCP server

China and Russia have signed a deal to build a nuclear power plant on the moon

Free AI Code Reviews for Cursor, Windsurf and VS Code: CodeRabbit in IDE

Cell cycle duration determines oncogenic transformation capacity

Show HN: Turn any workflow diagram into compilable, running and stateful code

Teaching Kids about Money in the Age of Tap to Pay