frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: Options for storing blobs for fast access?

2•Benedicht•1mo ago
I'm looking for a database to store blobs ranging from a few bytes to a few MBs. Presumably the number of blobs will be in the hundreds of millions. Each blob has well-defined metadata, perfectly fitting in SQL columns.

The blobs are collected over time and accessed in order of insertation but not necessarily from the beginning: multiple clients are 'reading' them starting from different start positions.

According to my research PostgreSQL looks good: - It can store blobs using TOAST - Handle partitioning, removing stalled data and some other neat stuff with the TimescaleDB extension.

The only requirement is to access the blobs as fast as possible. Of course it seems the limiting factor will be disk (and network) latency, but on top of these the DB should add only a fraction of overhead.

Currently i'm storing the blobs in memory and it's very good for latency, but very limiting and prevents adding new features.

I'm very curious whether there's any other option that i missed.

Comments

toomuchtodo•1mo ago
https://news.ycombinator.com/item?id=37325379 might be a useful thread for you inquiry.
Benedicht•1mo ago
Thanks, i'm reading it right now!

"Compiled" Specs

https://deepclause.substack.com/p/compiled-specs
1•schmuhblaster•16s ago•0 comments

The Next Big Language (2007) by Steve Yegge

https://steve-yegge.blogspot.com/2007/02/next-big-language.html?2026
1•cryptoz•1m ago•0 comments

Open-Weight Models Are Getting Serious: GLM 4.7 vs. MiniMax M2.1

https://blog.kilo.ai/p/open-weight-models-are-getting-serious
3•ms7892•11m ago•0 comments

Using AI for Code Reviews: What Works, What Doesn't, and Why

https://entelligence.ai/blogs/entelligence-ai-in-cli
3•Arindam1729•11m ago•0 comments

Show HN: Solnix – an early-stage experimental programming language

https://www.solnix-lang.org/
2•maheshbhatiya•11m ago•0 comments

DoNotNotify is now Open Source

https://donotnotify.com/opensource.html
4•awaaz•13m ago•1 comments

The British Empire's Brothels

https://www.historytoday.com/archive/feature/british-empires-brothels
2•pepys•13m ago•0 comments

What rare disease AI teaches us about longitudinal health

https://myaether.live/blog/what-rare-disease-ai-teaches-us-about-longitudinal-health
2•takmak007•18m ago•0 comments

The Brand Savior Complex and the New Age of Self Censorship

https://thesocialjuice.substack.com/p/the-brand-savior-complex-and-the
2•jaskaransainiz•20m ago•0 comments

Show HN: A Prompting Framework for Non-Vibe-Coders

https://github.com/No3371/projex
2•3371•21m ago•0 comments

Kilroy is a local-first "software factory" CLI

https://github.com/danshapiro/kilroy
2•ukuina•31m ago•0 comments

Mathscapes – Jan 2026 [pdf]

https://momath.org/wp-content/uploads/2026/02/1.-Mathscapes-January-2026-with-Solution.pdf
1•vismit2000•33m ago•0 comments

80386 Barrel Shifter

https://nand2mario.github.io/posts/2026/80386_barrel_shifter/
2•jamesbowman•34m ago•0 comments

Training Foundation Models Directly on Human Brain Data

https://arxiv.org/abs/2601.12053
1•helloplanets•34m ago•0 comments

Web Speech API on HN Threads

https://toulas.ch/projects/hn-readaloud/
1•etoulas•36m ago•0 comments

ArtisanForge: Learn Laravel through a gamified RPG adventure – 100% free

https://artisanforge.online/
2•grazulex•37m ago•1 comments

Your phone edits all your photos with AI – is it changing your view of reality?

https://www.bbc.com/future/article/20260203-the-ai-that-quietly-edits-all-of-your-photos
1•breve•38m ago•0 comments

DStack, a small Bash tool for managing Docker Compose projects

https://github.com/KyanJeuring/dstack
2•kppjeuring•39m ago•1 comments

Hop – Fast SSH connection manager with TUI dashboard

https://github.com/danmartuszewski/hop
1•danmartuszewski•39m ago•1 comments

Turning books to courses using AI

https://www.book2course.org/
5•syukursyakir•41m ago•2 comments

Top #1 AI Video Agent: Free All in One AI Video and Image Agent by Vidzoo AI

https://vidzoo.ai
2•Evan233•41m ago•1 comments

Ask HN: How would you design an LLM-unfriendly language?

1•sph•43m ago•0 comments

Show HN: MuxPod – A mobile tmux client for monitoring AI agents on the go

https://github.com/moezakura/mux-pod
1•moezakura•44m ago•0 comments

March for Billionaires

https://marchforbillionaires.org/
1•gscott•44m ago•0 comments

Turn Claude Code/OpenClaw into Your Local Lovart – AI Design MCP Server

https://github.com/jau123/MeiGen-Art
1•jaujaujau•44m ago•0 comments

An Nginx Engineer Took over AI's Benchmark Tool

https://github.com/hongzhidao/jsbench/tree/main/docs
1•zhidao9•46m ago•0 comments

Use fn-keys as fn-keys for chosen apps in OS X

https://www.balanci.ng/tools/karabiner-function-key-generator.html
1•thelollies•47m ago•1 comments

Sir/SIEN: A communication protocol for production outages

https://getsimul.com/blog/communicate-outage-to-ceo
1•pingananth•48m ago•1 comments

Show HN: OpenCode for Meetings

https://getscripta.app
2•whitemyrat•49m ago•1 comments

The chaos in the US is affecting open source software and its developers

https://www.osnews.com/story/144348/the-chaos-in-the-us-is-affecting-open-source-software-and-its...
1•pjmlp•50m ago•0 comments