frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Hosting SQLite Databases on GitHub Pages (2021)

https://phiresky.github.io/blog/2021/hosting-sqlite-databases-on-github-pages/
68•WA9ACE•13h ago

Comments

pspeter3•12h ago
I wonder if the author would use DuckDB WASM now?
ngc6677•10h ago
is it doing HTTP range request, to not download an entire db?
mrtimo•10h ago
I'm using DuckDB WASM on github pages. This will take about 10 seconds to load [1] and shows business trends in my county (Spokane County). This site is built using data-explorer [2] which uses many other open-source projects including malloy and malloy-explorer. One cool thing... if you use the UI to make a query on the data - you can share the URL with someone and they will see the same result / query (it's all embedded in the URL).

[1] - https://mrtimo.github.io/spokane-co-biz/#/model/businesses/e... [2] - https://github.com/aszenz/data-explorer

westurner•5h ago
From "Show HN: TeaTime – distributed book library powered by SQLite, IPFS and GitHub" https://news.ycombinator.com/item?id=42264274 :

>> phiresky/sql.js-httpvfs: https://github.com/phiresky/sql.js-httpvfs

>> mmomtchev/sqlite-wasm-http: https://github.com/mmomtchev/sqlite-wasm-http

>> This project is inspired from @phiresky/sql.js-httpvfs but uses the new official SQLite WASM distribution

duckdb/duckdb-wasm: https://github.com/duckdb/duckdb-wasm

westurner•5h ago
"PSA: SQLite WAL checksums fail silently and may lose data" so that's probably not how to sync sqlite; https://news.ycombinator.com/item?id=44672902

electric-sql/electric: https://github.com/electric-sql/electric :

> Specifically, Electric is a read-path sync engine for Postgres. It syncs data out of Postgres into ... anything you like. The core sync protocol is based on a low-level HTTP API. This integrates with CDNs for highly-scalable data delivery.

electric-sql/pglite: https://github.com/electric-sql/pglite :

> Embeddable Postgres with real-time, reactive bindings.

"Using Postgres for Everything" https://news.ycombinator.com/item?id=40420474

crtasm•12h ago
(2021)

>(or IPFS or any static file hoster)

misthop•12h ago
It would be a it more compelling if every example, at least for me, didn't return `[error: NetworkError: A network error occurred.]`
cwmma•12h ago
I'm assuming your using firefox, if so it's this bug[1] that basically prevents range requests from working. Basically firefox says it will accept gziped data even though it's a range request and github pages dudifly sends back an unreadable slice of a gziped file.

1. https://bugzilla.mozilla.org/show_bug.cgi?id=1874840

smithcoin•12h ago
It doesn't work for me on safari either.
cwmma•11h ago
works fine on safari desktop for me
Groxx•10h ago
huh. is this due to ambiguity in whether you want gzipped content vs gzipped transport (of arbitrary content), and/or which range the bytes are requesting? I can see both being useful, but I don't know what headers are available for these intentions...
cwmma•9h ago
my understanding is that technically only gzipped content is supported, not gzipped transport of arbitrary content. Due to ambiguity around the word 'append' [1] in the spec, firefox adds 'identity' (aka don't compress) to the end of the list of compressions supported while most other browsers replace the list with 'identity'. Also it should be noted that this is not a user configurable header so you can't actually try to override it.

There is a second layer to the bug in that github pages should almost certainly not be sending back slices of compressed files even if gzip is listed before identity and some change to something in the github stack probably exposed the bug that was there in firefox all along.

I literally just stumbled on this last week while doing a side project that involved browser range requests so this is fresh in my head.

1. it comes down to whether it was meant that 'Accept-Encoding:identity' should be appended to the list of header values possibly overwriting the one that already was there or if 'identity' should be appended to the list of values already in the 'Accept-Encoding' header. Firefox does the latter, everyone else does the former.

ngc6677•10h ago
this exact same example used to work in firefox a few years back, i guess some change introduced this bug in between
seligman99•9h ago
Indeed, I lost the history in a shuffle, but a similar use case broke in some Firefox update, and it's the exact reason behind this comment:

https://github.com/seligman/podcast_to_text/blob/master/sear...

In my case, loading the entire file is loading a tiny bit more data, so this fallback doesn't hurt, but it's still annoying, and broke any hope I had of doing something more clever with the dataset.

cwmma•9h ago
The actual regression might be with githup pages where firefox was sending the same ambiguous headers the whole time but something in github's stack started interpreting them differently.
graemep•11h ago
I get "Error connecting to database: RuntimeError: abort(Error: server uses gzip or doesn't have length). Build with -s ASSERTIONS=1 for more info" from the sposorship stats site lined toand the same as you for the demo.

its interesting, but it is not robust and I very much doubt it will have the claimed benefit for lasting without further work. At the very least its more work and requires cross browser testing.

It seems a lot of effort just to avoid paying a small amount a month for a VPS. Its free and " I forget about the backend and stop paying for whatever VPS it was on" stops being a problem (although running all the little things you have on one VPS would also simplify that).

zX41ZdbW•11h ago
It's old news, but you can even host ClickHouse databases on GitHub pages: https://github.com/ClickHouse/web-tables-demo
bomewish•6h ago
Where does the 600mb SQLite file live though? GitHub won’t host that. Lfs server?

Uv is the best thing to happen to the Python ecosystem in a decade

https://emily.space/posts/251023-uv
1332•todsacerdoti•9h ago•743 comments

Tell HN: Azure outage

688•tartieret•12h ago•652 comments

IRCd service (2024)

https://example.fi/blog/ircd.html
37•pabs3•2h ago•6 comments

Minecraft removing obfuscation in Java Edition

https://www.minecraft.net/en-us/article/removing-obfuscation-in-java-edition
621•SteveHawk27•12h ago•216 comments

How Ancient People Saw Themselves

https://worldhistory.substack.com/p/how-ancient-people-saw-themselves
23•crescit_eundo•3d ago•3 comments

China has added forest the size of Texas since 1990

https://e360.yale.edu/digest/china-new-forest-report
427•Brajeshwar•1d ago•318 comments

Raspberry Pi Pico Bit-Bangs 100 Mbit/S Ethernet

https://www.elektormagazine.com/news/rp2350-bit-bangs-100-mbit-ethernet
93•chaosprint•5h ago•24 comments

Dithering – Part 1

https://visualrambling.space/dithering-part-1/
256•Bogdanp•10h ago•58 comments

OS/2 Warp, PowerPC Edition (2011)

https://www.os2museum.com/wp/os2-history/os2-warp-powerpc-edition/
41•TMWNN•5h ago•20 comments

Hello-World iOS App in Assembly

https://gist.github.com/nicolas17/966a03ce49f949dd17b0123415ef2e31
21•pabs3•2h ago•4 comments

Kafka is Fast – I'll use Postgres

https://topicpartition.io/blog/postgres-pubsub-queue-benchmarks
333•enether•14h ago•253 comments

How the U.S. National Science Foundation Enabled Software-Defined Networking

https://cacm.acm.org/federal-funding-of-academic-research/how-the-u-s-national-science-foundation...
71•zdw•7h ago•18 comments

AOL to be sold to Bending Spoons for $1.5B

https://www.axios.com/2025/10/29/aol-bending-spoons-deal
210•jmsflknr•12h ago•183 comments

Tailscale Peer Relays

https://tailscale.com/blog/peer-relays-beta
278•seemaze•12h ago•79 comments

Board: New game console recognizes physical pieces, with an open SDK

https://board.fun/
163•nicoles•1d ago•69 comments

OpenAI’s promise to stay in California helped clear the path for its IPO

https://www.wsj.com/tech/ai/openais-promise-to-stay-in-california-helped-clear-the-path-for-its-i...
167•badprobe•11h ago•222 comments

GLP-1 therapeutics: Their emerging role in alcohol and substance use disorders

https://academic.oup.com/jes/article/9/11/bvaf141/8277723?login=false
172•PaulHoule•2d ago•77 comments

The Internet runs on free and open source software and so does the DNS

https://www.icann.org/en/blogs/details/the-internet-runs-on-free-and-open-source-softwareand-so-d...
122•ChrisArchitect•10h ago•8 comments

Keep Android Open

http://keepandroidopen.org/
2363•LorenDB•1d ago•750 comments

A century of reforestation helped keep the eastern US cool (2024)

https://news.agu.org/press-release/a-century-of-reforestation-helped-keep-the-eastern-us-cool/
101•softwaredoug•5h ago•12 comments

Crunchyroll is destroying its subtitles

https://daiz.moe/crunchyroll-is-destroying-its-subtitles-for-no-good-reason/
224•Daiz•5h ago•74 comments

Why imperfection could be key to Turing patterns in nature

https://arstechnica.com/science/2025/10/why-imperfection-could-be-key-to-turing-patterns-in-nature/
5•furcyd•2d ago•0 comments

More than DNS: Learnings from the 14 hour AWS outage

https://thundergolfer.com/blog/aws-us-east-1-outage-oct20
91•birdculture•2d ago•26 comments

How to Obsessively Tune WezTerm

https://rashil2000.me/blogs/tune-wezterm
83•todsacerdoti•9h ago•48 comments

Composer: Building a fast frontier model with RL

https://cursor.com/blog/composer
184•leerob•12h ago•137 comments

Extropic is building thermodynamic computing hardware

https://extropic.ai/
108•vyrotek•10h ago•78 comments

Eye prosthesis is the first to restore sight lost to macular degeneration

https://med.stanford.edu/news/all-news/2025/10/eye-prosthesis.html
199•gmays•1w ago•15 comments

One Year with Next.js App Router – Why We're Moving On

https://paperclover.net/blog/webdev/one-year-next-app-router
14•nnx•2h ago•11 comments

How blocks are chained in a blockchain

https://www.johndcook.com/blog/2025/10/27/blockchain/
57•tapanjk•2d ago•23 comments

Upwave (YC S12) is hiring software engineers

https://www.upwave.com/job/8228849002/
1•ckelly•11h ago