frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Playing GTA VI with a brain computer interface

https://twitter.com/neuralink/status/2123890949029818800
1•houqp•2m ago•0 comments

What is alternative grading? These TMU professors share how it works

https://www.ctvnews.ca/toronto/article/what-is-alternative-grading-these-tmu-professors-share-how...
1•amichail•6m ago•0 comments

The Future of Programming (2013)

https://worrydream.com/dbx/
1•zenincognito•6m ago•0 comments

Advent of Code 2026 starts in 10 days

https://www.reddit.com/r/adventofcode/comments/1xi8ltn/every_december_since_2015_ive_created_a_bu...
1•vismit2000•7m ago•0 comments

Vit B12-based air electrode for high-performance rechargeable zinc–air batteries

https://pubs.rsc.org/ta/article/14/50/34201/1280936/A-vitamin-B12-based-air-electrode-for-high
1•bookofjoe•7m ago•0 comments

Thenflation: A real life price guess game over the years

https://thenflation.com/
1•mvennekool•7m ago•1 comments

JEDEC Previews DDR6 Memory Standard: 2.35x More Bandwidth, 44% Narrower DIMMs

https://www.servethehome.com/jedec-previews-ddr6-memory-standard-2-35x-more-bandwidth-44-narrower...
1•ksec•7m ago•0 comments

MySQL Development as It Happens, Part 2 – Vector Indexes

https://blogs.oracle.com/mysql/mysql-development-as-it-happens-part-2-vector-indexes
1•ksec•8m ago•0 comments

Odin November 2026 Newsletter

https://odin-lang.org/news/newsletter-2026-11/
1•ksec•8m ago•0 comments

Qwen3.8 27B Just Became a Coding Monster (DaisyRose)

https://www.youtube.com/watch?v=bwsSnLM3YFI
1•lroe•9m ago•0 comments

Battery storage in Great Britain: how a grid battery makes money

https://a115.co.uk/battery-storage-revenues/
1•a115ltd•11m ago•0 comments

Branchi – Open-Source Git Client for Windows and Linux (Rust and Flutter)

https://github.com/mbpcoder/Branchi
1•mbpcoder•13m ago•0 comments

Armiger – a local ONNX torrent classifier for Bitmagnet and Rats Search

https://github.com/spencernorton/armiger
1•bilegeek•17m ago•0 comments

Ask HN: Best books you've read this year (2026)?

1•learner_yearner•19m ago•0 comments

Free System Design Course (Visual Learners)

https://systems-design.aiengineer.co/
3•owlewis•20m ago•0 comments

'Positive review only': Researchers hide AI prompts in papers Asia

https://asia.nikkei.com/business/technology/artificial-intelligence/positive-review-only-research...
1•colinprince•23m ago•0 comments

Apollo, Goldman lead $44B SpaceX GPU debt financing

https://www.reuters.com/business/media-telecom/apollo-goldman-lead-44-billion-spacex-gpu-debt-fin...
2•jeffufl•24m ago•0 comments

"Everything app" vs. "Context layer"

https://twitter.com/mdubakov/status/2124051223921799278
2•tablet•25m ago•0 comments

Show HN: rumblex – word timestamps and subtitles from Rumble-2-Flash's CTC head

https://github.com/EdwardGlockner/rumblex
1•edwardglockner•29m ago•0 comments

Fight over fossil fuels leaves COP31 climate talks in deadlock

https://www.bbc.com/news/articles/c6ly5w40eg07o
2•blondie9x•31m ago•0 comments

Wielding the written word: How to pitch and publish science prose

https://physicstoday.aip.org/features/wielding-the-written-word-how-to-pitch-and-publish-science-...
2•colinprince•34m ago•0 comments

What do Deutsche Bank leaks reveal about Trump, Epstein and Russia?

https://www.aljazeera.com/news/2026/11/18/what-do-deutsche-bank-leaks-reveal-about-trump-epstein-...
5•enoint•35m ago•0 comments

Show HN: agent-mcts – Monte Carlo tree search on top of Claude Code

https://github.com/natsu0529/agent-mcts
3•natsu529•37m ago•0 comments

Show HN: Accounting built like Git, with files in your own storage

https://github.com/spooky6G/bobalice_books
1•oskar77•37m ago•0 comments

The Machine in the Back of the Book

https://levships.com/books/the-machine-in-the-back-of-the-book/
1•AlexeyBrin•38m ago•0 comments

Inkling-2-Mini-GGUF

https://huggingface.co/unsloth/Inkling-2-Mini-GGUF
1•doener•38m ago•0 comments

Show HN: My encrypted agent OS gives OpenClaw and Hermes an Unreal Engine avatar

https://github.com/oscova/oscova-agents
1•driftvoy•39m ago•0 comments

The Kafkaian Agent Swarm That Locked Out My Cofounder

https://simeoncampos.substack.com/p/on-the-kafkaian-agent-swarm-that
1•fdb•40m ago•0 comments

Stripe evals: Measuring real-world coding agent performance

https://stripe.dev/blog/stripe-integration-evals-methodology
3•torutofu•40m ago•0 comments

Show HN: I made a PS1 style racing game

https://outpostracer.com
2•shash7•42m ago•0 comments
Open in hackernews

"A milion token context" Big AI says. But the model is accurate for 2-4K tokens

https://unagent.eu/2025/04/22/misleading-promises-of-long-context-llm/
2•kzawpl•1y ago

Comments

kzawpl•1y ago
Over last two years there were claims of better long context capabilities for LLM, but that is often tested on exact text search. New benchmark called NoLiMa shows that long context capability of LLM is still poor, if you want LLM to perform some abstraction and reasoning.
vessenes•1y ago
Meh. NoLima is helpful, in that it shows what we all "feel" working with models -- there's a marked dropoff in accuracy and intelligence as we get past 4-32k of context, depending on the model.

But, it seems unreasonable to be super worried about this -- a year or two ago, models couldn't easily find needles in haystacks of long context. As training and test strategies delivered trainable content, this became a thing that could be done perfectly across millions of tokens of context. There has not been a good way to incentivize models to do anything more but remember locations yet.

We are (mostly) paying the full costs of attending to the entire context in current architectures, and it seems pretty reasonable that we will therefore be able to train those architectures to more fully attend across context if we get the right training data into (ideally) an RL loop.

NoLima is an okay test, but I think the most recent OpenAI tests are significantly better and quite interesting; OpenAI-MRCR and Graphwalks are both super smart ideas about how to programmatically generate data that is easy to evaluate and forces better cross context attention.

From their 4.1 announcement: Graphwalks fills the context window with a directed graph composed of hexadecimal hashes, and then asks the model to perform a breadth-first search (BFS) starting from a random node in the graph. We then ask it to return all nodes at a certain depth.

MRCR asks for direct quotes at semantically identified locations in the text, e.g. poems about tapirs, bears and ballerinas, as well as stories about tapirs, bears and ballerinas are generated, perhaps fifty each. The system is asked "give me the third poem about tapirs". This requires counting, conceptual attention, and also distinguishing between stories and poems.

They only test their own models on MRCR for the benchmark graph, but it's still worth reviewing: the accuracy curves are super interesting. https://openai.com/index/gpt-4-1/