frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I benchmarked my memory graph against Memora (0.831 vs. 0.801)

https://github.com/corbym/locomo-recordari
4•colourclash•2h ago
One of the very first problems I hit when I started to do agentic programming was the context problem, and that my agent always started again from the beginning. Being a bit naive and not really knowing what I was doing, I started off writing a mcp tool (because those are cool, right?) to solve the problem.

MD files are primitive, I thought. This memory stuff should really be a database, I thought. So I tried a couple of free memory tools, but nothing was really doing anything for my particular itch. I wanted the agent to remember what I needed, when I needed it, and with the minimal of effort. I wanted it to talk architecture with me, file everything away, and be able to remember it when I wanted to write the stories I needed for the software I was building, and faffing around with plans and files was a pain. I need a knowledge graph.

To be honest, the tools I built are not required if you are happy with an md file solution and your claude.md file. These tools aren't essential for you if that's the case. If you have progressed beyond that set up, carry on reading!

The first tool I wrote was memoryweb (https://github.com/corbym/memoryweb, MIT). In a series of conversations with Claude, we worked out the basics of the api from the agent's perspective and had dogfooded a pretty good tool in just a few weeks. I was using it at work almost constantly. When it went wrong, I asked the agent why, and used memoryweb to record the problem and fix it with a story. It was a very effective loop, and almost effortless.

What about a multi-tenanted version? I had loads of important discussions that my team might like to keep track of. Recordari exists mainly because:

* When two users write conflicting decisions to the same file, no one will notice

* Decisions can be superseded, but old text remains, and the agents can think the stale version is the right version

* After multiple sessions, no one can say why a decision was made or if its true

* Nothing gets recorded about when or who made the decision effectively

Recordari was specifically written to deal with those things. Memories are typed, and the agent can connect memories with typed edges that label nodes "contradicts" and "resolved" - exactly the type of information you'd need to know whether someone disagrees. The server flags semantically close memories that could conflict, agents then adjudicate the possible contradictions and resolves them. Every memory has an owner, so agents don't just overwrite human decisions.

Oh right, the numbers. Yeah.. so the numbers were run using Memora's (Microsoft Research, ICML 2026) open-source benchmark harness, unmodified. The same model, the same LoCoMo dataset and the same category-exclusion conventions. Recordari scored 0.831 end to end, the LLM judge accuracy vs Memora's published 0.801. All the results are public (MIT): https://github.com/corbym/locomo-recordari. The biggest surprise was the multi-session questions coming out at 0.869 vs the raw storage baseline of 0.760.

The harness itself runs against the prod API - exactly the MCP search and recall api that a real agent would use. Not a mocked backend, the real API, with a configuration of `top_k=30`, and a 1 hop edge expansion.

Recordari works with Claude, Claude Code, ChatGPT and pretty much any agent that can connect to MCP and reason.

If you want to run an agent against it to run the LoCoMo benchmark yourself, you can anon login at:

https://admin.recordar.io/start

Just remember to add the Full Skill from the Connect page, and then Connect your agent. Et Viola.

What I would like from HN: have you felt the same pain with a team as me? I'd also like to know if this isn't something you'd want.

Thanks everyone!

Matt

Comments

colourclash•2h ago
--

References and Further reading:

* https://github.com/corbym/memoryweb (MIT)

* Recordari commercial site: https://recordar.io/

* Recordari Admin (register/sign in page): https://admin.recordar.io/

* Recordari Anon login (team tier): https://admin.recordar.io/start

* Microsoft blog: https://www.microsoft.com/en-us/research/blog/memora-a-harmo...

* Memora github: https://github.com/microsoft/Memora

* Memora paper: https://arxiv.org/abs/2602.03315

Things to ask the agent when running the demo sandbox:

* Why was VTIR created?

* Describe what was next in the project and why?

* Why must Pascal fixtures be written before the Rust port?

* What is TurboSound and why does it need special handling?

* What is the current state of the project?

* Why does WASM file I/O work differently from native?

* What are the standing rules for the AY chip port?

Song to download and try on VTIR (https://corbym.github.io/vtir/ - live web demo)

* https://zxart.ee/tune/325740 (download pt3 original file)

colourclash•2h ago
Also I'm here and happy to answer anyone's questions about the methodology.

Show HN: Woxi - Open-source Mathematica / Wolfram Language reimplementation

https://woxi.ad-si.com
187•adius•6h ago•27 comments

Show HN: KidScreen, a finite YouTube shelf chosen by parents

https://kidscreen.app
25•Tintly•4h ago•22 comments

Show HN: /show-me: agent skill for compact visual representations

https://www.humanlayer.com/blog/show-me-skill
2•dhorthy•42m ago•0 comments

Show HN: Meteor shower, planet alignment, eclipse kit

https://lifesprites.com/share/0ACA25
8•jmtrevarton•3h ago•11 comments

Show HN: Seisin – a desktop app that turns your job search into analytics

https://getseisin.com
2•LudbaSH•1h ago•0 comments

Show HN: Smarter Shell History for Zsh

https://github.com/overflowy/zhist
7•overflowy•3h ago•2 comments

Show HN: What US households pay for electricity and gas, by state, since 2001

https://energy-maps.com
4•ebaumer•3h ago•1 comments

Show HN: Tamron Lens Utility Alternative on Linux

https://github.com/yikerman/tamron-lens-control
77•xiaoyu2006•5d ago•8 comments

Show HN: AI 3D pop-out videos for Reels, Shorts and ads

https://videopopy.com
3•wowinter15•4h ago•1 comments

Show HN: Lucky Dangle – a lucky charm for your Mac

https://luckydangle.app/
3•kar-ma•2h ago•0 comments

Show HN: OpenMicroKbd: $40 open source alternative to Codex Micro Keyboard

https://openmicrokbd.org/
2•greatony•2h ago•0 comments

Show HN: Line9 – A Mermaid rendering engine with its own layout

https://line9.ai/diagram
80•jumpalongjim•6d ago•27 comments

Show HN: Crabsoup, a Liquidsoap-inspired audio streaming engine in Rust.

https://crabsoup.vercel.app
2•sonyarianto•2h ago•0 comments

Show HN: Aakit – find every assumption your coding agent made, and which broke

https://github.com/abhixhek/aakit
5•Abhixhek•4h ago•0 comments

Show HN: Git-knife – Edit commit messages, authors, and dates like a spreadsheet

https://github.com/TheRealYT/git-knife
160•YonathanTesfaye•1d ago•100 comments

Show HN: Word-finder/anagram solver web app for mobile browsers

https://wanderinghorse.net/gaming/paperback/words.html
2•sgbeal•2h ago•0 comments

Show HN: Make your bio link worth clicking, even for agents

4•czeizel•2h ago•1 comments

Show HN: I benchmarked my memory graph against Memora (0.831 vs. 0.801)

https://github.com/corbym/locomo-recordari
4•colourclash•2h ago•2 comments

Show HN: My Python course for those who want to improve their skills

https://en.andros.dev/courses/ab396439/python/1/setting-up-the-environment/
4•andros•3h ago•2 comments

Show HN: Day to day windows reminder CLI (NPM)

https://www.npmjs.com/package/d2dwin-reminder-cli
3•jay__proto•3h ago•0 comments

Show HN: Talkform.org, Turn voice inputs into structured data using front end AI

https://talkform.org
4•pankajunk•3h ago•0 comments

Show HN: SHTM – 60 Seconds Random Chat

https://shtm.vercel.app/
3•Emirhan123•3h ago•0 comments

Show HN: iPhone app takes simultaneous images from 2 lenses, fuses into 1 photo

https://photosynthesis.camera
317•sajomes•3d ago•293 comments

Show HN: Aileaks – scan repos for leaked LLM reasoning-trace secrets

https://github.com/sarthakuwar/aileaks
3•sarthakkuwar1•3h ago•1 comments

Show HN: Rekall – an Ableton Live project management companion application

https://rekall.machinelies.eu
5•iamsaitam•3h ago•0 comments

Show HN: Write.md – A free, open-source, themeable Markdown editor for macOS

https://writemd.app/
99•danielbilekq•1d ago•76 comments

Show HN: Insect species in 3D, generated from code (no model files)

https://insect-world.pages.dev/en/
3•XR843•4h ago•0 comments

Show HN: MintPDF – HTML/Markdown to PDF API with an MCP Server

https://mintpdf.dev
3•Stackedboost•4h ago•0 comments

Show HN: Eigshow Interactive Web App

https://eigshow-app.web.app/
3•cecinuga•4h ago•0 comments

Show HN: Hallucinote, integrating Ableton and Claude Code

https://github.com/brookstalley/hallucinote
3•brookst•4h ago•0 comments