The first evaluation focuses on Text Memory across two tracks:
- Open-source Methods - Commercial Products
136 teams registered, and 69 representative memory frameworks completed the first evaluation.
Commercial Products — Text Memory:
1. MemoraX — 58.02 2. MemOS — 45.89 3. NTES-MEMORY-SMART — 44.21
The benchmark uses a common evaluation framework and a clearer system boundary:
Memory system: Add → Search Benchmark: Answer → Eval
The goal is to make memory-system results more comparable and reproducible.