As it's minor change did not expect much, but having a higher context helps for sure. I will own the errors for passing bigger context.
i used luna 5.6 as the ranker/filter to remove useless items from upstream rag(mixing embedding, regex etc) and it did a good job but took 5-10 seconds each time. now less than 1 second and no observable precision loss. hope it helps
I like that they're being up front about this. Benchmarks are a metric that can be gamed. They give you an approximate estimate of where things land, but you really need to test for your use case.
Very refreshing.
benaduggan•26m ago
aryabakh•24m ago
ranger_danger•16m ago
benaduggan•7m ago
I guess their cheeky "Warning: AI Benchmarks, don't trust them" is their way out of that one.