Good like these small tools. I'd like to opt for more strategies too like doclings HierarchicalChunker.
messkan•2mo ago
Thanks, glad you like the tool! That's exactly the plan.
The goal for v0.1 was to build the evaluation harness first (the scoring part). Now that it's in place, adding more strategies like HierarchicalChunker to the 'test bench' is the perfect next step.
I've added it to the roadmap!
hhthrowaway1230•2mo ago
A good thing is to incorporate some old school observability and benchmarking, MLFLOW has been around for some time. You could push some some parameters to that to track your scores, and you could use Meta's AX optimisation framework to finetuning the settings (hyperparameters)
hhthrowaway1230•2mo ago
messkan•2mo ago
hhthrowaway1230•2mo ago