Most vector database benchmarks today focus on toy use cases: static data, pure ANN search, no filters, no writes.

That’s not how things work in production.

We built VectorDBBench to benchmark vector databases under real-world conditions. It’s open source and just hit v1.0.0.

What’s new in v1.0.0:

Label Filtering + vector search tests

Concurrent read/write under pressure

Customer dataset

Better webUI

It supports several popular vector DBs out of the box (Milvus, Weaviate, Qdrant, Chroma, etc.) and is easy to extend.

If you’re building anything with RAG, embeddings, or search infra, we’d love feedback.