The whole thing is ~3MB, written in Rust for performance and safety, runs in Docker, and handles 1000+ ops/sec. I've been running it in production for AI workflows and it's been rock solid.
The whole thing is ~3MB, written in Rust for performance and safety, runs in Docker, and handles 1000+ ops/sec. I've been running it in production for AI workflows and it's been rock solid.