frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: OpenAPI-batch: library for batch execution of LLM requests

https://github.com/sireto/openapi-batch
1•spannercode•2h ago
`openapi-batch` is a small Python library for running batches of LLM requests reliably.

It provides: - Async submission by default (you don’t block while the batch runs) - Durable state in SQLite (track progress, resume inspection) - Retries + partial failure handling - Native batch support where providers offer it (OpenAI, Gemini) - Provider adapters (no gateway required) - Callbacks for progress, per-item completion, and job completion

License: MIT