frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Routing LLM traffic across inference providers with TCP-style congestion control

https://getunblocked.com/blog/adaptive-routing-inference-providers/
6•dennispi•44m ago