For other companies looking to build something similar, you can use Svix Stream[1] that offers a lot of these integrations out of the box, with more coming.
Also, such integration really ought respect & add to any trace propogation contexts passed in. Fingers crossed that works well here! Not explicitly mentioned so I'm nervous, but the product really needs trace propogation.
echelon•1mo ago
I wish this had another name.
I love the idea of fire and forget to a central AI aggregator. This one for LLMs, Fal for image and video. You don't need to juggle dozens of API keys or API integrations.
But these aren't open, despite it being in the name.
I want the ability to pull it all on-prem if I so choose.
I probably won't. But if I want to, I should be able to.
Don't use the name "Open" like this.
OpenAI, OpenRouter, OpenArt... Just stop already.
This isn't even fair source, let alone open. It's totally closed and opaque.
I'm half minded to make an "ActuallyOpenRouter".
(I know there are local routers, but I want hosted and managed with the ability to self-manage.)
embedding-shape•1mo ago
BLKNSLVR•1mo ago
abidlabs•1mo ago
omneity•1mo ago
Perhaps you’ll find it interesting.
0: https://github.com/omarkamali/borgllm
1: https://borgllm.com
coolspot•1mo ago
Some founders choose a prefix, then tend to use it everywhere :)
Fnoord•1mo ago
Had to look up what OpenSea is. NFT. So from one hype (and arguably scam) involving GPUs to the neXt one.
BizarroLand•1mo ago