Ask HN: Can anyone run frontier AI models at usable speeds?
1•thesnarkitecht•42m ago
Eight months ago, EXO labs promised fast inference on local hardware. But it is not fast enough. It takes a minute and a half to get a response through hermes, using Kimi K2.6. Is there hardware that a dev can buy that can actually offset cloud bills?