Pay per pre-configured GPU hour or per token for open-source LLM inference?
1•yiro13•10m ago
Is it worth paying for a pre-configured GPU for open-source LLM inference instead of using a traditional pay-per-token provider? The biggest advantage seems to be having no usage limits