I found this is probably the simplest and realistic (no fluff) take on FinOps for LLMs.
https://leanroute.dev/blog/finops-for-llm-spend-three-axes-of-cost-variance
Comments
MoneyLovesSpeed•48m ago
the part about lower spend not always meaning better optimization is pretty important, sometimes you just had less traffic lol
leanroute_ai•39m ago
exactly, lost the user-base but kept thanking the code being more efficient lol
MoneyLovesSpeed•48m ago
leanroute_ai•39m ago