So far, what we've used are hardcoded files or keeping the data in our DB. This won't hold when moving to prod. It also keeps us very limited when it comes to creating price comparisons across different models/providers.
indextkn came from that. Over the past 3 weeks, I've spent a lot of time understanding more about pricing, when prices usually change, discounts (flex, batch, based on X number of tokens, etc.)... and it's massive.
The current state is not where I want it to be. The goal is to cover all prices and modalities offered by all providers. But right now, we have:
1. Prices fetched every couple of minutes, served via API, MCP, or you can install our SKILL.
2. Webhooks per model + provider, so you get a notification when anything changes.
Most of the time went into the logic to get the prices right and the logic to validate them! We have different levels of confidence, and I'm particularly proud of how we're double-checking when a price seems off (a combination of programmatic logic + agentic workflow).
Happy to answer any questions, and I'd love to have more folks testing it than just myself at the moment. :)