> The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report.
So... it ranks THIRD?
(There were only two countries competing in said event)
I don't understand how DeepSeek can be so cheap with their cache pricing - ~0.003 usd / 1Mtok. 100x less than Kimi K3, or similar numbers against pretty much any other decently sized model to my knowledge. I've been using it whenever possible as even longer agent sessions cost few cents.
Assuming experts are uniformly distributed (I’m really not that familiar with the deep details there), that’s 2800/896*16 = 50 billion active parameters just for the active/expert part. Wild stuff, and I’m glad there’s at least some companies still publishing (and pushing, for open-weight models) total parameter count.
And: It sounds very believable that this would result in efficiency gains wrt. to compute necessary for “good”-quality inference. Does anyone know whether there currently even are any SOTA or near-SOTA models that are dense still?
Kind of like scaling your personal automobile to the weight of a semi, the semi is still going to be far more efficient in moving cargo, not that the semi will cost the same to operate as the original car.
Also very cool to see LatentMoE being picked up by more models (https://arxiv.org/abs/2601.18089)
> K3 pushes the boundary of end-to-end knowledge work. On the GDPval-AA v2 leaderboard, Kimi K3 scores 1687. The benchmark evaluates AI models on real-world tasks across 44 occupations and 9 major industries; Kimi K3 ranks behind only Claude Fable 5 Max and GPT-5.6 Sol Max, and ahead of Claude Opus 4.8 Max at 1600.
> On AA-Briefcase, Kimi K3 scores 1527, ranking second among all models — behind only Claude Fable 5 Max and ahead of GPT-5.6 Sol Max (1495). AA-Briefcase is a private agentic knowledge-work benchmark developed by Artificial Analysis to evaluate frontier agentic capability in long-horizon knowledge work.
Really good benchmark score it seems. Maybe another DeepSeek moment right here.
Pretty sure ranking “second” to two others means ranking third.
But it does take some days after model release before they collect enough data.
Combine with the price it will surely more costly than gpt 5.6.
This puts them on the top of the largest open models list:
Kimi K3 2.8T
DeepSeek-V4-Pro 1.6T (49B active)
Kimi K2.6 ~1T (32B active)
GLM-5.2 754B (40B active)
DeepSeek-V3.2 685B
Mistral Large 3 675B
That's one mighty large model! Moonshot is going to need the USD 500 million reportedly raised earlier this year to run this model.Edit: OpenRouter still describes it as an open-weight model: https://openrouter.ai/moonshotai/kimi-k3
Guess we'll see!
From all the models available to me I'm most happy with Kimi K2.7 (given the cost/performance).
At this pricing, I'll be surprised if it's open.
95 input, 16,658 output = 25 cents! https://www.llm-prices.com/#it=95&ot=16658&ic=3&oc=15 (13,241 of those were reasoning tokens.)
I think that's the most expensive pelican I've rendered through a Chinese model so far.
Important limits:
reasoning_effort currently supports only max; K3 always has thinking mode enabled.
max_completion_tokens defaults to 131072 and can be set up to 1048576.
temperature=1.0, top_p=0.95, n=1, presence_penalty=0, and frequency_penalty=0 are fixed; omit them from requests.
Return the complete assistant message unchanged in multi-turn conversations and tool calls.
Vision input does not support public image URLs. Use base64 or ms://<file-id>, and make content an array of objects.
Web search is being updated and is not recommended for production workflows in the near term.Is them pricing at Sonnet level actually give us any information at all at how big Sonnet is or is there too much opacity around inference margins?
I's not just matching against titles. Ironically, I have an agent running daily scans, reading the contents of the top 200 stories of the day. It auto screens high-confidence ones and I make judgement calls on like 10-20 of them per day.
So, it's impossible to know whether your filter is working on this story yet, either.
or
https://lobste.rs will probably have less AI
Click the link to view conversation with Kimi AI Assistant https://www.kimi.com/share/19f6b96d-fdd2-8589-8000-0000daada...
Look through the provider list for a company you are willing to do business with?
This is the same benchmark where Sonnet 5 outperforms Opus 4.8 max.
Like all model releases, the benchmarks aren't going to tell the whole story. All of the open weight models come with amazing benchmark results now. It's hard to believe anything other than that the benchmarks are leaking into (or intentionally included) into training data.
I just tried "hi" through the same OpenRouter API and the input token count for that was 86 - and for "hi there" the count was 87.
I think there's an 85 token hidden system prompt of some sort.
Tiberium•1h ago
- https://platform.kimi.ai/docs/guide/kimi-k3-quickstart
- https://platform.kimi.ai/docs/pricing/chat-k3
1M context, pricing is $3/$15 for 1M tokens (cache $0.3), which is extremely high for a Chinese open-weight model, but if it's truly competitive with most of the current frontier and is only behind Fable/Sol, the pricing is justified.
This is 1:1 pricing of Anthropic's Sonnet series (except Sonnet 5 which is currently on discount), and very close to 5.6 Terra pricing (Terra's input is $2.5).
One thing to consider, though: reasoning efficiency matters directly for how expensive a model actually is in real use. GPT's models are extremely reasoning efficient, and some Claude models like Fable at lower effort are as well. So if Sol spends 10K reasoning tokens to do something (at $30/1M) vs Kimi K3 that spends 50K reasoning tokens, Sol would win on cost effectiveness.
Deukhoofd•1h ago
dghlsakjg•1h ago
That said, Kimi is competing against GLM in my mind, and GLM 5.2 is less than 1/3 the price.
asenna•1h ago
leecommamichael•1h ago
smallerize•25m ago
leecommamichael•5m ago
cmrdporcupine•13m ago
Neuralwatt was cheap (but slow) but they cranked their price.
Ollama monthly sub is speedy but doesn't offer a lot of quota.
Right now unless you're paying by the token, there's no cost based reason to use the open weight models for daily coding work because the monthly coding plans from Anthropic and OpenAI are a better deal.
martinald•1h ago
cyanydeez•1h ago
It'd need to be exceptionally smart and error free to ever make sense.
mmaunder•53m ago
schmorptron•48m ago
csomar•46m ago
easygenes•28m ago
Kimi also offers generous subscriptions. Subs aren’t going anywhere. Think of subs like running an insurance business. There might be some users you lose money on (ones who max out their weekly quota without fail), but they’re managed such that the average subscription turns a healthy profit. There’s never been subsidies in model serving, inference is just cheaper in terms of ops TCO than people assume, and API margins are very high.
nullbio•17m ago
0xbadcafebee•32m ago
It goes without saying, but if the open weights become as expensive as SOTA models, there's no point in using open weights. If nobody pays for open weights' development, the development dies out, and we're stuck with a US-controlled duopoly again. Which may be the biggest threat the world has seen from the US since nukes.
h14h•21m ago
I have high hopes on this topic, given token efficiency seemed to be the primary (only?) goal of the K2.7 Code release.
Excited to see the signals that come out of the big eval/benchmark sites.
nullbio•16m ago
cmrdporcupine•14m ago
sroerick•16m ago