> The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report.
So... it ranks THIRD?
(There were only two countries competing in said event)
I don't understand how DeepSeek can be so cheap with their cache pricing - ~0.003 usd / 1Mtok. 100x less than Kimi K3, or similar numbers against pretty much any other decently sized model to my knowledge. I've been using it whenever possible as even longer agent sessions cost few cents.
Assuming experts are uniformly distributed (I’m really not that familiar with the deep details there), that’s 2800/896*16 = 50 billion active parameters just for the active/expert part. Wild stuff, and I’m glad there’s at least some companies still publishing (and pushing, for open-weight models) total parameter count.
And: It sounds very believable that this would result in efficiency gains wrt. to compute necessary for “good”-quality inference. Does anyone know whether there currently even are any SOTA or near-SOTA models that are dense still?
Kind of like scaling your personal automobile to the weight of a semi, the semi is still going to be far more efficient in moving cargo, not that the semi will cost the same to operate as the original car.
Also very cool to see LatentMoE being picked up by more models (https://arxiv.org/abs/2601.18089)
> K3 pushes the boundary of end-to-end knowledge work. On the GDPval-AA v2 leaderboard, Kimi K3 scores 1687. The benchmark evaluates AI models on real-world tasks across 44 occupations and 9 major industries; Kimi K3 ranks behind only Claude Fable 5 Max and GPT-5.6 Sol Max, and ahead of Claude Opus 4.8 Max at 1600.
> On AA-Briefcase, Kimi K3 scores 1527, ranking second among all models — behind only Claude Fable 5 Max and ahead of GPT-5.6 Sol Max (1495). AA-Briefcase is a private agentic knowledge-work benchmark developed by Artificial Analysis to evaluate frontier agentic capability in long-horizon knowledge work.
Really good benchmark score it seems. Maybe another DeepSeek moment right here.
Pretty sure ranking “second” to two others means ranking third.
But it does take some days after model release before they collect enough data.
Combine with the price it will surely more costly than gpt 5.6.
This puts them on the top of the largest open models list:
Kimi K3 2.8T
DeepSeek-V4-Pro 1.6T (49B active)
Kimi K2.6 ~1T (32B active)
GLM-5.2 754B (40B active)
DeepSeek-V3.2 685B
Mistral Large 3 675B
That's one mighty large model! Moonshot is going to need the USD 500 million reportedly raised earlier this year to run this model.From all the models available to me I'm most happy with Kimi K2.7 (given the cost/performance).
At this pricing, I'll be surprised if it's open.
95 input, 16,658 output = 25 cents! https://www.llm-prices.com/#it=95&ot=16658&ic=3&oc=15 (13,241 of those were reasoning tokens.)
I think that's the most expensive pelican I've rendered through a Chinese model so far.
Important limits:
reasoning_effort currently supports only max; K3 always has thinking mode enabled.
max_completion_tokens defaults to 131072 and can be set up to 1048576.
temperature=1.0, top_p=0.95, n=1, presence_penalty=0, and frequency_penalty=0 are fixed; omit them from requests.
Return the complete assistant message unchanged in multi-turn conversations and tool calls.
Vision input does not support public image URLs. Use base64 or ms://<file-id>, and make content an array of objects.
Web search is being updated and is not recommended for production workflows in the near term.Is them pricing at Sonnet level actually give us any information at all at how big Sonnet is or is there too much opacity around inference margins?
I's not just matching against titles. Ironically, I have an agent running daily scans, reading the contents of the top 200 stories of the day. It auto screens high-confidence ones and I make judgement calls on like 10-20 of them per day.
So, it's impossible to know whether your filter is working on this story yet, either.
or
https://lobste.rs will probably have less AI
Click the link to view conversation with Kimi AI Assistant https://www.kimi.com/share/19f6b96d-fdd2-8589-8000-0000daada...
Look through the provider list for a company you are willing to do business with?
This is the same benchmark where Sonnet 5 outperforms Opus 4.8 max.
Like all model releases, the benchmarks aren't going to tell the whole story. All of the open weight models come with amazing benchmark results now. It's hard to believe anything other than that the benchmarks are leaking into (or intentionally included) into training data.
I just tried "hi" through the same OpenRouter API and the input token count for that was 86 - and for "hi there" the count was 87.
I think there's an 85 token hidden system prompt of some sort.
Tiberium•1h ago
- https://platform.kimi.ai/docs/guide/kimi-k3-quickstart
- https://platform.kimi.ai/docs/pricing/chat-k3
1M context, pricing is $3/$15 for 1M tokens (cache $0.3), which is extremely high for a Chinese open-weight model, but if it's truly competitive with most of the current frontier and is only behind Fable/Sol, the pricing is justified.
This is 1:1 pricing of Anthropic's Sonnet series (except Sonnet 5 which is currently on discount), and very close to 5.6 Terra pricing (Terra's input is $2.5).
One thing to consider, though: reasoning efficiency matters directly for how expensive a model actually is in real use. GPT's models are extremely reasoning efficient, and some Claude models like Fable at lower effort are as well. So if Sol spends 10K reasoning tokens to do something (at $30/1M) vs Kimi K3 that spends 50K reasoning tokens, Sol would win on cost effectiveness.
Deukhoofd•1h ago
dghlsakjg•58m ago
That said, Kimi is competing against GLM in my mind, and GLM 5.2 is less than 1/3 the price.
asenna•53m ago
leecommamichael•46m ago
smallerize•11m ago
martinald•52m ago
cyanydeez•50m ago
It'd need to be exceptionally smart and error free to ever make sense.
mmaunder•40m ago
schmorptron•34m ago
csomar•33m ago
easygenes•14m ago
Kimi also offers generous subscriptions. Subs aren’t going anywhere. Think of subs like running an insurance business. There might be some users you lose money on (ones who max out their weekly quota without fail), but they’re managed such that the average subscription turns a healthy profit. There’s never been subsidies in model serving, inference is just cheaper in terms of ops TCO than people assume, and API margins are very high.
nullbio•4m ago
0xbadcafebee•18m ago
It goes without saying, but if the open weights become as expensive as SOTA models, there's no point in using open weights. If nobody pays for open weights' development, the development dies out, and we're stuck with a US-controlled duopoly again. Which may be the biggest threat the world has seen from the US since nukes.
h14h•8m ago
I have high hopes on this topic, given token efficiency seemed to be the primary (only?) goal of the K2.7 Code release.
Excited to see the signals that come out of the big eval/benchmark sites.
nullbio•3m ago
sroerick•3m ago