Model vs model
Claude Sonnet 5 vs Kimi K3
Claude Sonnet 5 and Kimi K3 are both in llmwise. What each gets on every plan, what it reads, how it's served and what happens when its provider fails, from the catalog and the code that runs them.
Model prices and specs checked against OpenRouter's Claude Sonnet 5 page, OpenRouter's Kimi K3 page. Updated .
Short answer
They cost the same in llmwise: up to 125 messages a month on Pro on either. Otherwise, only Claude Sonnet 5 reads a PDF as the whole file. In our test runs, Claude Sonnet 5 passed 46 of the 50 prompts both answered and Kimi K3 46; 4 prompts split them, most on data analysis (4 to 5).
Claude Sonnet 5 vs Kimi K3, prompt by prompt
Every prompt Claude Sonnet 5 and Kimi K3 both answered, compared directly, their biggest differences first. One run each, through OpenRouter: a wait depends on the provider and the load that day, so a lead under 10% counts as close.
Of the 50 prompts both answered, both passed 44, only Claude Sonnet 5 passed 2, only Kimi K3 passed 2, and neither passed 2. Claude Sonnet 5 answered sooner on 23 of the 50 and Kimi K3 on 22; the rest were within 10% of each other. The 50 replies cost $0.2030 on Claude Sonnet 5 and $0.1938 on Kimi K3: about the same for both.
The 4 prompts only one of Claude Sonnet 5 and Kimi K3 passed
Announce a second bakery shop on LinkedIn (writing): Kimi K3 passed and Claude Sonnet 5 didn't. Claude Sonnet 5: Graded 3.5 of 5 on average (lowest 3). Kimi K3: Graded 4.5 of 5 on average (lowest 4).
A product announcement with five rules (writing): Claude Sonnet 5 passed and Kimi K3 didn't. Claude Sonnet 5: Graded 4.3 of 5 on average (lowest 4). Kimi K3: Graded 4.3 of 5 on average (lowest 4); but doesn't end with a question.
Correlation between ad spend and sign-ups (data analysis): Kimi K3 passed and Claude Sonnet 5 didn't. Claude Sonnet 5: Final answer 0.99; expected 0.97. Kimi K3: Final answer 0.97: right.
A refund request outside the window (customer support): Claude Sonnet 5 passed and Kimi K3 didn't. Claude Sonnet 5: Graded 4.7 of 5 on average (lowest 4). Kimi K3: Graded 4.0 of 5 on average (lowest 2).
Job by job, the widest gaps first
Customer support: Claude Sonnet 5 passed 5 of 5 and Kimi K3 4 of 5. Claude Sonnet 5 answered 1.2× sooner at the median, 3.5 s against 4.3 s. Claude Sonnet 5 cost 1.3× less, $0.0182 against $0.0228 for the 5 replies. Claude Sonnet 5's replies ran 40% longer, in tokens of reply, thinking not counted.
Data analysis: Claude Sonnet 5 passed 4 of 5 and Kimi K3 5 of 5. Kimi K3 answered 1.5× sooner at the median, 5.3 s against 3.5 s. They cost about the same, $0.0344 against $0.0339 for the 5 replies. Kimi K3's replies ran 14% longer, in tokens of reply, thinking not counted.
Coding: Claude Sonnet 5 passed 5 of 5 and Kimi K3 5 of 5. Claude Sonnet 5 answered 1.5× sooner at the median, 2.7 s against 4.1 s. Kimi K3 cost 1.6× less, $0.0508 against $0.0316 for the 5 replies. Claude Sonnet 5's replies ran 50% longer, in tokens of reply, thinking not counted.
RAG and answering from documents: Claude Sonnet 5 passed 5 of 5 and Kimi K3 5 of 5. Claude Sonnet 5 answered 1.5× sooner at the median, 1.8 s against 2.6 s. Kimi K3 cost 1.5× less, $0.0109 against $0.0073 for the 5 replies. Their replies ran to about the same length.
Summarization: Claude Sonnet 5 passed 3 of 5 and Kimi K3 3 of 5. Claude Sonnet 5 answered 1.2× sooner at the median, 2.7 s against 3.4 s. Claude Sonnet 5 cost 1.2× less, $0.0140 against $0.0172 for the 5 replies. Claude Sonnet 5's replies ran 29% longer, in tokens of reply, thinking not counted.
SQL: Claude Sonnet 5 passed 5 of 5 and Kimi K3 5 of 5. Kimi K3 answered 1.4× sooner at the median, 2.2 s against 1.6 s. Kimi K3 cost 1.2× less, $0.0142 against $0.0118 for the 5 replies. Claude Sonnet 5's replies ran 46% longer, in tokens of reply, thinking not counted.
Translation: Claude Sonnet 5 passed 5 of 5 and Kimi K3 5 of 5. Claude Sonnet 5 answered 1.9× sooner at the median, 2.8 s against 5.2 s. Claude Sonnet 5 cost 1.2× less, $0.0149 against $0.0179 for the 5 replies. Kimi K3's replies ran 19% longer, in tokens of reply, thinking not counted.
Math: Claude Sonnet 5 passed 5 of 5 and Kimi K3 5 of 5. Claude Sonnet 5 answered 1.4× sooner at the median, 3.9 s against 5.4 s. Claude Sonnet 5 cost 1.1× less, $0.0165 against $0.0187 for the 5 replies. Claude Sonnet 5's replies ran 66% longer, in tokens of reply, thinking not counted.
Writing: Claude Sonnet 5 passed 4 of 5 and Kimi K3 4 of 5. Kimi K3 answered 1.5× sooner at the median, 4.5 s against 3.0 s. Claude Sonnet 5 cost 1.1× less, $0.0171 against $0.0192 for the 5 replies. Claude Sonnet 5's replies ran 56% longer, in tokens of reply, thinking not counted.
Agents and tool use: Claude Sonnet 5 passed 5 of 5 and Kimi K3 5 of 5. Their median waits were close, 2.0 s against 2.0 s. Claude Sonnet 5 cost 1.1× less, $0.0121 against $0.0135 for the 5 replies. Claude Sonnet 5's replies ran 19% longer, in tokens of reply, thinking not counted.
All 50 prompts: who passed, who answered sooner, who cost less
| Prompt | Result | Sooner | Cheaper |
|---|---|---|---|
| Turn a title into a URL slug | Both passed | Claude Sonnet 5, 1.1×took 2.3 s and 2.6 s | Claude Sonnet 5, 1.4×cost $0.0024 and $0.0035 |
| Parse a duration like “1h 30m” | Both passed | Claude Sonnet 5, 2.8×took 2.6 s and 7.1 s | Claude Sonnet 5, 1.7×cost $0.0036 and $0.0063 |
| Merge overlapping intervals | Both passed | Kimi K3, 1.3×took 2.7 s and 2.0 s | Closecost $0.0034 and $0.0036 |
| Evaluate an arithmetic expression, no eval | Both passed | Kimi K3, 1.7×took 16.9 s and 9.9 s | Kimi K3, 2.0×cost $0.0226 and $0.0113 |
| Parse CSV with quoted fields | Both passed | Kimi K3, 3.8×took 15.8 s and 4.1 s | Kimi K3, 2.7×cost $0.0187 and $0.0069 |
| Announce a second bakery shop on LinkedIn | Only Kimi K3 | Kimi K3, 1.2×took 4.6 s and 3.9 s | Claude Sonnet 5, 1.2×cost $0.0037 and $0.0046 |
| Rewrite corporate jargon in plain words | Both passed | Kimi K3, 1.4×took 2.7 s and 2.0 s | Claude Sonnet 5, 1.3×cost $0.0022 and $0.0030 |
| Decline a meeting and offer two times | Both passed | Closetook 2.8 s and 3.0 s | Claude Sonnet 5, 1.3×cost $0.0026 and $0.0034 |
| A product announcement with five rules | Only Claude Sonnet 5 | Kimi K3, 1.9×took 4.5 s and 2.3 s | Closecost $0.0035 and $0.0033 |
| Argue both sides of free buses | Both passed | Kimi K3, 1.8×took 6.6 s and 3.6 s | Closecost $0.0050 and $0.0049 |
| A discount, then sales tax | Both passed | Claude Sonnet 5, 2.6×took 1.9 s and 5.0 s | Claude Sonnet 5, 2.4×cost $0.0015 and $0.0037 |
| Pens at 3 for $4 | Both passed | Kimi K3, 1.2×took 6.3 s and 5.4 s | Kimi K3, 1.3×cost $0.0061 and $0.0046 |
| Compound interest over three years | Both passed | Claude Sonnet 5, 1.6×took 3.7 s and 5.9 s | Claude Sonnet 5, 2.1×cost $0.0021 and $0.0044 |
| Four-digit numbers whose digits sum to 9 | Both passed | Claude Sonnet 5, 1.3×took 4.5 s and 6.0 s | Kimi K3, 1.2×cost $0.0039 and $0.0032 |
| The highest of three dice is a 5 | Both passed | Kimi K3, 1.6×took 3.9 s and 2.4 s | Closecost $0.0028 and $0.0027 |
| An article in three bullets | Neither passed | Closetook 2.6 s and 2.8 s | Closecost $0.0027 and $0.0028 |
| An email thread in one sentence | Neither passed | Claude Sonnet 5, 2.8×took 2.3 s and 6.4 s | Claude Sonnet 5, 1.6×cost $0.0019 and $0.0030 |
| Decisions and action items from a meeting | Both passed | Claude Sonnet 5, 1.2×took 2.8 s and 3.4 s | Claude Sonnet 5, 1.3×cost $0.0033 and $0.0044 |
| A quarterly memo for the CEO | Both passed | Claude Sonnet 5, 5.3×took 3.0 s and 15.7 s | Claude Sonnet 5, 1.5×cost $0.0033 and $0.0049 |
| A study with a negative result | Both passed | Claude Sonnet 5, 1.2×took 2.7 s and 3.2 s | Kimi K3, 1.3×cost $0.0028 and $0.0021 |
| The region with the most revenue | Both passed | Kimi K3, 2.9×took 6.4 s and 2.2 s | Claude Sonnet 5, 1.2×cost $0.0041 and $0.0049 |
| Average order value in August | Both passed | Kimi K3, 1.5×took 3.9 s and 2.7 s | Claude Sonnet 5, 1.3×cost $0.0041 and $0.0054 |
| Revenue change from July to August | Both passed | Claude Sonnet 5, 1.2×took 5.3 s and 6.4 s | Closecost $0.0062 and $0.0064 |
| A median, filtered two ways | Both passed | Kimi K3, 1.4×took 4.9 s and 3.5 s | Claude Sonnet 5, 1.2×cost $0.0036 and $0.0042 |
| Correlation between ad spend and sign-ups | Only Kimi K3 | Claude Sonnet 5, 1.5×took 13.8 s and 20.2 s | Kimi K3, 1.3×cost $0.0165 and $0.0131 |
| A late order | Both passed | Kimi K3, 1.4×took 3.5 s and 2.5 s | Claude Sonnet 5, 1.3×cost $0.0036 and $0.0045 |
| A return inside the window | Both passed | Claude Sonnet 5, 1.5×took 2.9 s and 4.3 s | Closecost $0.0032 and $0.0033 |
| A frustrated customer | Both passed | Claude Sonnet 5, 1.3×took 4.4 s and 5.6 s | Claude Sonnet 5, 1.5×cost $0.0041 and $0.0063 |
| A refund request outside the window | Only Claude Sonnet 5 | Kimi K3, 1.2×took 3.2 s and 2.6 s | Claude Sonnet 5, 1.4×cost $0.0031 and $0.0045 |
| A message with a planted instruction | Both passed | Claude Sonnet 5, 2.5×took 4.6 s and 11.5 s | Closecost $0.0041 and $0.0041 |
| A delivery message into Spanish | Both passed | Closetook 2.7 s and 2.9 s | Closecost $0.0029 and $0.0031 |
| A product description into French | Both passed | Claude Sonnet 5, 2.1×took 2.5 s and 5.4 s | Claude Sonnet 5, 1.3×cost $0.0029 and $0.0037 |
| A meeting note into German | Both passed | Closetook 2.8 s and 3.0 s | Kimi K3, 1.9×cost $0.0027 and $0.0014 |
| Idioms into natural Japanese | Both passed | Claude Sonnet 5, 1.3×took 4.1 s and 5.2 s | Claude Sonnet 5, 1.9×cost $0.0028 and $0.0053 |
| A lease clause into Brazilian Portuguese | Both passed | Claude Sonnet 5, 2.7×took 3.8 s and 10.1 s | Claude Sonnet 5, 1.2×cost $0.0036 and $0.0044 |
| Customers in one country | Both passed | Kimi K3, 1.7×took 1.8 s and 1.1 s | Kimi K3, 1.1×cost $0.0020 and $0.0018 |
| Count orders by status | Both passed | Kimi K3, 1.3×took 2.0 s and 1.5 s | Kimi K3, 2.3×cost $0.0020 and $0.0009 |
| Revenue by category | Both passed | Kimi K3, 2.2×took 3.5 s and 1.6 s | Kimi K3, 1.6×cost $0.0031 and $0.0019 |
| Every customer, even those without orders | Both passed | Claude Sonnet 5, 1.2×took 2.2 s and 2.5 s | Closecost $0.0030 and $0.0031 |
| Monthly revenue with a running total | Both passed | Kimi K3, 1.2×took 3.0 s and 2.5 s | Closecost $0.0042 and $0.0042 |
| A fact from one section | Both passed | Claude Sonnet 5, 3.9×took 1.7 s and 6.5 s | Kimi K3, 1.9×cost $0.0019 and $0.0010 |
| Core hours and start times | Both passed | Kimi K3, 1.7×took 2.1 s and 1.2 s | Kimi K3, 2.0×cost $0.0022 and $0.0011 |
| Two sections in one answer | Both passed | Claude Sonnet 5, 1.5×took 1.8 s and 2.6 s | Kimi K3, 1.1×cost $0.0022 and $0.0020 |
| A later amendment changes the answer | Both passed | Claude Sonnet 5, 2.3×took 2.1 s and 4.8 s | Kimi K3, 1.2×cost $0.0026 and $0.0022 |
| A question the handbook doesn't answer | Both passed | Kimi K3, 2.0×took 1.8 s and 0.9 s | Kimi K3, 1.9×cost $0.0019 and $0.0010 |
| Pick the tool and work out the date | Both passed | Claude Sonnet 5, 2.2×took 1.7 s and 3.7 s | Claude Sonnet 5, 1.8×cost $0.0018 and $0.0032 |
| Convert a currency | Both passed | Claude Sonnet 5, 1.5×took 2.0 s and 2.9 s | Claude Sonnet 5, 1.4×cost $0.0018 and $0.0025 |
| Book a meeting from a sentence | Both passed | Kimi K3, 3.6×took 5.7 s and 1.6 s | Kimi K3, 1.2×cost $0.0037 and $0.0031 |
| Search, but don't book | Both passed | Closetook 1.9 s and 2.0 s | Claude Sonnet 5, 1.7×cost $0.0020 and $0.0034 |
| Two calls with a unit conversion | Both passed | Kimi K3, 2.2×took 3.8 s and 1.7 s | Kimi K3, 2.3×cost $0.0028 and $0.0012 |
Claude Sonnet 5 vs Kimi K3 in our test runs
Claude Sonnet 5 and Kimi K3 on the same prompts, job by job: how many replies passed their check.
Based on 100 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .
| Job | Claude Sonnet 5 | Kimi K3 |
|---|---|---|
| Coding | 5 of 5 | 5 of 5 |
| Writing | 4 of 5 | 4 of 5 |
| Math | 5 of 5 | 5 of 5 |
| Summarization | 3 of 5 | 3 of 5 |
| Data analysis | 4 of 5 | 5 of 5 |
| Customer support | 5 of 5 | 4 of 5 |
| Translation | 5 of 5 | 5 of 5 |
| SQL | 5 of 5 | 5 of 5 |
| RAG and answering from documents | 5 of 5 | 5 of 5 |
| Agents and tool use | 5 of 5 | 5 of 5 |
| All jobs | 46 of 50 · 1 message each · $0.0041 a reply | 46 of 50 · 1 message each · $0.0039 a reply |
The same prompts, sent to both through llmwise's own pipeline and checked the same way: five for each job. A bold count is the one that passed more. Messages: what each reply counted as on Pro. Cost: what OpenRouter charged us per reply, on average. Every prompt, and how it's scored.
Where they differed most, data analysis: both replies to a prompt only one of them passed.
A hard prompt: “Correlation between ad spend and sign-ups”, in full.
Claude Sonnet 5
Failed: Final answer 0.99; expected 0.97.
**Working:** n=8, mean(x)=768.75, mean(y)=54.25 Computed deviations and cross-products: - Σ(dx·dy) = 24428.125 - Σ(dx²) = 624687.5 - Σ(dy²) = 971.5 r = Σ(dx·dy) / √(Σdx² · Σdy²) = 24428.125 / √(624687.5 × 971.5) = 24428.125 / 24635.01 ≈ 0.9916 **Final answer: 0.99**
605 tokens in, 1,524 out (1,348 of them reasoning) · 13.8 s · $0.0165 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·
Kimi K3
Passed: Final answer 0.97: right.
## Working **Means:** x̄ = 6150/8 = 768.75, ȳ = 434/8 = 54.25 **Deviations and sums:** | week | x−x̄ | y−ȳ | (x−x̄)(y−ȳ) | (x−x̄)² | (y−ȳ)² | |---|---|---|---|---|---| | 1 | −268.75 | −12.25 | 3292.19 | 72226.56 | 150.06 | | 2 | 31.25 | 0.75 | 23.44 | 976.56 | 0.56 | | 3 | −118.75 | −5.25 | 623.44 | 14101.56 | 27.56 | | 4 | 431.25 | 16.75 | 7223.44 | 185976.56 | 280.56 | | 5 | 131.25 | 5.75 | 754.69 | 17226.56 | 33.06 | | 6 | −468.75 | −19.25 | 9023.44 | 219726.56 | 370.56 | | 7 | 331.25 | 9.75 | 3229.69 | 109726.56 | 95.06 | | 8 | −68.75 | 3.75 | −257.81 | 4726.56 | 14.06 | | **Σ** | | | **23912.50** | **624687.50** | **971.50** | **Compute r:** r = 23912.5 / √(624687.5 × 971.5) = 23912.5 / √(606,883,906.25) = 23912.5 / 24635.0 ≈ 0.9707 Rounded to 2 decimal places: 0.97 (a very strong positive correlation). Final answer: 0.97
537 tokens in, 1,418 out (964 of them reasoning) · 20.2 s · $0.0131 · 1 message on Pro · answered by moonshotai/kimi-k3 via Wafer ·
Claude Sonnet 5 and Kimi K3 on every plan
Whether the one-time free trial reaches each model, then each paid plan's messages on it.
| Plan | Price | Claude Sonnet 5 | Kimi K3 |
|---|---|---|---|
| Free | $0 | In the one-time trial of 5 messages | In the one-time trial of 5 messages |
| Pro | $20 a month | Up to 125 a month | Up to 125 a month |
| Max | $50 a month | Up to 400 a month | Up to 400 a month |
| Ultra | $100 a month | Up to 900 a month | Up to 900 a month |
| Studio | $200 a month | Up to 2,000 a month | Up to 2,000 a month |
Prices don't include tax, which is added where it applies and shown before you pay. A paid plan's month is one allowance shared by every model, so each monthly count is the most you get if all of it goes to that model. It renews each billing period; everyday models refill daily at 00:00 UTC. Long chats count more per reply. How pricing works.
Every limit is published. Paid plans also have a monthly fair-use limit on AI cost: Pro $7.50, Max $20, Ultra $42, Studio $85. Using every message on your plan at typical sizes stays under it; very large messages and heavy research use it faster. Every limit, explained.
What differs
Messages on Pro
They cost the same in llmwise: up to 125 messages a month on Pro on either.
Context window
Claude Sonnet 5 takes up to 1M tokens; Kimi K3 up to 1.05M tokens. A chat in llmwise holds up to 200k tokens, which fits in either, so the difference shows only through each maker's own API.
Images and PDFs
Both read images. Kimi K3 gets a PDF's text rather than the file itself.
On Free
Both are in the free trial.
Where messages go
Claude Sonnet 5: Sent to Anthropic directly. Kimi K3: Served through OpenRouter, only by hosts that don't store or train on prompts. The maker's own endpoint is never asked.
Fact by fact
| Fact | Claude Sonnet 5 | Kimi K3 |
|---|---|---|
| Context window | 1M tokens | 1.05M tokens |
| Reads images | Yes | Yes |
| PDFs | Whole file | Text only |
| Reasoning | Yes | Yes |
| API price (September 2026) | $2.00 in / $10.00 out per million tokens | $3.00 in / $15.00 out per million tokens |
| A typical message at API prices (4,000 tokens in, 700 out) | $0.0150 | $0.0225 |
| A $10 top-up adds | 100 messages | 100 messages |
| Where a message goes | Sent to Anthropic directly. | Served through OpenRouter, only by hosts that don't store or train on prompts. The maker's own endpoint is never asked. |
| If the provider fails | If Anthropic fails before the reply starts (an overload, a server error, a dropped connection), llmwise sends the same request to Claude Sonnet 5 through OpenRouter instead. | When one host is down, OpenRouter moves the request to another host that meets the same rules. |
| Anthropic's safety fallback | Doesn't apply | Doesn't apply |
Claude Sonnet 5 or Kimi K3?
From the facts above and our test runs: the rest is how their answers suit your work, which one chat can show you.
Pick Claude Sonnet 5: it reads a PDF as the whole file, charts and scans included; it costs its maker less to run ($0.0150 a typical message at API prices), though in llmwise the count is the same.
Each model's page, the families, and other pairs
Claude Sonnet 5 vs Kimi K3 is one pair of models. The page below covers the whole families.
- Claude Sonnet 5: price, limits and messages on every plan
- Kimi K3: price, limits and messages on every plan
- Claude vs Kimi
- Claude Opus 5.5 vs Claude Sonnet 5
- Claude Fable 5.1 vs Claude Sonnet 5
- Claude Sonnet 5 vs Claude Haiku 4.5
- Claude Fable 5.1 vs Kimi K3
- Kimi K3 vs GLM 5.3
- DeepSeek V4 Pro vs Kimi K3
- Every model-vs-model page
Claude Sonnet 5 is a Claude model; Kimi K3 is a Kimi model.
Questions
Is Claude Sonnet 5 or Kimi K3 cheaper in llmwise?
They cost the same in llmwise: up to 125 messages a month on Pro on either. Every paid plan's monthly allowance is shared by all models, so each count is the most you get if it all goes to that model.
Can I try Claude Sonnet 5 and Kimi K3 for free?
Yes: both are in the free trial of 5 messages.
Which has the bigger context window, Claude Sonnet 5 or Kimi K3?
Kimi K3: 1.05M tokens, against 1M tokens. A chat in llmwise holds up to 200k tokens, which fits in either, so the difference shows only through each maker's own API.
Can I use Claude Sonnet 5 and Kimi K3 in the same chat?
Yes. Pick Claude Sonnet 5 for one message and Kimi K3 for the next; the second sees the whole chat, including the first one's answer.
Which did better in your test runs, Claude Sonnet 5 or Kimi K3?
On the same 50 prompts, run on September 27, 2026, Claude Sonnet 5 passed 46 and Kimi K3 passed 46. The table on this page has each job, and every reply is published.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, and GLM, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.