Tested prompt · Math
The highest of three dice is a 5: every AI model's reply, tested
We sent this hard math prompt to all 20 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.
Based on 20 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .
Short answer
All 20 models passed this math prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000098; the fastest, GLM 5.3's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 109 times as much ($0.0106).
The prompt, as sent, and its check
Checked by final answer, the same way for every model.
The highest of three dice is a 5 (hard)
You roll three fair six-sided dice. What's the probability that the highest number showing is exactly 5? Give it as a fraction in lowest terms. Show your working briefly, then end with a line that says "Final answer: " followed by the answer alone.
The final answer must be 61/216.
Exactly what this prompt's replies are checked against, with every other prompt of our test runs.
Every model's result
All 20 models on this prompt, in catalog order.
| Model | Result | Cost | Time | Reply |
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | Passed: Final answer 61/216: right. | $0.0106 | 5.9 s | 105 tokens |
| Claude Opus 5.5Anthropic | Passed: Final answer 61/216: right. | $0.0057 | 3.9 s | 144 tokens |
| Claude Sonnet 5.5Anthropic | Passed: Final answer 61/216: right. | $0.0022 | 1.7 s | 114 tokens |
| Claude Sonnet 5Anthropic | Passed: Final answer 61/216: right. | $0.0028 | 3.9 s | 111 tokens |
| Claude Haiku 5.5Anthropic | Passed: Final answer 61/216: right. | $0.00018 | 2.1 s | 179 tokens |
| Claude Haiku 4.5Anthropic | Passed: Final answer 61/216: right. | $0.0018 | 2.2 s | 276 tokens |
| GPT-6 AstraOpenAI | Passed: Final answer 61/216: right. | $0.0088 | 2.6 s | 97 tokens |
| GPT-6.1 SolOpenAI | Passed: Final answer (61/216 ): right. | $0.00083 | 1.8 s | 87 tokens |
| GPT-6 SolOpenAI | Passed: Final answer 61/216: right. | $0.0020 | 2.2 s | 91 tokens |
| GPT-6 LunaOpenAI | Passed: Final answer 61/216: right. | $0.000098 | 2.2 s | 78 tokens |
| Gemini 4 ArgonGoogle | Passed: Final answer 61/216: right. | $0.0016 | 4.9 s | 183 tokens |
| Gemini 3.1 Pro (preview)Google | Passed: Final answer 61/216: right. | $0.0090 | 8.3 s | 213 tokens |
| Gemini 3.8 FlashGoogle | Passed: Final answer 61/216: right. | $0.0018 | 4.9 s | 172 tokens |
| DeepSeek V4.1 FlashDeepSeek | Passed: Final answer 61/216: right. | $0.00023 | 1.0 s | 81 tokens |
| DeepSeek V4 ProDeepSeek | Passed: Final answer 61/216: right. | $0.00091 | 2.5 s | 72 tokens |
| Grok 4.7xAI | Passed: Final answer 61/216: right. | $0.0074 | 11.7 s | 127 tokens |
| Kimi K3Moonshot | Passed: Final answer 61/216: right. | $0.0027 | 2.4 s | 80 tokens |
| GLM 5.3Z.ai | Passed: Final answer 61/216: right. | $0.00059 | 0.9 s | 56 tokens |
| GLM 5.3 FlashZ.ai | Passed: Final answer 61/216: right. | $0.00011 | 0.9 s | 70 tokens |
| Mistral Large 4Mistral | Passed: Final answer 61/216: right. | $0.0039 | 17.9 s | 497 tokens |
Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.
Every reply
Every reply passed: here they are from the cheapest up.
GPT-6 Luna
Passed: Final answer 61/216: right.
There are \(5^3\) outcomes where every die is at most 5, and \(4^3\) where every die is at most 4. Thus the probability is \[ \frac{5^3-4^3}{6^3}=\frac{61}{216}. \] Final answer: 61/216393 tokens in, 117 out (39 of them reasoning) · 2.2 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·
GLM 5.3 Flash
Passed: Final answer 61/216: right.
P(max ≤ 5) = (5/6)³ = 125/216, P(max ≤ 4) = (4/6)³ = 64/216. So P(max = 5) = 125/216 − 64/216 = 61/216. Final answer: 61/216
409 tokens in, 97 out (27 of them reasoning) · 0.9 s · $0.0001 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Together ·
Claude Haiku 5.5
Passed: Final answer 61/216: right.
The highest number is exactly 5 when all three dice show at most 5, minus the cases where all three show at most 4: - All dice ≤ 5: 5³ = 125 outcomes - All dice ≤ 4: 4³ = 64 outcomes - Exactly max 5: 125 − 64 = 61 outcomes Out of 6³ = 216 total outcomes, the probability is 61/216. Since 61 is prime and doesn't divide 216, the fraction is already in lowest terms. Final answer: 61/216
540 tokens in, 250 out (71 of them reasoning) · 2.1 s · $0.0002 · 1 message on Pro · answered by anthropic/claude-haiku-5.5 via Anthropic ·
DeepSeek V4.1 Flash
Passed: Final answer 61/216: right.
Count outcomes where all three dice are ≤ 5, then subtract those where all are ≤ 4 (so no 5 appears): - All ≤ 5: 5³ = 125 - All ≤ 4: 4³ = 64 Favorable outcomes: 125 − 64 = 61, out of 216 total. Final answer: 61/216
433 tokens in, 150 out (69 of them reasoning) · 1.0 s · $0.0002 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Together ·
GLM 5.3
Passed: Final answer 61/216: right.
All outcomes ≤5 minus all ≤4, divided by 216: (5³ − 4³)/216 = (125 − 64)/216 = 61/216 61 is prime, so this is already lowest terms. Final answer: 61/216
432 tokens in, 79 out (23 of them reasoning) · 0.9 s · $0.0006 · 1 message on Pro · answered by z-ai/glm-5.3 via Wafer ·
GPT-6.1 Sol
Passed: Final answer (61/216 ): right.
The highest number is exactly 5 if all three dice show at most 5, but not all show at most 4. \[ P(\max=5)=\left(\frac56\right)^3-\left(\frac46\right)^3 =\frac{125-64}{216}=\frac{61}{216}. \] Final answer: \(\frac{61}{216}\)395 tokens in, 87 out · 1.8 s · $0.0008 · 1 message on Pro · answered by openai/gpt-6.1-sol via OpenAI ·
DeepSeek V4 Pro
Passed: Final answer 61/216: right.
Total outcomes: \(6^3 = 216\). Highest exactly 5 means all dice are at most 5, but not all at most 4: \[ 5^3 - 4^3 = 125 - 64 = 61 \] Probability: \[ \frac{61}{216} \] Final answer: 61/216405 tokens in, 199 out (127 of them reasoning) · 2.5 s · $0.0009 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·
Gemini 4 Argon
Passed: Final answer 61/216: right.
The total number of possible outcomes when rolling three six-sided dice is $6^3 = 216$. For the highest number showing to be at most 5, all three dice must show a number from 1 to 5, giving $5^3 = 125$ outcomes. For the highest number showing to be at most 4, all three dice must show a number from 1 to 4, giving $4^3 = 64$ outcomes. The number of outcomes where the highest number is *exactly* 5 is the difference between these two: $$125 - 64 = 61$$ Since 61 is a prime number, the fraction $\frac{61}{216}$ is already in its lowest terms. Final answer: 61/216640 tokens in, 183 out · 4.9 s · $0.0016 · 1 message on Pro · answered by google/gemini-4-argon via Google AI Studio ·
Gemini 3.8 Flash
Passed: Final answer 61/216: right.
To find the probability that the highest number showing on three fair six-sided dice is exactly 5: 1. The total number of possible outcomes when rolling three dice is $6^3 = 216$. 2. The number of outcomes where all three dice show a number less than or equal to 5 is $5^3 = 125$. 3. The number of outcomes where all three dice show a number less than or equal to 4 (meaning no 5 is rolled) is $4^3 = 64$. 4. The number of outcomes where the maximum number is exactly 5 is $125 - 64 = 61$. Thus, the probability is $\frac{61}{216}$. Final answer: 61/216421 tokens in, 392 out (220 of them reasoning) · 4.9 s · $0.0018 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·
Claude Haiku 4.5
Passed: Final answer 61/216: right.
I need to find the probability that the maximum of three dice is exactly 5. **Working:** For the maximum to be exactly 5: - At least one die shows 5 - No die shows 6 **Count favorable outcomes:** - All three dice must show values from {1, 2, 3, 4, 5} - At least one die must show 5 Using complementary counting: - Total ways to roll three dice with values in {1,2,3,4,5}: 5³ = 125 - Ways with no 5 (all from {1,2,3,4}): 4³ = 64 - Ways with at least one 5: 125 - 64 = 61 **Total possible outcomes:** 6³ = 216 **Probability:** 61/216 Let me verify this is in lowest terms by checking if 61 and 216 share factors: - 61 is prime - 216 = 2³ × 3³ - Since 61 is prime and doesn't equal 2 or 3, gcd(61, 216) = 1 Final answer: 61/216420 tokens in, 276 out · 2.2 s · $0.0018 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·
GPT-6 Sol
Passed: Final answer 61/216: right.
For the highest number to be exactly 5, all three dice must show 5 or less, but not all can show 4 or less. \[ P(\text{highest is }5)=\left(\frac56\right)^3-\left(\frac46\right)^3 =\frac{125-64}{216}=\frac{61}{216}. \] Final answer: 61/216393 tokens in, 122 out (31 of them reasoning) · 2.2 s · $0.0020 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·
Claude Sonnet 5.5
Passed: Final answer 61/216: right.
P(max ≤ 5) = (5/6)³ = 125/216 P(max ≤ 4) = (4/6)³ = 64/216 P(max = 5) = 125/216 − 64/216 = 61/216 61 is prime and doesn't divide 216, so the fraction is already in lowest terms. Final answer: 61/216
541 tokens in, 114 out · 1.7 s · $0.0022 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·
Kimi K3
Passed: Final answer 61/216: right.
Count outcomes where all dice are at most 5: \(5^3=125\). Subtract outcomes where all dice are at most 4: \(4^3=64\). So exactly highest 5: \(125-64=61\) out of \(6^3=216\). Final answer: 61/216
480 tokens in, 176 out (96 of them reasoning) · 2.4 s · $0.0027 · 1 message on Pro · answered by moonshotai/kimi-k3 via Phala ·
Claude Sonnet 5
Passed: Final answer 61/216: right.
P(max ≤ 5) = (5/6)³ = 125/216 P(max ≤ 4) = (4/6)³ = 64/216 P(max = 5) = 125/216 − 64/216 = 61/216 61 is prime and doesn't divide 216, so this is already in lowest terms. Final answer: 61/216
537 tokens in, 174 out (63 of them reasoning) · 3.9 s · $0.0028 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·
Mistral Large 4
Passed: Final answer 61/216: right.
Total outcomes when rolling three dice: $6^3 = 216$. For the highest number to be exactly 5: - No die can show 6, so all dice show values from $\{1,2,3,4,5\}$: $5^3 = 125$ outcomes. - But we must exclude cases where the highest is 4 or less (i.e., all dice from $\{1,2,3,4\}$): $4^3 = 64$ outcomes. Favorable outcomes: $125 - 64 = 61$. Probability: $\frac{61}{216}$ (61 is prime and doesn't divide 216, so this is in lowest terms). Final answer: $\frac{61}{216}$399 tokens in, 1,723 out (1,226 of them reasoning) · 17.9 s · $0.0039 · 1 message on Pro · answered by mistralai/mistral-large-4-0 via Mistral ·
Claude Opus 5.5
Passed: Final answer 61/216: right.
P(max = 5) = P(all ≤ 5) − P(all ≤ 4) - P(all ≤ 5) = (5/6)³ = 125/216 - P(all ≤ 4) = (4/6)³ = 64/216 So P(max = 5) = (125 − 64)/216 = 61/216. 61 is prime and doesn't divide 216, so this is already in lowest terms. Final answer: 61/216
539 tokens in, 178 out (34 of them reasoning) · 3.9 s · $0.0057 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·
Grok 4.7
Passed: Final answer 61/216: right.
The total number of outcomes is \(6^3 = 216\). The outcomes in which every die shows at most 5 number \(5^3 = 125\). Among these, the outcomes in which every die shows at most 4 number \(4^3 = 64\). Subtracting yields the outcomes in which the maximum is exactly 5: \[ 125 - 64 = 61. \] Thus the desired probability is \(61/216\). (The fraction is already in lowest terms, since 61 is prime and does not divide 216.) Final answer: 61/216
1,629 tokens in, 972 out (845 of them reasoning) · 11.7 s · $0.0074 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·
GPT-6 Astra
Passed: Final answer 61/216: right.
There are \(6^3=216\) equally likely outcomes. For the highest number to be exactly 5, all dice must show at most 5, but not all at most 4. Thus, \[ P(\text{highest}=5)=\frac{5^3-4^3}{6^3} =\frac{125-64}{216} =\frac{61}{216}. \] Final answer: 61/216393 tokens in, 97 out · 2.6 s · $0.0088 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·
Gemini 3.1 Pro
Passed: Final answer 61/216: right.
To find the probability that the highest number showing on three rolled dice is exactly 5, we can use the difference between two probabilities: 1. The probability that all three dice show a 5 or lower. 2. The probability that all three dice show a 4 or lower. The number of ways all three dice can show 5 or lower is $5^3 = 125$. The number of ways all three dice can show 4 or lower is $4^3 = 64$. The number of outcomes where the highest number is exactly 5 is the difference: $125 - 64 = 61$. The total number of possible outcomes when rolling three six-sided dice is $6^3 = 216$. Therefore, the probability is 61/216. Since 61 is a prime number and doesn't divide 216, this fraction is in lowest terms. Final answer: 61/216
421 tokens in, 676 out (463 of them reasoning) · 8.3 s · $0.0090 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·
Claude Fable 5.1
Passed: Final answer 61/216: right.
P(max ≤ 5) = (5/6)³ = 125/216 P(max ≤ 4) = (4/6)³ = 64/216 P(max = 5) = 125/216 − 64/216 = 61/216 61 is prime, so the fraction is already in lowest terms. Final answer: 61/216
539 tokens in, 105 out · 5.9 s · $0.0106 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·
More math prompts
The other math prompts, each with every model's reply, and the results across all five.
Questions
Which AI does best on “The highest of three dice is a 5”?
All 20 models passed this math prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000098; the fastest, GLM 5.3's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 109 times as much ($0.0106).
What does a reply to “The highest of three dice is a 5” cost?
Through the models' APIs, what OpenRouter charged us ran from $0.000098 (GPT-6 Luna) to $0.0106 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.