Skip to content

Tested prompt · Math

The highest of three dice is a 5: every AI model's reply, tested

We sent this hard math prompt to all 20 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.

Based on 20 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .

Short answer

All 20 models passed this math prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000098; the fastest, GLM 5.3's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 109 times as much ($0.0106).

The prompt, as sent, and its check

Checked by final answer, the same way for every model.

The highest of three dice is a 5 (hard)

You roll three fair six-sided dice. What's the probability that the highest number showing is exactly 5? Give it as a fraction in lowest terms.
Show your working briefly, then end with a line that says "Final answer: " followed by the answer alone.

The final answer must be 61/216.

Exactly what this prompt's replies are checked against, with every other prompt of our test runs.

Every model's result

All 20 models on this prompt, in catalog order.

Every model's reply to “The highest of three dice is a 5”
ModelResultCostTimeReply
Claude Fable 5.1AnthropicPassed: Final answer 61/216: right.$0.01065.9 s105 tokens
Claude Opus 5.5AnthropicPassed: Final answer 61/216: right.$0.00573.9 s144 tokens
Claude Sonnet 5.5AnthropicPassed: Final answer 61/216: right.$0.00221.7 s114 tokens
Claude Sonnet 5AnthropicPassed: Final answer 61/216: right.$0.00283.9 s111 tokens
Claude Haiku 5.5AnthropicPassed: Final answer 61/216: right.$0.000182.1 s179 tokens
Claude Haiku 4.5AnthropicPassed: Final answer 61/216: right.$0.00182.2 s276 tokens
GPT-6 AstraOpenAIPassed: Final answer 61/216: right.$0.00882.6 s97 tokens
GPT-6.1 SolOpenAIPassed: Final answer (61/216 ): right.$0.000831.8 s87 tokens
GPT-6 SolOpenAIPassed: Final answer 61/216: right.$0.00202.2 s91 tokens
GPT-6 LunaOpenAIPassed: Final answer 61/216: right.$0.0000982.2 s78 tokens
Gemini 4 ArgonGooglePassed: Final answer 61/216: right.$0.00164.9 s183 tokens
Gemini 3.1 Pro (preview)GooglePassed: Final answer 61/216: right.$0.00908.3 s213 tokens
Gemini 3.8 FlashGooglePassed: Final answer 61/216: right.$0.00184.9 s172 tokens
DeepSeek V4.1 FlashDeepSeekPassed: Final answer 61/216: right.$0.000231.0 s81 tokens
DeepSeek V4 ProDeepSeekPassed: Final answer 61/216: right.$0.000912.5 s72 tokens
Grok 4.7xAIPassed: Final answer 61/216: right.$0.007411.7 s127 tokens
Kimi K3MoonshotPassed: Final answer 61/216: right.$0.00272.4 s80 tokens
GLM 5.3Z.aiPassed: Final answer 61/216: right.$0.000590.9 s56 tokens
GLM 5.3 FlashZ.aiPassed: Final answer 61/216: right.$0.000110.9 s70 tokens
Mistral Large 4MistralPassed: Final answer 61/216: right.$0.003917.9 s497 tokens

Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.

Every reply

Every reply passed: here they are from the cheapest up.

  1. GPT-6 Luna

    Passed: Final answer 61/216: right.

    There are \(5^3\) outcomes where every die is at most 5, and \(4^3\) where every die is at most 4. Thus the probability is
    \[
    \frac{5^3-4^3}{6^3}=\frac{61}{216}.
    \]
    
    Final answer: 61/216

    393 tokens in, 117 out (39 of them reasoning) · 2.2 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·

  2. GLM 5.3 Flash

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216, P(max ≤ 4) = (4/6)³ = 64/216.
    
    So P(max = 5) = 125/216 − 64/216 = 61/216.
    
    Final answer: 61/216

    409 tokens in, 97 out (27 of them reasoning) · 0.9 s · $0.0001 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Together ·

  3. Claude Haiku 5.5

    Passed: Final answer 61/216: right.

    The highest number is exactly 5 when all three dice show at most 5, minus the cases where all three show at most 4:
    
    - All dice ≤ 5: 5³ = 125 outcomes
    - All dice ≤ 4: 4³ = 64 outcomes
    - Exactly max 5: 125 − 64 = 61 outcomes
    
    Out of 6³ = 216 total outcomes, the probability is 61/216. Since 61 is prime and doesn't divide 216, the fraction is already in lowest terms.
    
    Final answer: 61/216

    540 tokens in, 250 out (71 of them reasoning) · 2.1 s · $0.0002 · 1 message on Pro · answered by anthropic/claude-haiku-5.5 via Anthropic ·

  4. DeepSeek V4.1 Flash

    Passed: Final answer 61/216: right.

    Count outcomes where all three dice are ≤ 5, then subtract those where all are ≤ 4 (so no 5 appears):
    
    - All ≤ 5: 5³ = 125
    - All ≤ 4: 4³ = 64
    
    Favorable outcomes: 125 − 64 = 61, out of 216 total.
    
    Final answer: 61/216

    433 tokens in, 150 out (69 of them reasoning) · 1.0 s · $0.0002 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Together ·

  5. GLM 5.3

    Passed: Final answer 61/216: right.

    All outcomes ≤5 minus all ≤4, divided by 216:
    
    (5³ − 4³)/216 = (125 − 64)/216 = 61/216
    
    61 is prime, so this is already lowest terms.
    
    Final answer: 61/216

    432 tokens in, 79 out (23 of them reasoning) · 0.9 s · $0.0006 · 1 message on Pro · answered by z-ai/glm-5.3 via Wafer ·

  6. GPT-6.1 Sol

    Passed: Final answer (61/216 ): right.

    The highest number is exactly 5 if all three dice show at most 5, but not all show at most 4.
    
    \[
    P(\max=5)=\left(\frac56\right)^3-\left(\frac46\right)^3
    =\frac{125-64}{216}=\frac{61}{216}.
    \]
    
    Final answer: \(\frac{61}{216}\)

    395 tokens in, 87 out · 1.8 s · $0.0008 · 1 message on Pro · answered by openai/gpt-6.1-sol via OpenAI ·

  7. DeepSeek V4 Pro

    Passed: Final answer 61/216: right.

    Total outcomes: \(6^3 = 216\).
    
    Highest exactly 5 means all dice are at most 5, but not all at most 4:
    \[
    5^3 - 4^3 = 125 - 64 = 61
    \]
    
    Probability:
    \[
    \frac{61}{216}
    \]
    
    Final answer: 61/216

    405 tokens in, 199 out (127 of them reasoning) · 2.5 s · $0.0009 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·

  8. Gemini 4 Argon

    Passed: Final answer 61/216: right.

    The total number of possible outcomes when rolling three six-sided dice is $6^3 = 216$.
    
    For the highest number showing to be at most 5, all three dice must show a number from 1 to 5, giving $5^3 = 125$ outcomes.
    For the highest number showing to be at most 4, all three dice must show a number from 1 to 4, giving $4^3 = 64$ outcomes.
    
    The number of outcomes where the highest number is *exactly* 5 is the difference between these two:
    $$125 - 64 = 61$$
    
    Since 61 is a prime number, the fraction $\frac{61}{216}$ is already in its lowest terms.
    
    Final answer: 61/216

    640 tokens in, 183 out · 4.9 s · $0.0016 · 1 message on Pro · answered by google/gemini-4-argon via Google AI Studio ·

  9. Gemini 3.8 Flash

    Passed: Final answer 61/216: right.

    To find the probability that the highest number showing on three fair six-sided dice is exactly 5:
    
    1. The total number of possible outcomes when rolling three dice is $6^3 = 216$.
    2. The number of outcomes where all three dice show a number less than or equal to 5 is $5^3 = 125$.
    3. The number of outcomes where all three dice show a number less than or equal to 4 (meaning no 5 is rolled) is $4^3 = 64$.
    4. The number of outcomes where the maximum number is exactly 5 is $125 - 64 = 61$.
    
    Thus, the probability is $\frac{61}{216}$.
    
    Final answer: 61/216

    421 tokens in, 392 out (220 of them reasoning) · 4.9 s · $0.0018 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·

  10. Claude Haiku 4.5

    Passed: Final answer 61/216: right.

    I need to find the probability that the maximum of three dice is exactly 5.
    
    **Working:**
    
    For the maximum to be exactly 5:
    - At least one die shows 5
    - No die shows 6
    
    **Count favorable outcomes:**
    - All three dice must show values from {1, 2, 3, 4, 5}
    - At least one die must show 5
    
    Using complementary counting:
    - Total ways to roll three dice with values in {1,2,3,4,5}: 5³ = 125
    - Ways with no 5 (all from {1,2,3,4}): 4³ = 64
    - Ways with at least one 5: 125 - 64 = 61
    
    **Total possible outcomes:** 6³ = 216
    
    **Probability:** 61/216
    
    Let me verify this is in lowest terms by checking if 61 and 216 share factors:
    - 61 is prime
    - 216 = 2³ × 3³
    - Since 61 is prime and doesn't equal 2 or 3, gcd(61, 216) = 1
    
    Final answer: 61/216

    420 tokens in, 276 out · 2.2 s · $0.0018 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·

  11. GPT-6 Sol

    Passed: Final answer 61/216: right.

    For the highest number to be exactly 5, all three dice must show 5 or less, but not all can show 4 or less.
    
    \[
    P(\text{highest is }5)=\left(\frac56\right)^3-\left(\frac46\right)^3
    =\frac{125-64}{216}=\frac{61}{216}.
    \]
    
    Final answer: 61/216

    393 tokens in, 122 out (31 of them reasoning) · 2.2 s · $0.0020 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·

  12. Claude Sonnet 5.5

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216
    P(max ≤ 4) = (4/6)³ = 64/216
    
    P(max = 5) = 125/216 − 64/216 = 61/216
    
    61 is prime and doesn't divide 216, so the fraction is already in lowest terms.
    
    Final answer: 61/216

    541 tokens in, 114 out · 1.7 s · $0.0022 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·

  13. Kimi K3

    Passed: Final answer 61/216: right.

    Count outcomes where all dice are at most 5: \(5^3=125\).  
    Subtract outcomes where all dice are at most 4: \(4^3=64\).  
    So exactly highest 5: \(125-64=61\) out of \(6^3=216\).
    
    Final answer: 61/216

    480 tokens in, 176 out (96 of them reasoning) · 2.4 s · $0.0027 · 1 message on Pro · answered by moonshotai/kimi-k3 via Phala ·

  14. Claude Sonnet 5

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216
    P(max ≤ 4) = (4/6)³ = 64/216
    
    P(max = 5) = 125/216 − 64/216 = 61/216
    
    61 is prime and doesn't divide 216, so this is already in lowest terms.
    
    Final answer: 61/216

    537 tokens in, 174 out (63 of them reasoning) · 3.9 s · $0.0028 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·

  15. Mistral Large 4

    Passed: Final answer 61/216: right.

    Total outcomes when rolling three dice: $6^3 = 216$.
    
    For the highest number to be exactly 5:
    - No die can show 6, so all dice show values from $\{1,2,3,4,5\}$: $5^3 = 125$ outcomes.
    - But we must exclude cases where the highest is 4 or less (i.e., all dice from $\{1,2,3,4\}$): $4^3 = 64$ outcomes.
    
    Favorable outcomes: $125 - 64 = 61$.
    
    Probability: $\frac{61}{216}$ (61 is prime and doesn't divide 216, so this is in lowest terms).
    
    Final answer: $\frac{61}{216}$

    399 tokens in, 1,723 out (1,226 of them reasoning) · 17.9 s · $0.0039 · 1 message on Pro · answered by mistralai/mistral-large-4-0 via Mistral ·

  16. Claude Opus 5.5

    Passed: Final answer 61/216: right.

    P(max = 5) = P(all ≤ 5) − P(all ≤ 4)
    
    - P(all ≤ 5) = (5/6)³ = 125/216
    - P(all ≤ 4) = (4/6)³ = 64/216
    
    So P(max = 5) = (125 − 64)/216 = 61/216.
    
    61 is prime and doesn't divide 216, so this is already in lowest terms.
    
    Final answer: 61/216

    539 tokens in, 178 out (34 of them reasoning) · 3.9 s · $0.0057 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·

  17. Grok 4.7

    Passed: Final answer 61/216: right.

    The total number of outcomes is \(6^3 = 216\).
    
    The outcomes in which every die shows at most 5 number \(5^3 = 125\). Among these, the outcomes in which every die shows at most 4 number \(4^3 = 64\). Subtracting yields the outcomes in which the maximum is exactly 5:
    \[
    125 - 64 = 61.
    \]
    Thus the desired probability is \(61/216\). (The fraction is already in lowest terms, since 61 is prime and does not divide 216.)
    
    Final answer: 61/216

    1,629 tokens in, 972 out (845 of them reasoning) · 11.7 s · $0.0074 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·

  18. GPT-6 Astra

    Passed: Final answer 61/216: right.

    There are \(6^3=216\) equally likely outcomes. For the highest number to be exactly 5, all dice must show at most 5, but not all at most 4.
    
    Thus,
    \[
    P(\text{highest}=5)=\frac{5^3-4^3}{6^3}
    =\frac{125-64}{216}
    =\frac{61}{216}.
    \]
    
    Final answer: 61/216

    393 tokens in, 97 out · 2.6 s · $0.0088 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·

  19. Gemini 3.1 Pro

    Passed: Final answer 61/216: right.

    To find the probability that the highest number showing on three rolled dice is exactly 5, we can use the difference between two probabilities:
    1. The probability that all three dice show a 5 or lower.
    2. The probability that all three dice show a 4 or lower.
    
    The number of ways all three dice can show 5 or lower is $5^3 = 125$.
    The number of ways all three dice can show 4 or lower is $4^3 = 64$.
    
    The number of outcomes where the highest number is exactly 5 is the difference: $125 - 64 = 61$.
    
    The total number of possible outcomes when rolling three six-sided dice is $6^3 = 216$.
    
    Therefore, the probability is 61/216. Since 61 is a prime number and doesn't divide 216, this fraction is in lowest terms.
    
    Final answer: 61/216

    421 tokens in, 676 out (463 of them reasoning) · 8.3 s · $0.0090 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·

  20. Claude Fable 5.1

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216
    P(max ≤ 4) = (4/6)³ = 64/216
    P(max = 5) = 125/216 − 64/216 = 61/216
    
    61 is prime, so the fraction is already in lowest terms.
    
    Final answer: 61/216

    539 tokens in, 105 out · 5.9 s · $0.0106 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·

More math prompts

The other math prompts, each with every model's reply, and the results across all five.

Questions

Which AI does best on “The highest of three dice is a 5”?

All 20 models passed this math prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000098; the fastest, GLM 5.3's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 109 times as much ($0.0106).

What does a reply to “The highest of three dice is a 5” cost?

Through the models' APIs, what OpenRouter charged us ran from $0.000098 (GPT-6 Luna) to $0.0106 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.

Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.

See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.