Skip to content

Tested prompt · Math

The highest of three dice is a 5: every AI model's reply, tested

We sent this hard math prompt to all 16 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.

Based on 16 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .

Short answer

All 16 models passed this math prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000098; the fastest, GLM 5.3's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 109 times as much ($0.0106).

The prompt, as sent, and its check

Checked by final answer, the same way for every model.

The highest of three dice is a 5 (hard)

You roll three fair six-sided dice. What's the probability that the highest number showing is exactly 5? Give it as a fraction in lowest terms.
Show your working briefly, then end with a line that says "Final answer: " followed by the answer alone.

The final answer must be 61/216.

Exactly what this prompt's replies are checked against, with every other prompt of our test runs.

Every model's result

All 16 models on this prompt, in catalog order.

Every model's reply to “The highest of three dice is a 5”
ModelResultCostTimeReply
Claude Fable 5.1AnthropicPassed: Final answer 61/216: right.$0.01065.9 s105 tokens
Claude Opus 5.5AnthropicPassed: Final answer 61/216: right.$0.00573.9 s144 tokens
Claude Sonnet 5.5AnthropicPassed: Final answer 61/216: right.$0.00221.7 s114 tokens
Claude Sonnet 5AnthropicPassed: Final answer 61/216: right.$0.00283.9 s111 tokens
Claude Haiku 4.5AnthropicPassed: Final answer 61/216: right.$0.00182.2 s276 tokens
GPT-6 AstraOpenAIPassed: Final answer 61/216: right.$0.00882.6 s97 tokens
GPT-6 SolOpenAIPassed: Final answer 61/216: right.$0.00202.2 s91 tokens
GPT-6 LunaOpenAIPassed: Final answer 61/216: right.$0.0000982.2 s78 tokens
Gemini 3.1 Pro (preview)GooglePassed: Final answer 61/216: right.$0.00908.3 s213 tokens
Gemini 3.8 FlashGooglePassed: Final answer 61/216: right.$0.00184.9 s172 tokens
DeepSeek V4.1 FlashDeepSeekPassed: Final answer 61/216: right.$0.000192.5 s100 tokens
DeepSeek V4 ProDeepSeekPassed: Final answer 61/216: right.$0.000613.5 s96 tokens
Grok 4.7xAIPassed: Final answer 61/216: right.$0.00509.1 s165 tokens
Kimi K3MoonshotPassed: Final answer 61/216: right.$0.00272.4 s80 tokens
GLM 5.3Z.aiPassed: Final answer 61/216: right.$0.000590.9 s56 tokens
GLM 5.3 FlashZ.aiPassed: Final answer 61/216: right.$0.000110.9 s70 tokens

Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.

Every reply

Every reply passed: here they are from the cheapest up.

  1. GPT-6 Luna

    Passed: Final answer 61/216: right.

    There are \(5^3\) outcomes where every die is at most 5, and \(4^3\) where every die is at most 4. Thus the probability is
    \[
    \frac{5^3-4^3}{6^3}=\frac{61}{216}.
    \]
    
    Final answer: 61/216

    393 tokens in, 117 out (39 of them reasoning) · 2.2 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·

  2. GLM 5.3 Flash

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216, P(max ≤ 4) = (4/6)³ = 64/216.
    
    So P(max = 5) = 125/216 − 64/216 = 61/216.
    
    Final answer: 61/216

    409 tokens in, 97 out (27 of them reasoning) · 0.9 s · $0.0001 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Together ·

  3. DeepSeek V4.1 Flash

    Passed: Final answer 61/216: right.

    Total outcomes: 6³ = 216.
    
    Max exactly 5 means all dice show ≤ 5, but not all show ≤ 4:
    
    - All ≤ 5: 5³ = 125
    - All ≤ 4: 4³ = 64
    
    So favorable outcomes: 125 − 64 = 61.
    
    Probability = 61/216 (already in lowest terms, since 61 is prime and doesn't divide 216).
    
    Final answer: 61/216

    432 tokens in, 155 out (55 of them reasoning) · 2.5 s · $0.0002 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via CoreWeave ·

  4. GLM 5.3

    Passed: Final answer 61/216: right.

    All outcomes ≤5 minus all ≤4, divided by 216:
    
    (5³ − 4³)/216 = (125 − 64)/216 = 61/216
    
    61 is prime, so this is already lowest terms.
    
    Final answer: 61/216

    432 tokens in, 79 out (23 of them reasoning) · 0.9 s · $0.0006 · 1 message on Pro · answered by z-ai/glm-5.3 via Wafer ·

  5. DeepSeek V4 Pro

    Passed: Final answer 61/216: right.

    The highest die is exactly 5 means:
    
    - All three dice show 5 or less: \(5^3 = 125\) outcomes
    - Subtract outcomes where all dice show 4 or less: \(4^3 = 64\)
    
    So favorable outcomes:
    
    \[
    125 - 64 = 61
    \]
    
    Total outcomes:
    
    \[
    6^3 = 216
    \]
    
    Probability:
    
    \[
    \frac{61}{216}
    \]
    
    Final answer: 61/216

    405 tokens in, 213 out (117 of them reasoning) · 3.5 s · $0.0006 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Alibaba ·

  6. Gemini 3.8 Flash

    Passed: Final answer 61/216: right.

    To find the probability that the highest number showing on three fair six-sided dice is exactly 5:
    
    1. The total number of possible outcomes when rolling three dice is $6^3 = 216$.
    2. The number of outcomes where all three dice show a number less than or equal to 5 is $5^3 = 125$.
    3. The number of outcomes where all three dice show a number less than or equal to 4 (meaning no 5 is rolled) is $4^3 = 64$.
    4. The number of outcomes where the maximum number is exactly 5 is $125 - 64 = 61$.
    
    Thus, the probability is $\frac{61}{216}$.
    
    Final answer: 61/216

    421 tokens in, 392 out (220 of them reasoning) · 4.9 s · $0.0018 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·

  7. Claude Haiku 4.5

    Passed: Final answer 61/216: right.

    I need to find the probability that the maximum of three dice is exactly 5.
    
    **Working:**
    
    For the maximum to be exactly 5:
    - At least one die shows 5
    - No die shows 6
    
    **Count favorable outcomes:**
    - All three dice must show values from {1, 2, 3, 4, 5}
    - At least one die must show 5
    
    Using complementary counting:
    - Total ways to roll three dice with values in {1,2,3,4,5}: 5³ = 125
    - Ways with no 5 (all from {1,2,3,4}): 4³ = 64
    - Ways with at least one 5: 125 - 64 = 61
    
    **Total possible outcomes:** 6³ = 216
    
    **Probability:** 61/216
    
    Let me verify this is in lowest terms by checking if 61 and 216 share factors:
    - 61 is prime
    - 216 = 2³ × 3³
    - Since 61 is prime and doesn't equal 2 or 3, gcd(61, 216) = 1
    
    Final answer: 61/216

    420 tokens in, 276 out · 2.2 s · $0.0018 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·

  8. GPT-6 Sol

    Passed: Final answer 61/216: right.

    For the highest number to be exactly 5, all three dice must show 5 or less, but not all can show 4 or less.
    
    \[
    P(\text{highest is }5)=\left(\frac56\right)^3-\left(\frac46\right)^3
    =\frac{125-64}{216}=\frac{61}{216}.
    \]
    
    Final answer: 61/216

    393 tokens in, 122 out (31 of them reasoning) · 2.2 s · $0.0020 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·

  9. Claude Sonnet 5.5

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216
    P(max ≤ 4) = (4/6)³ = 64/216
    
    P(max = 5) = 125/216 − 64/216 = 61/216
    
    61 is prime and doesn't divide 216, so the fraction is already in lowest terms.
    
    Final answer: 61/216

    541 tokens in, 114 out · 1.7 s · $0.0022 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·

  10. Kimi K3

    Passed: Final answer 61/216: right.

    Count outcomes where all dice are at most 5: \(5^3=125\).  
    Subtract outcomes where all dice are at most 4: \(4^3=64\).  
    So exactly highest 5: \(125-64=61\) out of \(6^3=216\).
    
    Final answer: 61/216

    480 tokens in, 176 out (96 of them reasoning) · 2.4 s · $0.0027 · 1 message on Pro · answered by moonshotai/kimi-k3 via Phala ·

  11. Claude Sonnet 5

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216
    P(max ≤ 4) = (4/6)³ = 64/216
    
    P(max = 5) = 125/216 − 64/216 = 61/216
    
    61 is prime and doesn't divide 216, so this is already in lowest terms.
    
    Final answer: 61/216

    537 tokens in, 174 out (63 of them reasoning) · 3.9 s · $0.0028 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·

  12. Grok 4.7

    Passed: Final answer 61/216: right.

    The total number of outcomes when rolling three fair six-sided dice is \(6^3 = 216\).
    
    The highest face is exactly 5 precisely when every die shows a face in \(\{1,2,3,4,5\}\) and at least one die shows a 5. There are \(5^3 = 125\) outcomes in which every face is at most 5, and \(4^3 = 64\) outcomes in which every face is at most 4. Subtracting gives
    \[
    125 - 64 = 61
    \]
    favorable outcomes.
    
    Thus the desired probability is \(\frac{61}{216}\). (The fraction is already in lowest terms, since 61 is prime and does not divide 216.)
    
    Final answer: 61/216

    1,628 tokens in, 786 out (621 of them reasoning) · 9.1 s · $0.0050 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·

  13. Claude Opus 5.5

    Passed: Final answer 61/216: right.

    P(max = 5) = P(all ≤ 5) − P(all ≤ 4)
    
    - P(all ≤ 5) = (5/6)³ = 125/216
    - P(all ≤ 4) = (4/6)³ = 64/216
    
    So P(max = 5) = (125 − 64)/216 = 61/216.
    
    61 is prime and doesn't divide 216, so this is already in lowest terms.
    
    Final answer: 61/216

    539 tokens in, 178 out (34 of them reasoning) · 3.9 s · $0.0057 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·

  14. GPT-6 Astra

    Passed: Final answer 61/216: right.

    There are \(6^3=216\) equally likely outcomes. For the highest number to be exactly 5, all dice must show at most 5, but not all at most 4.
    
    Thus,
    \[
    P(\text{highest}=5)=\frac{5^3-4^3}{6^3}
    =\frac{125-64}{216}
    =\frac{61}{216}.
    \]
    
    Final answer: 61/216

    393 tokens in, 97 out · 2.6 s · $0.0088 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·

  15. Gemini 3.1 Pro

    Passed: Final answer 61/216: right.

    To find the probability that the highest number showing on three rolled dice is exactly 5, we can use the difference between two probabilities:
    1. The probability that all three dice show a 5 or lower.
    2. The probability that all three dice show a 4 or lower.
    
    The number of ways all three dice can show 5 or lower is $5^3 = 125$.
    The number of ways all three dice can show 4 or lower is $4^3 = 64$.
    
    The number of outcomes where the highest number is exactly 5 is the difference: $125 - 64 = 61$.
    
    The total number of possible outcomes when rolling three six-sided dice is $6^3 = 216$.
    
    Therefore, the probability is 61/216. Since 61 is a prime number and doesn't divide 216, this fraction is in lowest terms.
    
    Final answer: 61/216

    421 tokens in, 676 out (463 of them reasoning) · 8.3 s · $0.0090 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·

  16. Claude Fable 5.1

    Passed: Final answer 61/216: right.

    P(max ≤ 5) = (5/6)³ = 125/216
    P(max ≤ 4) = (4/6)³ = 64/216
    P(max = 5) = 125/216 − 64/216 = 61/216
    
    61 is prime, so the fraction is already in lowest terms.
    
    Final answer: 61/216

    539 tokens in, 105 out · 5.9 s · $0.0106 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·

More math prompts

The other math prompts, each with every model's reply, and the results across all five.

Questions

Which AI does best on “The highest of three dice is a 5”?

All 16 models passed this math prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000098; the fastest, GLM 5.3's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 109 times as much ($0.0106).

What does a reply to “The highest of three dice is a 5” cost?

Through the models' APIs, what OpenRouter charged us ran from $0.000098 (GPT-6 Luna) to $0.0106 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.

Claude, GPT, Gemini, DeepSeek, Grok, Kimi, and GLM, in one chat.

See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.