Tested prompt · AI math solver
A linear equation: every AI model's reply, tested
We ran this everyday AI math solver test input on all 19 models in llmwise, the way the tool runs it, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.
Based on 19 of our test runs on , through OpenRouter with the tool's own instructions and the app's settings. Updated .
Short answer
All 19 models passed this AI math solver test input's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000055; the fastest, GLM 5.3's in 1.0 s. The dearest reply, Claude Fable 5.1's, cost 291 times as much ($0.0160).
The prompt, as sent, and its check
Checked by final answer, the same way for every model.
A linear equation (everyday)
Solve this math problem step by step. Number the steps, check the result, and end with a line that starts "Final answer:". --- Solve for x: 5x - 7 = 3x + 9
Sent with the AI math solver's own instructions as the system prompt, as a free run of the tool sends them.
The final answer must be 8.
How the AI math solver's test inputs are scored, with every model's results on all five.
Every model's result
All 19 models on this test input, in catalog order.
| Model | Result | Cost | Time | Reply |
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | Passed: Final answer x = 8: right. | $0.0160 | 3.4 s | 231 tokens |
| Claude Opus 5.5Anthropic | Passed: Final answer x = 8: right. | $0.0069 | 4.1 s | 255 tokens |
| Claude Sonnet 5.5Anthropic | Passed: Final answer x = 8: right. | $0.0036 | 2.4 s | 275 tokens |
| Claude Sonnet 5Anthropic | Passed: Final answer x = 8: right. | $0.0037 | 3.2 s | 256 tokens |
| Claude Haiku 5.5Anthropic | Passed: Final answer x = 8: right. | $0.00023 | 2.3 s | 372 tokens |
| Claude Haiku 4.5Anthropic | Passed: Final answer x = 8: right. | $0.0016 | 3.3 s | 249 tokens |
| GPT-6 AstraOpenAI | Passed: Final answer x = 8: right. | $0.0061 | 2.8 s | 174 tokens |
| GPT-6.1 SolOpenAI | Passed: Final answer x = 8: right. | $0.0011 | 2.4 s | 145 tokens |
| GPT-6 SolOpenAI | Passed: Final answer x = 8: right. | $0.0013 | 5.3 s | 119 tokens |
| GPT-6 LunaOpenAI | Passed: Final answer x = 8: right. | $0.000055 | 2.0 s | 132 tokens |
| Gemini 3.1 Pro (preview)Google | Passed: Final answer x = 8: right. | $0.0059 | 8.4 s | 271 tokens |
| Gemini 3.8 FlashGoogle | Passed: Final answer 8: right. | $0.00055 | 1.9 s | 221 tokens |
| DeepSeek V4.1 FlashDeepSeek | Passed: Final answer x = 8: right. | $0.00048 | 1.4 s | 159 tokens |
| DeepSeek V4 ProDeepSeek | Passed: Final answer x = 8: right. | $0.0011 | 1.6 s | 206 tokens |
| Grok 4.7xAI | Passed: Final answer x = 8: right. | $0.0047 | 5.5 s | 195 tokens |
| Kimi K3Moonshot | Passed: Final answer x = 8: right. | $0.0025 | 3.9 s | 208 tokens |
| GLM 5.3Z.ai | Passed: Final answer x = 8: right. | $0.0011 | 1.0 s | 172 tokens |
| GLM 5.3 FlashZ.ai | Passed: Final answer x = 8: right. | $0.00015 | 1.7 s | 188 tokens |
| Mistral Large 4Mistral | Passed: Final answer 8: right. | $0.0024 | 11.8 s | 369 tokens |
Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.
Every reply
Every reply passed: here they are from the cheapest up.
GPT-6 Luna
Passed: Final answer x = 8: right.
1. Start with the equation: 5x - 7 = 3x + 9 2. Subtract 3x from both sides: 2x - 7 = 9 3. Add 7 to both sides: 2x = 16 4. Divide both sides by 2: x = 8 5. Check by substitution: 5(8) - 7 = 40 - 7 = 33 3(8) + 9 = 24 + 9 = 33 Both sides are equal, so the solution checks. Final answer: x = 8
343 tokens in, 152 out (20 of them reasoning) · 2.0 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·
GLM 5.3 Flash
Passed: Final answer x = 8: right.
Reading: solve the linear equation 5x - 7 = 3x + 9 for x. Step 1: Subtract 3x from both sides to collect x terms on the left. 5x - 3x - 7 = 9 2x - 7 = 9 Step 2: Add 7 to both sides. 2x = 9 + 7 2x = 16 Step 3: Divide both sides by 2. x = 16/2 x = 8 Check: substitute x = 8 back into the original equation. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
352 tokens in, 188 out · 1.7 s · $0.0001 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Friendli ·
Claude Haiku 5.5
Passed: Final answer x = 8: right.
1. Start with the equation: 5x - 7 = 3x + 9 2. Subtract 3x from both sides to collect x-terms on the left: 5x - 3x - 7 = 9 2x - 7 = 9 (Reason: subtracting the same quantity from both sides keeps the equation balanced.) 3. Add 7 to both sides to isolate the x-term: 2x - 7 + 7 = 9 + 7 2x = 16 (Reason: adding the same quantity to both sides keeps the equation balanced.) 4. Divide both sides by 2: 2x / 2 = 16 / 2 x = 8 (Reason: dividing both sides by the same nonzero number keeps the equation balanced.) 5. Check by substituting x = 8 into the original equation: Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so x = 8 is correct. 6. The equation is linear, so there is exactly one solution. Final answer: x = 8
448 tokens in, 372 out · 2.3 s · $0.0002 · 1 message on Pro · answered by anthropic/claude-haiku-5.5 via Anthropic ·
DeepSeek V4.1 Flash
Passed: Final answer x = 8: right.
1. Start with the equation: 5x - 7 = 3x + 9 2. Subtract 3x from both sides to collect x terms on the left: 2x - 7 = 9 3. Add 7 to both sides to isolate the x term: 2x = 16 4. Divide both sides by 2: x = 8 5. Check by substituting x = 8 into the original equation: Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides are equal, so the solution is correct. Final answer: x = 8
369 tokens in, 309 out (150 of them reasoning) · 1.4 s · $0.0005 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Together ·
Gemini 3.8 Flash
Passed: Final answer 8: right.
Step 1: Start with the given linear equation. 5x - 7 = 3x + 9 Step 2: Subtract 3x from both sides to get all terms with the variable x on the left side. 5x - 3x - 7 = 9 2x - 7 = 9 Step 3: Add 7 to both sides to isolate the term with the variable. 2x = 9 + 7 2x = 16 Step 4: Divide both sides by 2 to solve for x. x = 16 / 2 x = 8 Check the result: Substitute x = 8 back into the original equation to verify. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: 8
352 tokens in, 221 out · 1.9 s · $0.0005 · 1 message on Pro · answered by google/gemini-3.8-flash via Google AI Studio ·
GPT-6.1 Sol
Passed: Final answer x = 8: right.
1. Subtract 3x from both sides to collect the x terms. 5x - 3x - 7 = 9 2x - 7 = 9 2. Add 7 to both sides to isolate the term with x. 2x = 16 3. Divide both sides by 2. x = 8 4. Check by substituting x = 8 into the original equation. 5(8) - 7 = 40 - 7 = 33 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
343 tokens in, 145 out · 2.4 s · $0.0011 · 1 message on Pro · answered by openai/gpt-6.1-sol via OpenAI ·
DeepSeek V4 Pro
Passed: Final answer x = 8: right.
1. Start with the equation: 5x - 7 = 3x + 9. 2. Subtract 3x from both sides so the x terms are on one side: 5x - 3x - 7 = 3x - 3x + 9 2x - 7 = 9 3. Add 7 to both sides so the constant is on the other side: 2x - 7 + 7 = 9 + 7 2x = 16 4. Divide both sides by 2: 2x/2 = 16/2 x = 8 5. Check by substituting x = 8 into the original equation: Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution checks. Final answer: x = 8
343 tokens in, 244 out (38 of them reasoning) · 1.6 s · $0.0011 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·
GLM 5.3
Passed: Final answer x = 8: right.
1. Start with the equation: 5x - 7 = 3x + 9 2. Subtract 3x from both sides to collect x terms on the left: 5x - 3x - 7 = 9 3. Simplify: 2x - 7 = 9 4. Add 7 to both sides: 2x = 16 5. Divide both sides by 2: x = 8 Check: substitute x = 8 into the original equation. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
352 tokens in, 172 out · 1.0 s · $0.0011 · 1 message on Pro · answered by z-ai/glm-5.3 via Friendli ·
GPT-6 Sol
Passed: Final answer x = 8: right.
1. Subtract 3x from both sides. 2x - 7 = 9 2. Add 7 to both sides. 2x = 16 3. Divide both sides by 2. x = 8 4. Check by substituting x = 8 into the original equation. 5(8) - 7 = 33 3(8) + 9 = 33 Both sides are equal, so the solution checks. Final answer: x = 8
343 tokens in, 196 out (77 of them reasoning) · 5.3 s · $0.0013 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·
Claude Haiku 4.5
Passed: Final answer x = 8: right.
I'll solve this linear equation step by step. 1. Start with the equation: 5x - 7 = 3x + 9 2. Subtract 3x from both sides to collect x terms on the left: 5x - 3x - 7 = 3x - 3x + 9 2x - 7 = 9 3. Add 7 to both sides to isolate the term with x: 2x - 7 + 7 = 9 + 7 2x = 16 4. Divide both sides by 2 to solve for x: x = 16/2 x = 8 Check the result by substituting x = 8 back into the original equation: Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
362 tokens in, 249 out · 3.3 s · $0.0016 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Anthropic ·
Mistral Large 4
Passed: Final answer 8: right.
Step 1: Subtract 3x from both sides to collect the x terms on the left side. 5x - 7 - 3x = 3x + 9 - 3x 2x - 7 = 9 Step 2: Add 7 to both sides to isolate the term with x. 2x - 7 + 7 = 9 + 7 2x = 16 Step 3: Divide both sides by 2 to solve for x. 2x/2 = 16/2 x = 8 Check: Substitute x = 8 back into the original equation to verify. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: 8
348 tokens in, 1,018 out (649 of them reasoning) · 11.8 s · $0.0024 · 1 message on Pro · answered by mistralai/mistral-large-4-0 via Mistral ·
Kimi K3
Passed: Final answer x = 8: right.
1. Start with the equation: 5x - 7 = 3x + 9 2. Subtract 3x from both sides to gather the x-terms on the left (subtracting the same value from both sides keeps the equation balanced): 5x - 3x - 7 = 9 3. Simplify the left side: 2x - 7 = 9 4. Add 7 to both sides to isolate the term with x: 2x = 16 5. Divide both sides by 2 to solve for x: x = 8 6. Check by substituting x = 8 back into the original equation: Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
430 tokens in, 240 out (32 of them reasoning) · 3.9 s · $0.0025 · 1 message on Pro · answered by moonshotai/kimi-k3 via Wafer ·
Claude Sonnet 5.5
Passed: Final answer x = 8: right.
This is a linear equation. The goal is to get x alone on one side. Step 1: Start with the equation. 5x - 7 = 3x + 9 Step 2: Subtract 3x from both sides so the x terms are together on the left. 5x - 3x - 7 = 9 2x - 7 = 9 Step 3: Add 7 to both sides to move the constant to the right. 2x = 9 + 7 2x = 16 Step 4: Divide both sides by 2. x = 16/2 x = 8 Step 5: Check by substituting x = 8 into both sides of the original equation. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
448 tokens in, 275 out · 2.4 s · $0.0036 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·
Claude Sonnet 5
Passed: Final answer x = 8: right.
Step 1: Start with the equation. 5x - 7 = 3x + 9 Step 2: Subtract 3x from both sides to gather x-terms on one side. 5x - 3x - 7 = 9 2x - 7 = 9 Step 3: Add 7 to both sides to isolate the term with x. 2x = 9 + 7 2x = 16 Step 4: Divide both sides by 2 to solve for x. x = 16/2 x = 8 Step 5: Check by substituting x = 8 back into the original equation. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution checks out. Final answer: x = 8
446 tokens in, 280 out (24 of them reasoning) · 3.2 s · $0.0037 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Anthropic ·
Grok 4.7
Passed: Final answer x = 8: right.
Step 1: Subtract 3x from both sides so the variable terms are together on the left. 5x - 7 - 3x = 3x + 9 - 3x 2x - 7 = 9 Step 2: Add 7 to both sides so the constant terms are together on the right. 2x - 7 + 7 = 9 + 7 2x = 16 Step 3: Divide both sides by 2 so x stands alone. 2x / 2 = 16 / 2 x = 8 Check: substitute x = 8 into the original equation. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides match, so the solution is correct. Final answer: x = 8
1,581 tokens in, 546 out (351 of them reasoning) · 5.5 s · $0.0047 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·
Gemini 3.1 Pro
Passed: Final answer x = 8: right.
Here is the step-by-step solution to the problem: Step 1: Write down the original equation. 5x - 7 = 3x + 9 Step 2: Group all terms containing x on one side of the equation. To do this, subtract 3x from both sides. 5x - 3x - 7 = 3x - 3x + 9 2x - 7 = 9 Step 3: Group all the constant numbers on the other side. To do this, add 7 to both sides of the equation. 2x - 7 + 7 = 9 + 7 2x = 16 Step 4: Solve for x by dividing both sides by 2. 2x / 2 = 16 / 2 x = 8 Step 5: Check the result by substituting x = 8 back into the original equation to make sure both sides match. Left side: 5(8) - 7 40 - 7 33 Right side: 3(8) + 9 24 + 9 33 Since both sides equal 33, the solution is correct. Final answer: x = 8
352 tokens in, 920 out (649 of them reasoning) · 8.4 s · $0.0059 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google AI Studio ·
GPT-6 Astra
Passed: Final answer x = 8: right.
1. Subtract 3x from both sides to collect the x terms. 5x - 7 - 3x = 3x + 9 - 3x 2x - 7 = 9 2. Add 7 to both sides to isolate the x term. 2x - 7 + 7 = 9 + 7 2x = 16 3. Divide both sides by 2. x = 16/2 x = 8 4. Check by substituting x = 8 into the original equation. 5(8) - 7 = 40 - 7 = 33 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
343 tokens in, 174 out · 2.8 s · $0.0061 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·
Claude Opus 5.5
Passed: Final answer x = 8: right.
Step 1. Start with the equation. 5x - 7 = 3x + 9 Step 2. Subtract 3x from both sides so the x terms are on one side. 5x - 3x - 7 = 9 2x - 7 = 9 Step 3. Add 7 to both sides to isolate the x term. 2x = 9 + 7 2x = 16 Step 4. Divide both sides by 2 to solve for x. x = 16/2 x = 8 Check: Substitute x = 8 into both sides of the original equation. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so x = 8 is correct. Final answer: x = 8
448 tokens in, 255 out · 4.1 s · $0.0069 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Google ·
Claude Fable 5.1
Passed: Final answer x = 8: right.
1. Start with the equation: 5x - 7 = 3x + 9 2. Subtract 3x from both sides to collect the x terms on the left: 5x - 3x - 7 = 9 2x - 7 = 9 3. Add 7 to both sides to isolate the x term: 2x = 9 + 7 2x = 16 4. Divide both sides by 2: x = 16/2 x = 8 Check: substitute x = 8 into the original equation. Left side: 5(8) - 7 = 40 - 7 = 33 Right side: 3(8) + 9 = 24 + 9 = 33 Both sides equal 33, so the solution is correct. Final answer: x = 8
448 tokens in, 231 out · 3.4 s · $0.0160 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Google ·
More AI math solver test inputs
The other AI math solver test inputs, each with every model's reply, and the results across all five.
Questions
Which AI does best on “A linear equation”?
All 19 models passed this AI math solver test input's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.000055; the fastest, GLM 5.3's in 1.0 s. The dearest reply, Claude Fable 5.1's, cost 291 times as much ($0.0160).
What does a reply to “A linear equation” cost?
Through the models' APIs, what OpenRouter charged us ran from $0.000055 (GPT-6 Luna) to $0.0160 (Claude Fable 5.1) for this test input. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.