Tested prompt · Data analysis
Revenue change from July to August: every AI model's reply, tested
We sent this everyday data analysis prompt to all 16 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.
Based on 16 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .
Short answer
All 16 models passed this data analysis prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.00013; the fastest, GLM 5.3's in 1.4 s. The dearest reply, Claude Fable 5.1's, cost 175 times as much ($0.0232).
The prompt, as sent, and its check
Checked by final answer, the same way for every model.
Revenue change from July to August (everyday)
Here are some orders as CSV. Revenue is quantity times price. By what percentage did total revenue change from July 2026 to August 2026? Round to one decimal place. [14 lines every data analysis prompt of ours shares, word for word: the whole prompt, on the methods page]
The final answer must be 67.4.
Exactly what this prompt's replies are checked against, with every other prompt of our test runs.
Every model's result
All 16 models on this prompt, in catalog order.
| Model | Result | Cost | Time | Reply |
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | Passed: Final answer 67.4%: right. | $0.0232 | 4.9 s | 259 tokens |
| Claude Opus 5.5Anthropic | Passed: Final answer 67.4%: right. | $0.0120 | 5.1 s | 309 tokens |
| Claude Sonnet 5.5Anthropic | Passed: Final answer 67.4%: right. | $0.0048 | 2.3 s | 273 tokens |
| Claude Sonnet 5Anthropic | Passed: Final answer 67.4%: right. | $0.0062 | 5.3 s | 251 tokens |
| Claude Haiku 4.5Anthropic | Passed: Final answer 67.4%: right. | $0.0022 | 4.2 s | 309 tokens |
| GPT-6 AstraOpenAI | Passed: Final answer 67.4% increase: right. | $0.0150 | 3.6 s | 111 tokens |
| GPT-6 SolOpenAI | Passed: Final answer 67.4% increase: right. | $0.0025 | 2.8 s | 64 tokens |
| GPT-6 LunaOpenAI | Passed: Final answer 67.4% increase: right. | $0.00013 | 2.5 s | 66 tokens |
| Gemini 3.1 Pro (preview)Google | Passed: Final answer 67.4%: right. | $0.0135 | 9.0 s | 356 tokens |
| Gemini 3.8 FlashGoogle | Passed: Final answer 67.4%: right. | $0.0037 | 6.6 s | 439 tokens |
| DeepSeek V4.1 FlashDeepSeek | Passed: Final answer +67.4%: right. | $0.00031 | 10.2 s | 357 tokens |
| DeepSeek V4 ProDeepSeek | Passed: Final answer 67.4%: right. | $0.0017 | 2.5 s | 95 tokens |
| Grok 4.7xAI | Passed: Final answer 67.4%: right. | $0.0071 | 10.1 s | 115 tokens |
| Kimi K3Moonshot | Passed: Final answer 67.4%: right. | $0.0064 | 6.4 s | 101 tokens |
| GLM 5.3Z.ai | Passed: Final answer 67.4%: right. | $0.0016 | 1.4 s | 156 tokens |
| GLM 5.3 FlashZ.ai | Passed: Final answer 67.4%: right. | $0.00037 | 9.8 s | 193 tokens |
Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.
Every reply
Every reply passed: here they are from the cheapest up.
GPT-6 Luna
Passed: Final answer 67.4% increase: right.
July revenue: $1,075.00. August revenue: $1,800.00. Percentage change = (($1,800 − $1,075) ÷ $1,075) × 100 = 67.4% increase. Final answer: 67.4% increase
652 tokens in, 135 out (69 of them reasoning) · 2.5 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·
DeepSeek V4.1 Flash
Passed: Final answer +67.4%: right.
**July 2026 revenue:** - 1001: 2×45 = 90 - 1002: 1×120 = 120 - 1003: 1×310 = 310 - 1004: 4×45 = 180 - 1005: 3×45 = 135 - 1006: 2×120 = 240 - **Total = 1,075** **August 2026 revenue:** - 1007: 2×120 = 240 - 1008: 1×310 = 310 - 1009: 2×310 = 620 - 1010: 5×45 = 225 - 1011: 3×120 = 360 - 1012: 1×45 = 45 - **Total = 1,800** **Change:** (1,800 − 1,075) / 1,075 = 725 / 1,075 ≈ 0.6744 → +67.4% Final answer: +67.4%
695 tokens in, 456 out (99 of them reasoning) · 10.2 s · $0.0003 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Relace ·
GLM 5.3 Flash
Passed: Final answer 67.4%: right.
**July 2026 revenue:** - 2×45 = 90 - 1×120 = 120 - 1×310 = 310 - 4×45 = 180 - 3×45 = 135 - 2×120 = 240 - Total = **1075** **August 2026 revenue:** - 2×120 = 240 - 1×310 = 310 - 2×310 = 620 - 5×45 = 225 - 3×120 = 360 - 1×45 = 45 - Total = **1800** **Percentage change:** (1800 − 1075) / 1075 × 100 = 725 / 1075 × 100 ≈ 67.4419% → 67.4% Final answer: 67.4%
667 tokens in, 424 out (231 of them reasoning) · 9.8 s · $0.0004 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Wafer ·
GLM 5.3
Passed: Final answer 67.4%: right.
**July 2026 revenue:** - 2×45=90, 1×120=120, 1×310=310, 4×45=180, 3×45=135, 2×120=240 → **$1,075** **August 2026 revenue:** - 2×120=240, 1×310=310, 2×310=620, 5×45=225, 3×120=360, 1×45=45 → **$1,800** **Change:** (1800 − 1075) / 1075 = 725/1075 ≈ 0.6744 Final answer: 67.4%
690 tokens in, 218 out (62 of them reasoning) · 1.4 s · $0.0016 · 1 message on Pro · answered by z-ai/glm-5.3 via Wafer ·
DeepSeek V4 Pro
Passed: Final answer 67.4%: right.
July revenue: - 90 + 120 + 310 + 180 + 135 + 240 = **1075** August revenue: - 240 + 310 + 620 + 225 + 360 + 45 = **1800** Change = (1800 − 1075) / 1075 × 100 = 725 / 1075 × 100 ≈ **67.4%** Final answer: 67.4%
667 tokens in, 431 out (336 of them reasoning) · 2.5 s · $0.0017 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·
Claude Haiku 4.5
Passed: Final answer 67.4%: right.
I'll calculate the revenue for each order, then sum by month. **July 2026 orders:** - 1001: 2 × $45 = $90 - 1002: 1 × $120 = $120 - 1003: 1 × $310 = $310 - 1004: 4 × $45 = $180 - 1005: 3 × $45 = $135 - 1006: 2 × $120 = $240 **July total: $1,075** **August 2026 orders:** - 1007: 2 × $120 = $240 - 1008: 1 × $310 = $310 - 1009: 2 × $310 = $620 - 1010: 5 × $45 = $225 - 1011: 3 × $120 = $360 - 1012: 1 × $45 = $45 **August total: $1,800** **Percentage change:** $$\frac{1,800 - 1,075}{1,075} × 100 = \frac{725}{1,075} × 100 = 67.4\%$$ Final answer: 67.4%688 tokens in, 309 out · 4.2 s · $0.0022 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·
GPT-6 Sol
Passed: Final answer 67.4% increase: right.
July revenue: $1,075. August revenue: $1,800. Percentage change: \((1,800 - 1,075) \div 1,075 \times 100 = 67.4\%\). Final answer: 67.4% increase
652 tokens in, 118 out (54 of them reasoning) · 2.8 s · $0.0025 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·
Gemini 3.8 Flash
Passed: Final answer 67.4%: right.
**July 2026 Revenue:** * Order 1001: 2 × 45.00 = $90.00 * Order 1002: 1 × 120.00 = $120.00 * Order 1003: 1 × 310.00 = $310.00 * Order 1004: 4 × 45.00 = $180.00 * Order 1005: 3 × 45.00 = $135.00 * Order 1006: 2 × 120.00 = $240.00 * **July Total:** $1,075.00 **August 2026 Revenue:** * Order 1007: 2 × 120.00 = $240.00 * Order 1008: 1 × 310.00 = $310.00 * Order 1009: 2 × 310.00 = $620.00 * Order 1010: 5 × 45.00 = $225.00 * Order 1011: 3 × 120.00 = $360.00 * Order 1012: 1 × 45.00 = $45.00 * **August Total:** $1,800.00 **Percentage Change:** $$\frac{1,800 - 1,075}{1,075} \times 100 = \frac{725}{1,075} \times 100 \approx 67.4\%$$ Final answer: 67.4%786 tokens in, 820 out (381 of them reasoning) · 6.6 s · $0.0037 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·
Claude Sonnet 5.5
Passed: Final answer 67.4%: right.
**July:** - 1001: 2 × 45 = 90 - 1002: 1 × 120 = 120 - 1003: 1 × 310 = 310 - 1004: 4 × 45 = 180 - 1005: 3 × 45 = 135 - 1006: 2 × 120 = 240 July total = 1075 **August:** - 1007: 2 × 120 = 240 - 1008: 1 × 310 = 310 - 1009: 2 × 310 = 620 - 1010: 5 × 45 = 225 - 1011: 3 × 120 = 360 - 1012: 1 × 45 = 45 August total = 1800 **Change:** (1800 − 1075) / 1075 = 725 / 1075 ≈ 0.67442 → 67.4% Final answer: 67.4%
833 tokens in, 273 out · 2.3 s · $0.0048 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·
Claude Sonnet 5
Passed: Final answer 67.4%: right.
**July 2026 Revenue:** - 1001: 2×45=90 - 1002: 1×120=120 - 1003: 1×310=310 - 1004: 4×45=180 - 1005: 3×45=135 - 1006: 2×120=240 - **Total = 1075** **August 2026 Revenue:** - 1007: 2×120=240 - 1008: 1×310=310 - 1009: 2×310=620 - 1010: 5×45=225 - 1011: 3×120=360 - 1012: 1×45=45 - **Total = 1800** **Percentage change:** (1800 − 1075) / 1075 × 100 = 725/1075 × 100 ≈ 67.4% Final answer: 67.4%
829 tokens in, 455 out (204 of them reasoning) · 5.3 s · $0.0062 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·
Kimi K3
Passed: Final answer 67.4%: right.
July revenue: 90 + 120 + 310 + 180 + 135 + 240 = 1075 August revenue: 240 + 310 + 620 + 225 + 360 + 45 = 1800 Change: (1800 − 1075) / 1075 × 100 = 67.441...% ≈ 67.4% increase Final answer: 67.4%
740 tokens in, 415 out (314 of them reasoning) · 6.4 s · $0.0064 · 1 message on Pro · answered by moonshotai/kimi-k3 via Phala ·
Grok 4.7
Passed: Final answer 67.4%: right.
July revenue: 2×45 + 1×120 + 1×310 + 4×45 + 3×45 + 2×120 = 1075. August revenue: 2×120 + 1×310 + 2×310 + 5×45 + 3×120 + 1×45 = 1800. Change: (1800 − 1075) / 1075 × 100 = 67.441…% → 67.4%. Final answer: 67.4%
1,888 tokens in, 1,134 out (1,019 of them reasoning) · 10.1 s · $0.0071 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·
Claude Opus 5.5
Passed: Final answer 67.4%: right.
**July 2026 revenue:** - 1001: 2 × 45 = 90 - 1002: 1 × 120 = 120 - 1003: 1 × 310 = 310 - 1004: 4 × 45 = 180 - 1005: 3 × 45 = 135 - 1006: 2 × 120 = 240 - **Total = 1,075.00** **August 2026 revenue:** - 1007: 2 × 120 = 240 - 1008: 1 × 310 = 310 - 1009: 2 × 310 = 620 - 1010: 5 × 45 = 225 - 1011: 3 × 120 = 360 - 1012: 1 × 45 = 45 - **Total = 1,800.00** **Change:** (1,800 − 1,075) / 1,075 × 100 = 725 / 1,075 × 100 ≈ 67.44%, an increase. Final answer: 67.4%
831 tokens in, 396 out (87 of them reasoning) · 5.1 s · $0.0120 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·
Gemini 3.1 Pro
Passed: Final answer 67.4%: right.
**July 2026 Revenue:** * Order 1001: 2 x $45 = $90 * Order 1002: 1 x $120 = $120 * Order 1003: 1 x $310 = $310 * Order 1004: 4 x $45 = $180 * Order 1005: 3 x $45 = $135 * Order 1006: 2 x $120 = $240 * **July Total:** $1,075 **August 2026 Revenue:** * Order 1007: 2 x $120 = $240 * Order 1008: 1 x $310 = $310 * Order 1009: 2 x $310 = $620 * Order 1010: 5 x $45 = $225 * Order 1011: 3 x $120 = $360 * Order 1012: 1 x $45 = $45 * **August Total:** $1,800 **Percentage Change:** ((1800 - 1075) / 1075) * 100 = (725 / 1075) * 100 = 67.4418...% Final answer: 67.4%
786 tokens in, 990 out (634 of them reasoning) · 9.0 s · $0.0135 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·
GPT-6 Astra
Passed: Final answer 67.4% increase: right.
July revenue: \(90 + 120 + 310 + 180 + 135 + 240 = \$1{,}075\) August revenue: \(240 + 310 + 620 + 225 + 360 + 45 = \$1{,}800\) Percentage change: \(\frac{1{,}800 - 1{,}075}{1{,}075} \times 100 = 67.4\%\) Final answer: 67.4% increase652 tokens in, 169 out (58 of them reasoning) · 3.6 s · $0.0150 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·
Claude Fable 5.1
Passed: Final answer 67.4%: right.
July revenue: - 1001: 2×45 = 90 - 1002: 1×120 = 120 - 1003: 1×310 = 310 - 1004: 4×45 = 180 - 1005: 3×45 = 135 - 1006: 2×120 = 240 - Total: 1,075 August revenue: - 1007: 2×120 = 240 - 1008: 1×310 = 310 - 1009: 2×310 = 620 - 1010: 5×45 = 225 - 1011: 3×120 = 360 - 1012: 1×45 = 45 - Total: 1,800 Change: (1,800 − 1,075) / 1,075 = 725 / 1,075 ≈ 0.6744 → 67.4% increase Final answer: 67.4%
831 tokens in, 259 out · 4.9 s · $0.0232 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·
More data analysis prompts
The other data analysis prompts, each with every model's reply.
Questions
Which AI does best on “Revenue change from July to August”?
All 16 models passed this data analysis prompt's check (final answer). The cheapest reply that passed was GPT-6 Luna's, at $0.00013; the fastest, GLM 5.3's in 1.4 s. The dearest reply, Claude Fable 5.1's, cost 175 times as much ($0.0232).
What does a reply to “Revenue change from July to August” cost?
Through the models' APIs, what OpenRouter charged us ran from $0.00013 (GPT-6 Luna) to $0.0232 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, and GLM, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.