Tested prompt · Data analysis
Average order value in August: every AI model's reply, tested
We sent this everyday data analysis prompt to all 16 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.
Based on 16 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .
Short answer
15 of 16 models passed this data analysis prompt's check (final answer); Claude Haiku 4.5 didn't. The cheapest reply that passed was GPT-6 Luna's, at $0.00013; the fastest, Claude Sonnet 5.5's in 1.7 s. The dearest reply, Claude Fable 5.1's, cost 161 times as much ($0.0209).
The prompt, as sent, and its check
Checked by final answer, the same way for every model.
Average order value in August (everyday)
Here are some orders as CSV. Revenue is quantity times price. What was the average revenue per order in August 2026, to 2 decimal places? [14 lines every data analysis prompt of ours shares, word for word: the whole prompt, on the methods page]
The final answer must be 300.
Exactly what this prompt's replies are checked against, with every other prompt of our test runs.
Every model's result
All 16 models on this prompt, in catalog order.
| Model | Result | Cost | Time | Reply |
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | Passed: Final answer 300.00: right. | $0.0209 | 3.3 s | 216 tokens |
| Claude Opus 5.5Anthropic | Passed: Final answer 300.00: right. | $0.0107 | 4.4 s | 240 tokens |
| Claude Sonnet 5.5Anthropic | Passed: Final answer 300.00: right. | $0.0037 | 1.7 s | 170 tokens |
| Claude Sonnet 5Anthropic | Passed: Final answer 300.00: right. | $0.0041 | 3.9 s | 135 tokens |
| Claude Haiku 4.5Anthropic | Failed: Final answer 275.00; expected 300. | $0.0023 | 2.1 s | 326 tokens |
| GPT-6 AstraOpenAI | Passed: Final answer 300.00: right. | $0.0104 | 2.5 s | 58 tokens |
| GPT-6 SolOpenAI | Passed: Final answer 300.00: right. | $0.0025 | 2.8 s | 65 tokens |
| GPT-6 LunaOpenAI | Passed: Final answer 300.00: right. | $0.00013 | 2.6 s | 64 tokens |
| Gemini 3.1 Pro (preview)Google | Passed: Final answer 300.00: right. | $0.0130 | 8.6 s | 273 tokens |
| Gemini 3.8 FlashGoogle | Passed: Final answer 300.00: right. | $0.0016 | 4.4 s | 272 tokens |
| DeepSeek V4.1 FlashDeepSeek | Passed: Final answer 300.00: right. | $0.00029 | 2.0 s | 156 tokens |
| DeepSeek V4 ProDeepSeek | Passed: Final answer 300.00: right. | $0.0021 | 3.7 s | 151 tokens |
| Grok 4.7xAI | Passed: Final answer 300.00: right. | $0.0037 | 5.5 s | 157 tokens |
| Kimi K3Moonshot | Passed: Final answer 300.00: right. | $0.0054 | 2.7 s | 79 tokens |
| GLM 5.3Z.ai | Passed: Final answer 300.00: right. | $0.00037 | 1.9 s | 164 tokens |
| GLM 5.3 FlashZ.ai | Passed: Final answer 300.00: right. | $0.00037 | 14.5 s | 201 tokens |
Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.
Every reply
The reply that failed first, then the ones that passed, from the cheapest up.
Claude Haiku 4.5
Failed: Final answer 275.00; expected 300.
I'll find the average revenue per order for August 2026. **August 2026 orders:** | order_id | date | quantity | price | revenue | |----------|------|----------|-------|---------| | 1007 | 2026-08-02 | 2 | 45.00 | 90.00 | | 1008 | 2026-08-06 | 1 | 310.00 | 310.00 | | 1009 | 2026-08-11 | 2 | 310.00 | 620.00 | | 1010 | 2026-08-15 | 5 | 45.00 | 225.00 | | 1011 | 2026-08-19 | 3 | 120.00 | 360.00 | | 1012 | 2026-08-27 | 1 | 45.00 | 45.00 | **Calculation:** - Total revenue: 90 + 310 + 620 + 225 + 360 + 45 = 1,650.00 - Number of orders: 6 - Average revenue per order: 1,650.00 ÷ 6 = 275.00 Final answer: 275.00
683 tokens in, 326 out · 2.1 s · $0.0023 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·
GPT-6 Luna
Passed: Final answer 300.00: right.
August revenue: $240 + $310 + $620 + $225 + $360 + $45 = $1,800. There were 6 orders, so the average is $1,800 ÷ 6 = $300.00. Final answer: $300.00
647 tokens in, 131 out (67 of them reasoning) · 2.6 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·
DeepSeek V4.1 Flash
Passed: Final answer 300.00: right.
August 2026 orders (1007–1012): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total = 1,800.00 across 6 orders → 1,800.00 / 6 = 300.00 Final answer: 300.00
690 tokens in, 267 out (111 of them reasoning) · 2.0 s · $0.0003 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via StreamLake ·
GLM 5.3
Passed: Final answer 300.00: right.
August 2026 orders and revenue (quantity × price): - 1007: 2 × 120 = 240.00 - 1008: 1 × 310 = 310.00 - 1009: 2 × 310 = 620.00 - 1010: 5 × 45 = 225.00 - 1011: 3 × 120 = 360.00 - 1012: 1 × 45 = 45.00 Total = 240 + 310 + 620 + 225 + 360 + 45 = 1800.00 Orders = 6 Average = 1800 / 6 = 300.00 Final answer: 300.00
661 tokens in, 164 out · 1.9 s · $0.0004 · 1 message on Pro · answered by z-ai/glm-5.3 via Baidu ·
GLM 5.3 Flash
Passed: Final answer 300.00: right.
**August 2026 orders (1007–1012):** | Order | Qty × Price | Revenue | |-------|-------------|---------| | 1007 | 2 × 120.00 | 240.00 | | 1008 | 1 × 310.00 | 310.00 | | 1009 | 2 × 310.00 | 620.00 | | 1010 | 5 × 45.00 | 225.00 | | 1011 | 3 × 120.00 | 360.00 | | 1012 | 1 × 45.00 | 45.00 | Total revenue = 240 + 310 + 620 + 225 + 360 + 45 = **1,800.00** Number of orders = **6** Average = 1,800.00 ÷ 6 = **300.00** Final answer: 300.00
662 tokens in, 372 out (171 of them reasoning) · 14.5 s · $0.0004 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Wafer ·
Gemini 3.8 Flash
Passed: Final answer 300.00: right.
**Working:** Orders in August 2026: * 1007: 2 × 120.00 = 240.00 * 1008: 1 × 310.00 = 310.00 * 1009: 2 × 310.00 = 620.00 * 1010: 5 × 45.00 = 225.00 * 1011: 3 × 120.00 = 360.00 * 1012: 1 × 45.00 = 45.00 Total revenue = 240.00 + 310.00 + 620.00 + 225.00 + 360.00 + 45.00 = 1,800.00 Number of orders = 6 Average revenue per order = 1,800.00 / 6 = 300.00 Final answer: 300.00
779 tokens in, 272 out · 4.4 s · $0.0016 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·
DeepSeek V4 Pro
Passed: Final answer 300.00: right.
August 2026 orders (6 total): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total revenue = 1800.00 Average = 1800.00 / 6 = 300.00 Final answer: 300.00
662 tokens in, 298 out (147 of them reasoning) · 3.7 s · $0.0021 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via AtlasCloud ·
GPT-6 Sol
Passed: Final answer 300.00: right.
August’s six orders had revenues of $240, $310, $620, $225, $360, and $45. Their total was $1,800, so the average was $1,800 ÷ 6 = $300.00. Final answer: $300.00
647 tokens in, 120 out (55 of them reasoning) · 2.8 s · $0.0025 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·
Grok 4.7
Passed: Final answer 300.00: right.
August 2026 orders and revenue (quantity × price): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total revenue = 1800.00 across 6 orders. Average = 1800.00 / 6 = 300.00. Final answer: 300.00
1,883 tokens in, 496 out (339 of them reasoning) · 5.5 s · $0.0037 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·
Claude Sonnet 5.5
Passed: Final answer 300.00: right.
August 2026 orders (1007–1012): - 1007: 2 × 120 = 240 - 1008: 1 × 310 = 310 - 1009: 2 × 310 = 620 - 1010: 5 × 45 = 225 - 1011: 3 × 120 = 360 - 1012: 1 × 45 = 45 Total = 240 + 310 + 620 + 225 + 360 + 45 = 1800 Average = 1800 / 6 = 300.00 Final answer: 300.00
825 tokens in, 170 out · 1.7 s · $0.0037 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·
Claude Sonnet 5
Passed: Final answer 300.00: right.
Working: - 1007: 2×120=240 - 1008: 1×310=310 - 1009: 2×310=620 - 1010: 5×45=225 - 1011: 3×120=360 - 1012: 1×45=45 Sum = 240+310+620+225+360+45 = 1800 Count = 6 orders Average = 1800/6 = 300.00 Final answer: 300.00
821 tokens in, 243 out (108 of them reasoning) · 3.9 s · $0.0041 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·
Kimi K3
Passed: Final answer 300.00: right.
August 2026 orders: 1007–1012 Revenues: 240, 310, 620, 225, 360, 45 Total = 1800; orders = 6; average = 1800 / 6 = 300.00 Final answer: 300.00
735 tokens in, 234 out (155 of them reasoning) · 2.7 s · $0.0054 · 1 message on Pro · answered by moonshotai/kimi-k3 via Together ·
GPT-6 Astra
Passed: Final answer 300.00: right.
August revenues: 240 + 310 + 620 + 225 + 360 + 45 = 1,800. Average revenue per order = 1,800 ÷ 6 = 300.00. Final answer: 300.00
647 tokens in, 78 out (20 of them reasoning) · 2.5 s · $0.0104 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·
Claude Opus 5.5
Passed: Final answer 300.00: right.
August 2026 orders (revenue = quantity × price): | Order | Calculation | Revenue | |---|---|---| | 1007 | 2 × 120.00 | 240.00 | | 1008 | 1 × 310.00 | 310.00 | | 1009 | 2 × 310.00 | 620.00 | | 1010 | 5 × 45.00 | 225.00 | | 1011 | 3 × 120.00 | 360.00 | | 1012 | 1 × 45.00 | 45.00 | - **Total:** 1,800.00 - **Orders:** 6 - **Average:** 1,800.00 ÷ 6 = 300.00 Final answer: 300.00
823 tokens in, 332 out (92 of them reasoning) · 4.4 s · $0.0107 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·
Gemini 3.1 Pro
Passed: Final answer 300.00: right.
Here are the orders for August 2026 and their calculated revenue (quantity × price): * Order 1007: 2 × $120.00 = $240.00 * Order 1008: 1 × $310.00 = $310.00 * Order 1009: 2 × $310.00 = $620.00 * Order 1010: 5 × $45.00 = $225.00 * Order 1011: 3 × $120.00 = $360.00 * Order 1012: 1 × $45.00 = $45.00 Total revenue for August = $240 + $310 + $620 + $225 + $360 + $45 = $1800.00 Number of orders in August = 6 Average revenue per order = $1800.00 / 6 = $300.00 Final answer: 300.00
779 tokens in, 955 out (682 of them reasoning) · 8.6 s · $0.0130 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·
Claude Fable 5.1
Passed: Final answer 300.00: right.
August 2026 orders and revenue (quantity × price): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total revenue = 240 + 310 + 620 + 225 + 360 + 45 = 1,800.00 Number of orders = 6 Average = 1,800.00 / 6 = 300.00 Final answer: 300.00
823 tokens in, 216 out · 3.3 s · $0.0209 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·
More data analysis prompts
The other data analysis prompts, each with every model's reply.
Questions
Which AI does best on “Average order value in August”?
15 of 16 models passed this data analysis prompt's check (final answer); Claude Haiku 4.5 didn't. The cheapest reply that passed was GPT-6 Luna's, at $0.00013; the fastest, Claude Sonnet 5.5's in 1.7 s. The dearest reply, Claude Fable 5.1's, cost 161 times as much ($0.0209).
What does a reply to “Average order value in August” cost?
Through the models' APIs, what OpenRouter charged us ran from $0.00013 (GPT-6 Luna) to $0.0209 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, and GLM, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.