Tested prompt · Data analysis
Average order value in August: every AI model's reply, tested
We sent this everyday data analysis prompt to all 20 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.
Based on 20 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .
Short answer
19 of 20 models passed this data analysis prompt's check (final answer); Claude Haiku 4.5 didn't. The cheapest reply that passed was GPT-6 Luna's, at $0.00013; the fastest, DeepSeek V4.1 Flash's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 161 times as much ($0.0209).
The prompt, as sent, and its check
Checked by final answer, the same way for every model.
Average order value in August (everyday)
Here are some orders as CSV. Revenue is quantity times price. What was the average revenue per order in August 2026, to 2 decimal places? [14 lines every data analysis prompt of ours shares, word for word: the whole prompt, on the methods page]
The final answer must be 300.
Exactly what this prompt's replies are checked against, with every other prompt of our test runs.
Every model's result
All 20 models on this prompt, in catalog order.
| Model | Result | Cost | Time | Reply |
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | Passed: Final answer 300.00: right. | $0.0209 | 3.3 s | 216 tokens |
| Claude Opus 5.5Anthropic | Passed: Final answer 300.00: right. | $0.0107 | 4.4 s | 240 tokens |
| Claude Sonnet 5.5Anthropic | Passed: Final answer 300.00: right. | $0.0037 | 1.7 s | 170 tokens |
| Claude Sonnet 5Anthropic | Passed: Final answer 300.00: right. | $0.0041 | 3.9 s | 135 tokens |
| Claude Haiku 5.5Anthropic | Passed: Final answer 300.00: right. | $0.00021 | 1.3 s | 208 tokens |
| Claude Haiku 4.5Anthropic | Failed: Final answer 275.00; expected 300. | $0.0023 | 2.1 s | 326 tokens |
| GPT-6 AstraOpenAI | Passed: Final answer 300.00: right. | $0.0104 | 2.5 s | 58 tokens |
| GPT-6.1 SolOpenAI | Passed: Final answer 300.00: right. | $0.0011 | 2.1 s | 67 tokens |
| GPT-6 SolOpenAI | Passed: Final answer 300.00: right. | $0.0025 | 2.8 s | 65 tokens |
| GPT-6 LunaOpenAI | Passed: Final answer 300.00: right. | $0.00013 | 2.6 s | 64 tokens |
| Gemini 4 ArgonGoogle | Passed: Final answer 300.00: right. | $0.0027 | 5.6 s | 345 tokens |
| Gemini 3.1 Pro (preview)Google | Passed: Final answer 300.00: right. | $0.0130 | 8.6 s | 273 tokens |
| Gemini 3.8 FlashGoogle | Passed: Final answer 300.00: right. | $0.0016 | 4.4 s | 272 tokens |
| DeepSeek V4.1 FlashDeepSeek | Passed: Final answer 300.00: right. | $0.00045 | 0.9 s | 153 tokens |
| DeepSeek V4 ProDeepSeek | Passed: Final answer 300.00: right. | $0.0012 | 2.2 s | 61 tokens |
| Grok 4.7xAI | Passed: Final answer 300.00: right. | $0.0072 | 9.1 s | 149 tokens |
| Kimi K3Moonshot | Passed: Final answer 300.00: right. | $0.0054 | 2.7 s | 79 tokens |
| GLM 5.3Z.ai | Passed: Final answer 300.00: right. | $0.00037 | 1.9 s | 164 tokens |
| GLM 5.3 FlashZ.ai | Passed: Final answer 300.00: right. | $0.00037 | 14.5 s | 201 tokens |
| Mistral Large 4Mistral | Passed: Final answer 300.00: right. | $0.0021 | 20.4 s | 375 tokens |
Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.
Every reply
The reply that failed first, then the ones that passed, from the cheapest up.
Claude Haiku 4.5
Failed: Final answer 275.00; expected 300.
I'll find the average revenue per order for August 2026. **August 2026 orders:** | order_id | date | quantity | price | revenue | |----------|------|----------|-------|---------| | 1007 | 2026-08-02 | 2 | 45.00 | 90.00 | | 1008 | 2026-08-06 | 1 | 310.00 | 310.00 | | 1009 | 2026-08-11 | 2 | 310.00 | 620.00 | | 1010 | 2026-08-15 | 5 | 45.00 | 225.00 | | 1011 | 2026-08-19 | 3 | 120.00 | 360.00 | | 1012 | 2026-08-27 | 1 | 45.00 | 45.00 | **Calculation:** - Total revenue: 90 + 310 + 620 + 225 + 360 + 45 = 1,650.00 - Number of orders: 6 - Average revenue per order: 1,650.00 ÷ 6 = 275.00 Final answer: 275.00
683 tokens in, 326 out · 2.1 s · $0.0023 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·
GPT-6 Luna
Passed: Final answer 300.00: right.
August revenue: $240 + $310 + $620 + $225 + $360 + $45 = $1,800. There were 6 orders, so the average is $1,800 ÷ 6 = $300.00. Final answer: $300.00
647 tokens in, 131 out (67 of them reasoning) · 2.6 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·
Claude Haiku 5.5
Passed: Final answer 300.00: right.
August orders (1007–1012): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total revenue: 240 + 310 + 620 + 225 + 360 + 45 = 1,800.00 Number of orders: 6 Average: 1,800.00 / 6 = 300.00 Final answer: 300.00
824 tokens in, 208 out · 1.3 s · $0.0002 · 1 message on Pro · answered by anthropic/claude-haiku-5.5 via Anthropic ·
GLM 5.3
Passed: Final answer 300.00: right.
August 2026 orders and revenue (quantity × price): - 1007: 2 × 120 = 240.00 - 1008: 1 × 310 = 310.00 - 1009: 2 × 310 = 620.00 - 1010: 5 × 45 = 225.00 - 1011: 3 × 120 = 360.00 - 1012: 1 × 45 = 45.00 Total = 240 + 310 + 620 + 225 + 360 + 45 = 1800.00 Orders = 6 Average = 1800 / 6 = 300.00 Final answer: 300.00
661 tokens in, 164 out · 1.9 s · $0.0004 · 1 message on Pro · answered by z-ai/glm-5.3 via Baidu ·
GLM 5.3 Flash
Passed: Final answer 300.00: right.
**August 2026 orders (1007–1012):** | Order | Qty × Price | Revenue | |-------|-------------|---------| | 1007 | 2 × 120.00 | 240.00 | | 1008 | 1 × 310.00 | 310.00 | | 1009 | 2 × 310.00 | 620.00 | | 1010 | 5 × 45.00 | 225.00 | | 1011 | 3 × 120.00 | 360.00 | | 1012 | 1 × 45.00 | 45.00 | Total revenue = 240 + 310 + 620 + 225 + 360 + 45 = **1,800.00** Number of orders = **6** Average = 1,800.00 ÷ 6 = **300.00** Final answer: 300.00
662 tokens in, 372 out (171 of them reasoning) · 14.5 s · $0.0004 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Wafer ·
DeepSeek V4.1 Flash
Passed: Final answer 300.00: right.
August 2026 orders (1007–1012): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total = 1800.00 across 6 orders → 1800 / 6 = 300.00 Final answer: 300.00
690 tokens in, 264 out (111 of them reasoning) · 0.9 s · $0.0004 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Together ·
GPT-6.1 Sol
Passed: Final answer 300.00: right.
August order revenues: 240, 310, 620, 225, 360, and 45. Total revenue = 1,800 across 6 orders. Average revenue per order = 1,800 ÷ 6 = 300.00. Final answer: 300.00
649 tokens in, 92 out (25 of them reasoning) · 2.1 s · $0.0011 · 1 message on Pro · answered by openai/gpt-6.1-sol via OpenAI ·
DeepSeek V4 Pro
Passed: Final answer 300.00: right.
August 2026 revenues: 240, 310, 620, 225, 360, 45 Total = 1800.00, orders = 6 Average = 1800.00 / 6 = 300.00 Final answer: 300.00
662 tokens in, 244 out (183 of them reasoning) · 2.2 s · $0.0012 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·
Gemini 3.8 Flash
Passed: Final answer 300.00: right.
**Working:** Orders in August 2026: * 1007: 2 × 120.00 = 240.00 * 1008: 1 × 310.00 = 310.00 * 1009: 2 × 310.00 = 620.00 * 1010: 5 × 45.00 = 225.00 * 1011: 3 × 120.00 = 360.00 * 1012: 1 × 45.00 = 45.00 Total revenue = 240.00 + 310.00 + 620.00 + 225.00 + 360.00 + 45.00 = 1,800.00 Number of orders = 6 Average revenue per order = 1,800.00 / 6 = 300.00 Final answer: 300.00
779 tokens in, 272 out · 4.4 s · $0.0016 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·
Mistral Large 4
Passed: Final answer 300.00: right.
August 2026 orders: - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total revenue: 240 + 310 + 620 + 225 + 360 + 45 = 1800.00 Number of orders: 6 Average: 1800.00 / 6 = 300.00 Final answer: 300.00
653 tokens in, 814 out (439 of them reasoning) · 20.4 s · $0.0021 · 1 message on Pro · answered by mistralai/mistral-large-4-0 via Mistral ·
GPT-6 Sol
Passed: Final answer 300.00: right.
August’s six orders had revenues of $240, $310, $620, $225, $360, and $45. Their total was $1,800, so the average was $1,800 ÷ 6 = $300.00. Final answer: $300.00
647 tokens in, 120 out (55 of them reasoning) · 2.8 s · $0.0025 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·
Gemini 4 Argon
Passed: Final answer 300.00: right.
**August 2026 Orders:** * **1007** (2026-08-02): 2 × 120.00 = 240.00 * **1008** (2026-08-06): 1 × 310.00 = 310.00 * **1009** (2026-08-11): 2 × 310.00 = 620.00 * **1010** (2026-08-15): 5 × 45.00 = 225.00 * **1011** (2026-08-19): 3 × 120.00 = 360.00 * **1012** (2026-08-27): 1 × 45.00 = 45.00 **Calculation:** * Total revenue: 240.00 + 310.00 + 620.00 + 225.00 + 360.00 + 45.00 = 1800.00 * Number of orders: 6 * Average revenue: 1800.00 / 6 = 300.00 Final answer: 300.00
998 tokens in, 345 out · 5.6 s · $0.0027 · 1 message on Pro · answered by google/gemini-4-argon via Google AI Studio ·
Claude Sonnet 5.5
Passed: Final answer 300.00: right.
August 2026 orders (1007–1012): - 1007: 2 × 120 = 240 - 1008: 1 × 310 = 310 - 1009: 2 × 310 = 620 - 1010: 5 × 45 = 225 - 1011: 3 × 120 = 360 - 1012: 1 × 45 = 45 Total = 240 + 310 + 620 + 225 + 360 + 45 = 1800 Average = 1800 / 6 = 300.00 Final answer: 300.00
825 tokens in, 170 out · 1.7 s · $0.0037 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·
Claude Sonnet 5
Passed: Final answer 300.00: right.
Working: - 1007: 2×120=240 - 1008: 1×310=310 - 1009: 2×310=620 - 1010: 5×45=225 - 1011: 3×120=360 - 1012: 1×45=45 Sum = 240+310+620+225+360+45 = 1800 Count = 6 orders Average = 1800/6 = 300.00 Final answer: 300.00
821 tokens in, 243 out (108 of them reasoning) · 3.9 s · $0.0041 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·
Kimi K3
Passed: Final answer 300.00: right.
August 2026 orders: 1007–1012 Revenues: 240, 310, 620, 225, 360, 45 Total = 1800; orders = 6; average = 1800 / 6 = 300.00 Final answer: 300.00
735 tokens in, 234 out (155 of them reasoning) · 2.7 s · $0.0054 · 1 message on Pro · answered by moonshotai/kimi-k3 via Together ·
Grok 4.7
Passed: Final answer 300.00: right.
August 2026 orders (6): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total revenue = 1800.00 Average = 1800.00 / 6 = 300.00 Final answer: 300.00
1,884 tokens in, 865 out (716 of them reasoning) · 9.1 s · $0.0072 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·
GPT-6 Astra
Passed: Final answer 300.00: right.
August revenues: 240 + 310 + 620 + 225 + 360 + 45 = 1,800. Average revenue per order = 1,800 ÷ 6 = 300.00. Final answer: 300.00
647 tokens in, 78 out (20 of them reasoning) · 2.5 s · $0.0104 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·
Claude Opus 5.5
Passed: Final answer 300.00: right.
August 2026 orders (revenue = quantity × price): | Order | Calculation | Revenue | |---|---|---| | 1007 | 2 × 120.00 | 240.00 | | 1008 | 1 × 310.00 | 310.00 | | 1009 | 2 × 310.00 | 620.00 | | 1010 | 5 × 45.00 | 225.00 | | 1011 | 3 × 120.00 | 360.00 | | 1012 | 1 × 45.00 | 45.00 | - **Total:** 1,800.00 - **Orders:** 6 - **Average:** 1,800.00 ÷ 6 = 300.00 Final answer: 300.00
823 tokens in, 332 out (92 of them reasoning) · 4.4 s · $0.0107 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·
Gemini 3.1 Pro
Passed: Final answer 300.00: right.
Here are the orders for August 2026 and their calculated revenue (quantity × price): * Order 1007: 2 × $120.00 = $240.00 * Order 1008: 1 × $310.00 = $310.00 * Order 1009: 2 × $310.00 = $620.00 * Order 1010: 5 × $45.00 = $225.00 * Order 1011: 3 × $120.00 = $360.00 * Order 1012: 1 × $45.00 = $45.00 Total revenue for August = $240 + $310 + $620 + $225 + $360 + $45 = $1800.00 Number of orders in August = 6 Average revenue per order = $1800.00 / 6 = $300.00 Final answer: 300.00
779 tokens in, 955 out (682 of them reasoning) · 8.6 s · $0.0130 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·
Claude Fable 5.1
Passed: Final answer 300.00: right.
August 2026 orders and revenue (quantity × price): - 1007: 2 × 120.00 = 240.00 - 1008: 1 × 310.00 = 310.00 - 1009: 2 × 310.00 = 620.00 - 1010: 5 × 45.00 = 225.00 - 1011: 3 × 120.00 = 360.00 - 1012: 1 × 45.00 = 45.00 Total revenue = 240 + 310 + 620 + 225 + 360 + 45 = 1,800.00 Number of orders = 6 Average = 1,800.00 / 6 = 300.00 Final answer: 300.00
823 tokens in, 216 out · 3.3 s · $0.0209 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·
More data analysis prompts
The other data analysis prompts, each with every model's reply.
Questions
Which AI does best on “Average order value in August”?
19 of 20 models passed this data analysis prompt's check (final answer); Claude Haiku 4.5 didn't. The cheapest reply that passed was GPT-6 Luna's, at $0.00013; the fastest, DeepSeek V4.1 Flash's in 0.9 s. The dearest reply, Claude Fable 5.1's, cost 161 times as much ($0.0209).
What does a reply to “Average order value in August” cost?
Through the models' APIs, what OpenRouter charged us ran from $0.00013 (GPT-6 Luna) to $0.0209 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.