Claude Sonnet 5 · Data analysis

Claude Sonnet 5 for data analysis: our test runs

Claude Sonnet 5 ran our 5 data analysis prompts in llmwise, through the same pipeline your messages take. Here's every reply as it came, whether it passed, what it cost and what it counts as on Pro, next to the other models.

Start free See pricing

Based on 5 of our test runs on September 27, 2026, through OpenRouter with the app's own prompt and settings. Updated October 15, 2026.

Short answer

In our test runs on September 27, 2026, Claude Sonnet 5 passed 4 of 5 of our data analysis prompts (1 of the 2 hard ones): tied 17th of 20 models. Each reply counted as 1 message on Pro, where it has 125 a month, and cost $0.0069 to run on average.

Prompt by prompt

Each of the 5 data analysis prompts, and how Claude Sonnet 5's reply did.

Claude Sonnet 5 on each data analysis prompt
Prompt	Result	Cost	Time
The region with the most revenueEveryday	Passed: Final answer North, 1085.00: right.	$0.0041	6.4 s
Average order value in AugustEveryday	Passed: Final answer 300.00: right.	$0.0041	3.9 s
Revenue change from July to AugustEveryday	Passed: Final answer 67.4%: right.	$0.0062	5.3 s
A median, filtered two waysHard	Passed: Final answer 6.25 hours: right.	$0.0036	4.9 s
Correlation between ad spend and sign-upsHard	Failed: Final answer 0.99; expected 0.97.	$0.0165	13.8 s

Every data analysis reply from Claude Sonnet 5

The region with the most revenue
An everyday prompt: “The region with the most revenue”, in full.
Passed: Final answer North, 1085.00: right.
```
Working:
- West: 90+310+240+225 = 865
- East: 120+135+310+360 = 925
- North: 180+240+620+45 = 1085

Final answer: North, $1085.00
```
813 tokens in, 243 out (175 of them reasoning) · 6.4 s · $0.0041 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS · September 27, 2026
Average order value in August
An everyday prompt: “Average order value in August”, in full.
Passed: Final answer 300.00: right.
```
Working:
- 1007: 2×120=240
- 1008: 1×310=310
- 1009: 2×310=620
- 1010: 5×45=225
- 1011: 3×120=360
- 1012: 1×45=45

Sum = 240+310+620+225+360+45 = 1800
Count = 6 orders
Average = 1800/6 = 300.00

Final answer: 300.00
```
821 tokens in, 243 out (108 of them reasoning) · 3.9 s · $0.0041 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS · September 27, 2026

Revenue change from July to August

An everyday prompt: “Revenue change from July to August”, in full.

Passed: Final answer 67.4%: right.

**July 2026 Revenue:**
- 1001: 2×45=90
- 1002: 1×120=120
- 1003: 1×310=310
- 1004: 4×45=180
- 1005: 3×45=135
- 1006: 2×120=240
- **Total = 1075**

**August 2026 Revenue:**
- 1007: 2×120=240
- 1008: 1×310=310
- 1009: 2×310=620
- 1010: 5×45=225
- 1011: 3×120=360
- 1012: 1×45=45
- **Total = 1800**

**Percentage change:** (1800 − 1075) / 1075 × 100 = 725/1075 × 100 ≈ 67.4%

Final answer: 67.4%

829 tokens in, 455 out (204 of them reasoning) · 5.3 s · $0.0062 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS · September 27, 2026

A median, filtered two ways
A hard prompt: “A median, filtered two ways”, in full.
Passed: Final answer 6.25 hours: right.
```
Billing + high-priority tickets: T1=5.5, T4=2, T6=9, T9=7, T10=26, T12=4

Sorted: 2, 4, 5.5, 7, 9, 26 (6 values)

Median = average of 3rd and 4th values = (5.5 + 7) / 2 = 6.25

Final answer: 6.25 hours
```
689 tokens in, 223 out (100 of them reasoning) · 4.9 s · $0.0036 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS · September 27, 2026
Correlation between ad spend and sign-ups
A hard prompt: “Correlation between ad spend and sign-ups”, in full.
Failed: Final answer 0.99; expected 0.97.
```
**Working:**

n=8, mean(x)=768.75, mean(y)=54.25

Computed deviations and cross-products:
- Σ(dx·dy) = 24428.125
- Σ(dx²) = 624687.5
- Σ(dy²) = 971.5

r = Σ(dx·dy) / √(Σdx² · Σdy²) = 24428.125 / √(624687.5 × 971.5) = 24428.125 / 24635.01 ≈ 0.9916

**Final answer: 0.99**
```
605 tokens in, 1,524 out (1,348 of them reasoning) · 13.8 s · $0.0165 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS · September 27, 2026

How it compares on data analysis

Claude Sonnet 5 beside the job's picks among every model. 16 models share the hard-problems pick, and Claude Sonnet 5 isn't one of them.

Claude Sonnet 5 beside other models on data analysis
Model	Passed	On Pro	Cost per reply
GLM 5.3Our pick: hard problems (shared), best value	5 of 5	250 a month on Pro	$0.0019
GPT-6 LunaOur pick: hard problems (shared), everyday	5 of 5	60 a day on Pro	$0.0002
Claude Sonnet 5	4 of 5	125 a month on Pro	$0.0069

On Pro: Pro's count on each model. Cost: what OpenRouter charged us per reply, on average.

Every limit is published. Paid plans also have a monthly fair-use limit on AI cost: Plus $3.75, Pro $7.50, Max $20, Ultra $42, Studio $85. Using every message on your plan at typical sizes stays under it; very large messages and heavy research use it faster. Every limit, explained.

Claude Sonnet 5 next to each model on data analysis

Claude Sonnet 5 against each model on the same 5 data analysis prompts. One run each, through OpenRouter: a wait depends on the provider and the load that day, so a lead under 10% counts as close.

Against Claude Fable 5.1: Claude Sonnet 5 answered within 10% of its time (5.3 s to 4.9 s), cost 4.1× less, and passed 4 of 5 to its 5. Only Claude Fable 5.1 passed Correlation between ad spend and sign-ups.
Against Claude Opus 5.5: Claude Sonnet 5 answered 1.2× later (5.3 s to 4.6 s), cost 1.9× less, and passed 4 of 5 to its 5. Only Claude Opus 5.5 passed Correlation between ad spend and sign-ups.
Against Claude Sonnet 5.5: Claude Sonnet 5 answered 2.3× later (5.3 s to 2.3 s), cost 1.5× more, and passed 4 of 5 to its 5. Only Claude Sonnet 5.5 passed Correlation between ad spend and sign-ups.
Against Claude Haiku 5.5: Claude Sonnet 5 answered 1.6× later (5.3 s to 3.3 s), cost 19.2× more, and passed 4 of 5 to its 5. Only Claude Haiku 5.5 passed Correlation between ad spend and sign-ups.
Against Claude Haiku 4.5: Claude Sonnet 5 answered 1.9× later (5.3 s to 2.7 s), cost 2.8× more, and passed 4 of 5 to its 3. Only Claude Sonnet 5 passed Average order value in August.
Against GPT-6 Astra: Claude Sonnet 5 answered 1.6× later (5.3 s to 3.3 s), cost 2.2× less, and passed 4 of 5 to its 5. Only GPT-6 Astra passed Correlation between ad spend and sign-ups.
Against GPT-6.1 Sol: Claude Sonnet 5 answered 1.8× later (5.3 s to 3.0 s), cost 4.3× more, and passed 4 of 5 to its 5. Only GPT-6.1 Sol passed Correlation between ad spend and sign-ups.
Against GPT-6 Sol: Claude Sonnet 5 answered 1.9× later (5.3 s to 2.8 s), cost 2.0× more, and passed 4 of 5 to its 5. Only GPT-6 Sol passed Correlation between ad spend and sign-ups.
Against GPT-6 Luna: Claude Sonnet 5 answered 2.1× later (5.3 s to 2.5 s), cost 39.1× more, and passed 4 of 5 to its 5. Only GPT-6 Luna passed Correlation between ad spend and sign-ups.
Against Gemini 4 Argon: Claude Sonnet 5 answered 1.3× sooner (5.3 s to 6.9 s), cost 2.4× more, and passed 4 of 5 to its 5. Only Gemini 4 Argon passed Correlation between ad spend and sign-ups.
Against Gemini 3.1 Pro (preview): Claude Sonnet 5 answered 1.6× sooner (5.3 s to 8.6 s), cost 2.2× less, and passed 4 of 5 to its 5. Only Gemini 3.1 Pro (preview) passed Correlation between ad spend and sign-ups.
Against Gemini 3.8 Flash: Claude Sonnet 5 answered within 10% of its time (5.3 s to 5.4 s), cost 2.5× more, and passed 4 of 5 to its 4.
Against DeepSeek V4.1 Flash: Claude Sonnet 5 answered 6.1× later (5.3 s to 0.9 s), cost 8.1× more, and passed 4 of 5 to its 5. Only DeepSeek V4.1 Flash passed Correlation between ad spend and sign-ups.
Against DeepSeek V4 Pro: Claude Sonnet 5 answered 1.3× later (5.3 s to 4.1 s), cost 2.4× more, and passed 4 of 5 to its 5. Only DeepSeek V4 Pro passed Correlation between ad spend and sign-ups.
Against Grok 4.7: Claude Sonnet 5 answered 1.7× sooner (5.3 s to 8.9 s), cost 1.6× less, and passed 4 of 5 to its 5. Only Grok 4.7 passed Correlation between ad spend and sign-ups.
Against Kimi K3: Claude Sonnet 5 answered 1.5× later (5.3 s to 3.5 s), cost within 10% of it, and passed 4 of 5 to its 5. Only Kimi K3 passed Correlation between ad spend and sign-ups.
Against GLM 5.3: Claude Sonnet 5 answered 2.7× later (5.3 s to 1.9 s), cost 3.6× more, and passed 4 of 5 to its 5. Only GLM 5.3 passed Correlation between ad spend and sign-ups.
Against GLM 5.3 Flash: Claude Sonnet 5 answered 1.8× sooner (5.3 s to 9.8 s), cost 17.9× more, and passed 4 of 5 to its 4.
Against Mistral Large 4: Claude Sonnet 5 answered 3.0× sooner (5.3 s to 15.8 s), cost 1.8× more, and passed 4 of 5 to its 5. Only Mistral Large 4 passed Correlation between ad spend and sign-ups.

How these runs were done

Final answer. Automatic. The reply's last “Final answer:” line must hold the right value.

How the runs were done, and every data analysis prompt.

Claude Sonnet 5, and data analysis, elsewhere

Questions

Is Claude Sonnet 5 good for data analysis?

In our test runs it passed 4 of 5 data analysis prompts, tied 17th of the 20 models in llmwise. Every reply is on this page, so you can judge them yourself.

How many of my messages does a data analysis reply from Claude Sonnet 5 use?

1 message each on Pro, where it has 125 a month on Pro. The price of a message is fixed and shown before you send it, however long the reply.

How were these runs done?

The same way for every model: each prompt sent through llmwise's own pipeline, each reply checked the same way. The methods page has every prompt and how each is scored.

Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.

See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.