Skip to content

Model vs model

Claude Sonnet 5 vs Gemini 3.1 Pro (preview)

Claude Sonnet 5 and Gemini 3.1 Pro (preview) are both in llmwise. What each gets on every plan, what it reads, how it's served and what happens when its provider fails, from the catalog and the code that runs them.

Model prices and specs checked against OpenRouter's Claude Sonnet 5 page, OpenRouter's Gemini 3.1 Pro page. Updated .

Short answer

They cost the same in llmwise: up to 125 messages a month on Pro on either. Beyond that, they read the same files and neither is easier to try. In our test runs, Claude Sonnet 5 passed 46 of the 50 prompts both answered and Gemini 3.1 Pro (preview) 49; 5 prompts split them, most on summarization (3 to 5).

Claude Sonnet 5 vs Gemini 3.1 Pro (preview), prompt by prompt

Every prompt Claude Sonnet 5 and Gemini 3.1 Pro (preview) both answered, compared directly, their biggest differences first. One run each, through OpenRouter: a wait depends on the provider and the load that day, so a lead under 10% counts as close.

Of the 50 prompts both answered, both passed 45, only Claude Sonnet 5 passed 1, only Gemini 3.1 Pro (preview) passed 4, and neither passed 0. Claude Sonnet 5 answered sooner on 50 of the 50 and Gemini 3.1 Pro (preview) on 0; the rest were within 10% of each other. The 50 replies cost $0.2030 on Claude Sonnet 5 and $0.5334 on Gemini 3.1 Pro (preview): 2.6× less on Claude Sonnet 5.

The 5 prompts only one of Claude Sonnet 5 and Gemini 3.1 Pro (preview) passed

  • Announce a second bakery shop on LinkedIn (writing): Gemini 3.1 Pro (preview) passed and Claude Sonnet 5 didn't. Claude Sonnet 5: Graded 3.5 of 5 on average (lowest 3). Gemini 3.1 Pro (preview): Graded 4.0 of 5 on average (lowest 3).

  • Argue both sides of free buses (writing): Claude Sonnet 5 passed and Gemini 3.1 Pro (preview) didn't. Claude Sonnet 5: Graded 4.0 of 5 on average (lowest 4). Gemini 3.1 Pro (preview): Graded 3.7 of 5 on average (lowest 3).

  • An article in three bullets (summarization): Gemini 3.1 Pro (preview) passed and Claude Sonnet 5 didn't. Claude Sonnet 5: Graded 3.7 of 5 on average (lowest 3). Gemini 3.1 Pro (preview): Graded 4.3 of 5 on average (lowest 4).

  • An email thread in one sentence (summarization): Gemini 3.1 Pro (preview) passed and Claude Sonnet 5 didn't. Claude Sonnet 5: Graded 5.0 of 5 on average (lowest 5); but 32 words, over the 30 allowed. Gemini 3.1 Pro (preview): Graded 4.7 of 5 on average (lowest 4).

  • Correlation between ad spend and sign-ups (data analysis): Gemini 3.1 Pro (preview) passed and Claude Sonnet 5 didn't. Claude Sonnet 5: Final answer 0.99; expected 0.97. Gemini 3.1 Pro (preview): Final answer 0.97: right.

Job by job, the widest gaps first

  • Summarization: Claude Sonnet 5 passed 3 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 2.9× sooner at the median, 2.7 s against 8.0 s. Claude Sonnet 5 cost 3.2× less, $0.0140 against $0.0441 for the 5 replies. Claude Sonnet 5's replies ran 76% longer, in tokens of reply, thinking not counted.

  • Data analysis: Claude Sonnet 5 passed 4 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 1.6× sooner at the median, 5.3 s against 8.6 s. Claude Sonnet 5 cost 2.2× less, $0.0344 against $0.0773 for the 5 replies. Gemini 3.1 Pro (preview)'s replies ran 120% longer, in tokens of reply, thinking not counted.

  • Translation: Claude Sonnet 5 passed 5 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 3.8× sooner at the median, 2.8 s against 10.3 s. Claude Sonnet 5 cost 4.7× less, $0.0149 against $0.0699 for the 5 replies. Claude Sonnet 5's replies ran 75% longer, in tokens of reply, thinking not counted.

  • Math: Claude Sonnet 5 passed 5 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 2.1× sooner at the median, 3.9 s against 8.3 s. Claude Sonnet 5 cost 3.0× less, $0.0165 against $0.0501 for the 5 replies. Gemini 3.1 Pro (preview)'s replies ran 59% longer, in tokens of reply, thinking not counted.

  • Customer support: Claude Sonnet 5 passed 5 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 2.5× sooner at the median, 3.5 s against 8.7 s. Claude Sonnet 5 cost 2.9× less, $0.0182 against $0.0529 for the 5 replies. Claude Sonnet 5's replies ran 61% longer, in tokens of reply, thinking not counted.

  • SQL: Claude Sonnet 5 passed 5 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 3.5× sooner at the median, 2.2 s against 7.4 s. Claude Sonnet 5 cost 2.7× less, $0.0142 against $0.0386 for the 5 replies. Claude Sonnet 5's replies ran 53% longer, in tokens of reply, thinking not counted.

  • Writing: Claude Sonnet 5 passed 4 of 5 and Gemini 3.1 Pro (preview) 4 of 5. Claude Sonnet 5 answered 2.0× sooner at the median, 4.5 s against 9.1 s. Claude Sonnet 5 cost 2.7× less, $0.0171 against $0.0459 for the 5 replies. Claude Sonnet 5's replies ran 75% longer, in tokens of reply, thinking not counted.

  • RAG and answering from documents: Claude Sonnet 5 passed 5 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 3.1× sooner at the median, 1.8 s against 5.6 s. Claude Sonnet 5 cost 2.7× less, $0.0109 against $0.0290 for the 5 replies. Claude Sonnet 5's replies ran 77% longer, in tokens of reply, thinking not counted.

  • Agents and tool use: Claude Sonnet 5 passed 5 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 2.7× sooner at the median, 2.0 s against 5.3 s. Claude Sonnet 5 cost 2.3× less, $0.0121 against $0.0284 for the 5 replies. Gemini 3.1 Pro (preview)'s replies ran 19% longer, in tokens of reply, thinking not counted.

  • Coding: Claude Sonnet 5 passed 5 of 5 and Gemini 3.1 Pro (preview) 5 of 5. Claude Sonnet 5 answered 3.8× sooner at the median, 2.7 s against 10.3 s. Claude Sonnet 5 cost 1.9× less, $0.0508 against $0.0973 for the 5 replies. Claude Sonnet 5's replies ran 48% longer, in tokens of reply, thinking not counted.

All 50 prompts: who passed, who answered sooner, who cost less
Claude Sonnet 5 and Gemini 3.1 Pro (preview) on each prompt of our test runs
PromptResultSoonerCheaper
Turn a title into a URL slugBoth passedClaude Sonnet 5, 2.7×took 2.3 s and 6.0 sClaude Sonnet 5, 2.3×cost $0.0024 and $0.0056
Parse a duration like “1h 30m”Both passedClaude Sonnet 5, 4.0×took 2.6 s and 10.3 sClaude Sonnet 5, 4.7×cost $0.0036 and $0.0172
Merge overlapping intervalsBoth passedClaude Sonnet 5, 3.2×took 2.7 s and 8.6 sClaude Sonnet 5, 3.0×cost $0.0034 and $0.0103
Evaluate an arithmetic expression, no evalBoth passedClaude Sonnet 5, 1.2×took 16.9 s and 20.6 sClaude Sonnet 5, 1.6×cost $0.0226 and $0.0351
Parse CSV with quoted fieldsBoth passedClaude Sonnet 5, 1.3×took 15.8 s and 20.6 sClaude Sonnet 5, 1.6×cost $0.0187 and $0.0291
Announce a second bakery shop on LinkedInOnly Gemini 3.1 Pro (preview)Claude Sonnet 5, 2.1×took 4.6 s and 9.5 sClaude Sonnet 5, 3.0×cost $0.0037 and $0.0113
Rewrite corporate jargon in plain wordsBoth passedClaude Sonnet 5, 3.3×took 2.7 s and 8.8 sClaude Sonnet 5, 4.5×cost $0.0022 and $0.0101
Decline a meeting and offer two timesBoth passedClaude Sonnet 5, 2.2×took 2.8 s and 6.2 sClaude Sonnet 5, 2.3×cost $0.0026 and $0.0058
A product announcement with five rulesBoth passedClaude Sonnet 5, 2.1×took 4.5 s and 9.2 sClaude Sonnet 5, 2.7×cost $0.0035 and $0.0095
Argue both sides of free busesOnly Claude Sonnet 5Claude Sonnet 5, 1.4×took 6.6 s and 9.1 sClaude Sonnet 5, 1.8×cost $0.0050 and $0.0092
A discount, then sales taxBoth passedClaude Sonnet 5, 1.8×took 1.9 s and 3.6 sClaude Sonnet 5, 2.7×cost $0.0015 and $0.0042
Pens at 3 for $4Both passedClaude Sonnet 5, 1.5×took 6.3 s and 9.6 sClaude Sonnet 5, 2.0×cost $0.0061 and $0.0121
Compound interest over three yearsBoth passedClaude Sonnet 5, 1.7×took 3.7 s and 6.2 sClaude Sonnet 5, 4.7×cost $0.0021 and $0.0099
Four-digit numbers whose digits sum to 9Both passedClaude Sonnet 5, 2.1×took 4.5 s and 9.6 sClaude Sonnet 5, 3.8×cost $0.0039 and $0.0150
The highest of three dice is a 5Both passedClaude Sonnet 5, 2.1×took 3.9 s and 8.3 sClaude Sonnet 5, 3.2×cost $0.0028 and $0.0090
An article in three bulletsOnly Gemini 3.1 Pro (preview)Claude Sonnet 5, 3.0×took 2.6 s and 8.0 sClaude Sonnet 5, 3.2×cost $0.0027 and $0.0088
An email thread in one sentenceOnly Gemini 3.1 Pro (preview)Claude Sonnet 5, 2.7×took 2.3 s and 6.3 sClaude Sonnet 5, 3.0×cost $0.0019 and $0.0058
Decisions and action items from a meetingBoth passedClaude Sonnet 5, 2.7×took 2.8 s and 7.6 sClaude Sonnet 5, 2.4×cost $0.0033 and $0.0081
A quarterly memo for the CEOBoth passedClaude Sonnet 5, 3.8×took 3.0 s and 11.2 sClaude Sonnet 5, 4.3×cost $0.0033 and $0.0139
A study with a negative resultBoth passedClaude Sonnet 5, 3.0×took 2.7 s and 8.2 sClaude Sonnet 5, 2.7×cost $0.0028 and $0.0075
The region with the most revenueBoth passedClaude Sonnet 5, 1.3×took 6.4 s and 8.5 sClaude Sonnet 5, 2.9×cost $0.0041 and $0.0117
Average order value in AugustBoth passedClaude Sonnet 5, 2.2×took 3.9 s and 8.6 sClaude Sonnet 5, 3.2×cost $0.0041 and $0.0130
Revenue change from July to AugustBoth passedClaude Sonnet 5, 1.7×took 5.3 s and 9.0 sClaude Sonnet 5, 2.2×cost $0.0062 and $0.0135
A median, filtered two waysBoth passedClaude Sonnet 5, 1.5×took 4.9 s and 7.1 sClaude Sonnet 5, 2.3×cost $0.0036 and $0.0082
Correlation between ad spend and sign-upsOnly Gemini 3.1 Pro (preview)Claude Sonnet 5, 1.2×took 13.8 s and 16.5 sClaude Sonnet 5, 1.9×cost $0.0165 and $0.0310
A late orderBoth passedClaude Sonnet 5, 2.5×took 3.5 s and 8.7 sClaude Sonnet 5, 3.5×cost $0.0036 and $0.0125
A return inside the windowBoth passedClaude Sonnet 5, 2.4×took 2.9 s and 6.9 sClaude Sonnet 5, 2.3×cost $0.0032 and $0.0076
A frustrated customerBoth passedClaude Sonnet 5, 2.2×took 4.4 s and 9.8 sClaude Sonnet 5, 2.7×cost $0.0041 and $0.0110
A refund request outside the windowBoth passedClaude Sonnet 5, 2.3×took 3.2 s and 7.4 sClaude Sonnet 5, 3.3×cost $0.0031 and $0.0103
A message with a planted instructionBoth passedClaude Sonnet 5, 2.3×took 4.6 s and 10.6 sClaude Sonnet 5, 2.8×cost $0.0041 and $0.0116
A delivery message into SpanishBoth passedClaude Sonnet 5, 4.4×took 2.7 s and 11.8 sClaude Sonnet 5, 5.3×cost $0.0029 and $0.0157
A product description into FrenchBoth passedClaude Sonnet 5, 3.6×took 2.5 s and 9.1 sClaude Sonnet 5, 4.9×cost $0.0029 and $0.0141
A meeting note into GermanBoth passedClaude Sonnet 5, 4.7×took 2.8 s and 13.0 sClaude Sonnet 5, 5.9×cost $0.0027 and $0.0158
Idioms into natural JapaneseBoth passedClaude Sonnet 5, 2.5×took 4.1 s and 10.3 sClaude Sonnet 5, 4.2×cost $0.0028 and $0.0118
A lease clause into Brazilian PortugueseBoth passedClaude Sonnet 5, 2.1×took 3.8 s and 8.1 sClaude Sonnet 5, 3.5×cost $0.0036 and $0.0125
Customers in one countryBoth passedClaude Sonnet 5, 2.7×took 1.8 s and 4.9 sClaude Sonnet 5, 1.4×cost $0.0020 and $0.0029
Count orders by statusBoth passedClaude Sonnet 5, 2.6×took 2.0 s and 5.0 sClaude Sonnet 5, 2.0×cost $0.0020 and $0.0039
Revenue by categoryBoth passedClaude Sonnet 5, 2.1×took 3.5 s and 7.4 sClaude Sonnet 5, 2.4×cost $0.0031 and $0.0074
Every customer, even those without ordersBoth passedClaude Sonnet 5, 3.7×took 2.2 s and 7.9 sClaude Sonnet 5, 2.9×cost $0.0030 and $0.0089
Monthly revenue with a running totalBoth passedClaude Sonnet 5, 3.7×took 3.0 s and 11.1 sClaude Sonnet 5, 3.7×cost $0.0042 and $0.0155
A fact from one sectionBoth passedClaude Sonnet 5, 3.2×took 1.7 s and 5.3 sClaude Sonnet 5, 2.3×cost $0.0019 and $0.0045
Core hours and start timesBoth passedClaude Sonnet 5, 2.8×took 2.1 s and 5.8 sClaude Sonnet 5, 2.4×cost $0.0022 and $0.0052
Two sections in one answerBoth passedClaude Sonnet 5, 3.1×took 1.8 s and 5.6 sClaude Sonnet 5, 2.1×cost $0.0022 and $0.0047
A later amendment changes the answerBoth passedClaude Sonnet 5, 4.1×took 2.1 s and 8.6 sClaude Sonnet 5, 3.8×cost $0.0026 and $0.0099
A question the handbook doesn't answerBoth passedClaude Sonnet 5, 3.1×took 1.8 s and 5.6 sClaude Sonnet 5, 2.4×cost $0.0019 and $0.0046
Pick the tool and work out the dateBoth passedClaude Sonnet 5, 2.5×took 1.7 s and 4.3 sClaude Sonnet 5, 2.7×cost $0.0018 and $0.0048
Convert a currencyBoth passedClaude Sonnet 5, 2.7×took 2.0 s and 5.3 sClaude Sonnet 5, 2.5×cost $0.0018 and $0.0044
Book a meeting from a sentenceBoth passedClaude Sonnet 5, 1.3×took 5.7 s and 7.1 sClaude Sonnet 5, 1.8×cost $0.0037 and $0.0068
Search, but don't bookBoth passedClaude Sonnet 5, 2.5×took 1.9 s and 4.7 sClaude Sonnet 5, 3.0×cost $0.0020 and $0.0061
Two calls with a unit conversionBoth passedClaude Sonnet 5, 1.8×took 3.8 s and 6.9 sClaude Sonnet 5, 2.2×cost $0.0028 and $0.0063

Claude Sonnet 5 vs Gemini 3.1 Pro (preview) in our test runs

Claude Sonnet 5 and Gemini 3.1 Pro (preview) on the same prompts, job by job: how many replies passed their check.

Based on 100 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .

Claude Sonnet 5 and Gemini 3.1 Pro (preview) in our test runs, job by job
JobClaude Sonnet 5Gemini 3.1 Pro (preview)
Coding5 of 55 of 5
Writing4 of 54 of 5
Math5 of 55 of 5
Summarization3 of 55 of 5
Data analysis4 of 55 of 5
Customer support5 of 55 of 5
Translation5 of 55 of 5
SQL5 of 55 of 5
RAG and answering from documents5 of 55 of 5
Agents and tool use5 of 55 of 5
All jobs46 of 50 · 1 message each · $0.0041 a reply49 of 50 · 1 message each · $0.0107 a reply

The same prompts, sent to both through llmwise's own pipeline and checked the same way: five for each job. A bold count is the one that passed more. Messages: what each reply counted as on Pro. Cost: what OpenRouter charged us per reply, on average. Every prompt, and how it's scored.

Where they differed most, summarization: both replies to a prompt only one of them passed.

An everyday prompt: “An article in three bullets”, in full.

  • Claude Sonnet 5

    Failed: Graded 3.7 of 5 on average (lowest 3).

    - Aldmoor's 6-month trial bike lanes tripled cyclist trips (900→2,300/day), cut car traffic 14%, but added ~1 min to rush-hour drives.
    
    - Business impact mixed: 27 of 60 shops saw more customers, 19 fewer.
    
    - Injuries dropped (9→2); permanent install would cost €1.1M more.

    725 tokens in, 125 out · 2.6 s · $0.0027 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·

  • Gemini 3.1 Pro

    Passed: Graded 4.3 of 5 on average (lowest 4).

    * Daily bike trips jumped to 2,300 and cyclist injuries dropped sharply.
    * Car traffic fell 14% with minor delays, while local business impacts were mixed.
    * The city council votes in November on spending €1.1 million to make the lanes permanent.

    560 tokens in, 636 out (577 of them reasoning) · 8.0 s · $0.0088 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·

Claude Sonnet 5 and Gemini 3.1 Pro (preview) on every plan

Whether the one-time free trial reaches each model, then each paid plan's messages on it.

Messages on Claude Sonnet 5 and Gemini 3.1 Pro (preview), plan by plan
PlanPriceClaude Sonnet 5Gemini 3.1 Pro (preview)
Free$0In the one-time trial of 5 messagesIn the one-time trial of 5 messages
Pro$20 a monthUp to 125 a monthUp to 125 a month
Max$50 a monthUp to 400 a monthUp to 400 a month
Ultra$100 a monthUp to 900 a monthUp to 900 a month
Studio$200 a monthUp to 2,000 a monthUp to 2,000 a month

Prices don't include tax, which is added where it applies and shown before you pay. A paid plan's month is one allowance shared by every model, so each monthly count is the most you get if all of it goes to that model. It renews each billing period; everyday models refill daily at 00:00 UTC. Long chats count more per reply. How pricing works.

Every limit is published. Paid plans also have a monthly fair-use limit on AI cost: Pro $7.50, Max $20, Ultra $42, Studio $85. Using every message on your plan at typical sizes stays under it; very large messages and heavy research use it faster. Every limit, explained.

What differs

  • Messages on Pro

    They cost the same in llmwise: up to 125 messages a month on Pro on either.

  • Context window

    Claude Sonnet 5 takes up to 1M tokens; Gemini 3.1 Pro (preview) up to 1.05M tokens. A chat in llmwise holds up to 200k tokens, which fits in either, so the difference shows only through each maker's own API.

  • Images and PDFs

    Both read images. Both take a PDF as the whole file, pages and all.

  • On Free

    Both are in the free trial.

  • Where messages go

    Claude Sonnet 5: Sent to Anthropic directly. Gemini 3.1 Pro (preview): Sent to Google directly.

Fact by fact

Claude Sonnet 5 and Gemini 3.1 Pro (preview), fact by fact
FactClaude Sonnet 5Gemini 3.1 Pro (preview)
Context window1M tokens1.05M tokens
Reads imagesYesYes
PDFsWhole fileWhole file
ReasoningYesYes
API price (September 2026)$2.00 in / $10.00 out per million tokens$2.00 in / $12.00 out per million tokens
A typical message at API prices (4,000 tokens in, 700 out)$0.0150$0.0164
A $10 top-up adds100 messages100 messages
Where a message goesSent to Anthropic directly.Sent to Google directly.
If the provider failsIf Anthropic fails before the reply starts (an overload, a server error, a dropped connection), llmwise sends the same request to Claude Sonnet 5 through OpenRouter instead.If Google fails before the reply starts (an overload, a server error, a dropped connection), llmwise sends the same request to Gemini 3.1 Pro (preview) through OpenRouter instead.
Anthropic's safety fallbackDoesn't applyDoesn't apply
API prices are what our model catalog lists (Claude: Anthropic's list price; Gemini: Google's list price). In llmwise you pay per message, not per token: the counts above are what you get.

Claude Sonnet 5 or Gemini 3.1 Pro (preview)?

From the facts above and our test runs: the rest is how their answers suit your work, which one chat can show you.

  • Pick Claude Sonnet 5: it costs its maker less to run ($0.0150 a typical message at API prices), though in llmwise the count is the same.

Each model's page, the families, and other pairs

Claude Sonnet 5 vs Gemini 3.1 Pro (preview) is one pair of models. The page below covers the whole families.

Questions

Is Claude Sonnet 5 or Gemini 3.1 Pro (preview) cheaper in llmwise?

They cost the same in llmwise: up to 125 messages a month on Pro on either. Every paid plan's monthly allowance is shared by all models, so each count is the most you get if it all goes to that model.

Can I try Claude Sonnet 5 and Gemini 3.1 Pro (preview) for free?

Yes: both are in the free trial of 5 messages.

Which has the bigger context window, Claude Sonnet 5 or Gemini 3.1 Pro (preview)?

Gemini 3.1 Pro (preview): 1.05M tokens, against 1M tokens. A chat in llmwise holds up to 200k tokens, which fits in either, so the difference shows only through each maker's own API.

Can I use Claude Sonnet 5 and Gemini 3.1 Pro (preview) in the same chat?

Yes. Pick Claude Sonnet 5 for one message and Gemini 3.1 Pro (preview) for the next; the second sees the whole chat, including the first one's answer.

Which did better in your test runs, Claude Sonnet 5 or Gemini 3.1 Pro (preview)?

On the same 50 prompts, run on September 27, 2026, Claude Sonnet 5 passed 46 and Gemini 3.1 Pro (preview) passed 49. The table on this page has each job, and every reply is published.

Claude, GPT, Gemini, DeepSeek, Grok, Kimi, and GLM, in one chat.

See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.