Comparison · 3 families
ChatGPT vs Claude vs Gemini
In our test runs on October 15, 2026, the same 50 prompts across 10 jobs: GPT's 4 models passed 186 of 200 replies, Claude's 6 models passed 275 of 300 replies, and Gemini's 3 models passed 142 of 150 replies. ChatGPT is OpenAI's own app for its GPT models; llmwise has GPT models in its own chat, not ChatGPT itself.
Based on 650 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .
Short answer
Job by job, all 3 families' best models shared the top result on 8 of the 10 jobs; GPT's alone had it on writing; GPT's trailed on customer support; Claude's trailed on writing; Gemini's trailed on writing.
GPT vs Claude vs Gemini, job by job
Each family's best model on each job, by our published rule (the most prompts passed, then the most hard ones, then the cheaper), and what it passed. The top result on each job is marked.
| Job | GPT | Claude | Gemini |
|---|---|---|---|
| Coding | 5 of 5 · top4 models tied | 5 of 5 · top5 models tied | 5 of 5 · top3 models tied |
| Writing | 5 of 5 · top2 models tied | 4 of 5Claude Sonnet 5 | 4 of 52 models tied |
| Math | 5 of 5 · top3 models tied | 5 of 5 · top6 models tied | 5 of 5 · top3 models tied |
| Summarization | 5 of 5 · top2 models tied | 5 of 5 · top2 models tied | 5 of 5 · top3 models tied |
| Data analysis | 5 of 5 · top4 models tied | 5 of 5 · top4 models tied | 5 of 5 · top2 models tied |
| Customer support | 4 of 5GPT-6 Luna | 5 of 5 · top2 models tied | 5 of 5 · topGemini 3.1 Pro |
| Translation | 5 of 5 · top3 models tied | 5 of 5 · top6 models tied | 5 of 5 · top3 models tied |
| SQL | 5 of 5 · top4 models tied | 5 of 5 · top6 models tied | 5 of 5 · top3 models tied |
| RAG and answering from documents | 5 of 5 · top4 models tied | 5 of 5 · top6 models tied | 5 of 5 · top3 models tied |
| Agents and tool use | 5 of 5 · top4 models tied | 5 of 5 · top6 models tied | 5 of 5 · top3 models tied |
Every model, every job
All 13 GPT, Claude, and Gemini models in llmwise across the 50 prompts, with what a reply cost to run and each model's count on Pro.
| Model | Passed | Hard ones | Cost per reply | On Pro |
|---|---|---|---|---|
| GPT-6 AstraOpenAI | 48 of 50 | 20 of 20 | $0.0117 | Up to 31 a month |
| GPT-6.1 SolOpenAI | 46 of 50 | 19 of 20 | $0.0012 | Up to 125 a month |
| GPT-6 SolOpenAI | 45 of 50 | 19 of 20 | $0.0026 | Up to 125 a month |
| GPT-6 LunaOpenAI | 47 of 50 | 20 of 20 | $0.00012 | Up to 60 a day |
| Claude Fable 5.1Anthropic | 45 of 50 | 17 of 20 | $0.0200 | Up to 31 a month |
| Claude Opus 5.5Anthropic | 49 of 50 | 19 of 20 | $0.0107 | Up to 62 a month |
| Claude Sonnet 5.5Anthropic | 47 of 50 | 19 of 20 | $0.0038 | Up to 125 a month |
| Claude Sonnet 5Anthropic | 46 of 50 | 19 of 20 | $0.0041 | Up to 125 a month |
| Claude Haiku 4.5Anthropic | 43 of 50 | 15 of 20 | $0.0015 | Up to 250 a month |
| Claude Haiku 5.5Anthropic | 45 of 50 | 19 of 20 | $0.00024 | Up to 60 a day |
| Gemini 4 ArgonGoogle | 47 of 50 | 19 of 20 | $0.0016 | Up to 62 a month |
| Gemini 3.1 Pro (preview)Google | 49 of 50 | 19 of 20 | $0.0107 | Up to 125 a month |
| Gemini 3.8 FlashGoogle | 46 of 50 | 18 of 20 | $0.0013 | Up to 250 a month |
Passed: replies that passed their check, of those scored. Cost: what OpenRouter charged us per reply, on average; in llmwise you pay per message, not per token. Every prompt and how it's scored.
One writing prompt, 3 replies
GPT-6 Luna, Claude Sonnet 5, and Gemini 3.1 Pro, each its family's pick on writing by the rule above, on the same prompt: every reply as it came.
A hard prompt: “A product announcement with five rules”, in full.
GPT-6 Luna
Passed: Graded 4.0 of 5 on average (lowest 3).
Meet the Nordvik 2, a desk lamp designed to bring flexible light to your workspace. Choose from five brightness levels, charge it via USB-C, and turn its arm up to 270 degrees to direct light where you need it. The Nordvik 2 costs €79 and ships on 1 December. Ready to brighten your desk?
406 tokens in, 73 out · 1.5 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·
Claude Sonnet 5
Passed: Graded 4.3 of 5 on average (lowest 4).
**Introducing the Nordvik 2 Desk Lamp** Meet the Nordvik 2, thoughtfully redesigned for how you actually work. Five-step dimming lets you fine-tune brightness for any task, from focused reading to ambient evening light. The 270-degree rotating arm adjusts to virtually any angle, giving you precise control over where light falls. USB-C charging means one cable does it all, keeping your desk clutter-free and compatible with everything else you own. Priced at €79, the Nordvik 2 brings premium design and functionality within easy reach. It begins shipping on 1 December, just in time to brighten your winter workspace. Ready to see how the right light changes the way you work?
554 tokens in, 235 out · 4.5 s · $0.0035 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·
Gemini 3.1 Pro
Passed: Graded 4.0 of 5 on average (lowest 3).
Introducing the Nordvik 2 desk lamp, designed to illuminate your workspace with precision. This new model features a highly flexible arm that turns 270 degrees, putting light exactly where you need it. You can easily tailor the brightness to suit any task, as it dims in five steps. Built for modern convenience, it also charges from USB-C to keep your setup clean and wire-free. The Nordvik 2 costs €79 and ships on 1 December. Are you ready to upgrade your daily lighting?
435 tokens in, 715 out (609 of them reasoning) · 9.2 s · $0.0095 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·
Their own subscriptions
Each company's own plan at about llmwise Pro's price ($20 a month), in its own words, dated. We drop a plan here when its facts are more than 45 days old.
ChatGPT Plus (OpenAI), $20 a month
Models it names: GPT-6 Astra, GPT-6 Sol, and GPT-6 Luna. On its limits: “To ensure a smooth experience for all users, Plus subscriptions may include usage limits such as message caps, especially during high demand. These limits may vary based on system conditions.” ChatGPT Plus vs llmwise.
Checked : OpenAI Help Center: What is ChatGPT Plus?, OpenAI Help Center: Managing usage with GPT-6 Astra in Work and Codex and ChatGPT pricing.
Claude Pro (Anthropic), $20 a month
Models it names: Claude Opus, Claude Sonnet, and Claude Haiku. On its limits: “The number of messages you can send will vary based on message length, including the length of files you attach, the length of your current conversation, and the model or feature you use. Your session-based usage limit will reset every five hours.” Claude Pro vs llmwise.
Checked : Claude Help Center: What is the Pro plan?, Claude Help Center: Claude Fable models on your plan and Claude pricing.
Google AI Pro (Google), $19.99 a month
Models it names: Gemini 3.1 Pro. On its limits: “AI Pro: 4x higher than standard limits” Google AI Pro vs llmwise.
Checked : Google One: Google AI plans and Gemini Apps Help: limits and upgrades for Google AI subscribers.
llmwise Pro, $20 a month, has all 13 of these models in one chat, on one monthly allowance. On it: GPT-6.1 Sol up to 125 messages a month, Claude Sonnet 5.5 up to 125, and Gemini 3.1 Pro (preview) up to 125.
Every GPT, Claude, and Gemini model in llmwise
| Model | On Pro | On Free | Context window | Images | PDFs | Reasoning | API price per 1M, in / out |
|---|---|---|---|---|---|---|---|
| GPT-6 AstraOpenAI | 31/mo on Pro | No | 1.05M tokens | Yes | Whole file | Yes | $10.00 / $50.00 |
| GPT-6.1 SolOpenAI | 125/mo on Pro | No | 1.05M tokens | Yes | Whole file | Yes | $2.00 / $10.00 |
| GPT-6 SolOpenAI | 125/mo on Pro | No | 1.05M tokens | Yes | Whole file | Yes | $2.00 / $10.00 |
| GPT-6 LunaOpenAI | 60/day on Pro | No | 1.05M tokens | Yes | Whole file | Yes | $0.10 / $0.50 |
| Claude Fable 5.1Anthropic | 31/mo on Pro | No | 1M tokens | Yes | Whole file | Yes | $10.00 / $50.00 |
| Claude Opus 5.5Anthropic | 62/mo on Pro | No | 1M tokens | Yes | Whole file | Yes | $4.00 / $20.00 |
| Claude Sonnet 5.5Anthropic | 125/mo on Pro | No | 1M tokens | Yes | Whole file | Yes | $2.00 / $10.00 |
| Claude Sonnet 5Anthropic | 125/mo on Pro | No | 1M tokens | Yes | Whole file | Yes | $2.00 / $10.00 |
| Claude Haiku 4.5Anthropic | 250/mo on Pro | No | 200K tokens | Yes | Whole file | No | $1.00 / $5.00 |
| Claude Haiku 5.5Anthropic | 60/day on Pro | Yes | 1M tokens | Yes | Whole file | Yes | $0.10 / $0.50 |
| Gemini 4 ArgonGoogle | 62/mo on Pro | No | 1.05M tokens | Yes | Whole file | Yes | $4.00 / $20.00 |
| Gemini 3.1 Pro (preview)Google | 125/mo on Pro | No | 1.05M tokens | Yes | Whole file | Yes | $2.00 / $12.00 |
| Gemini 3.8 FlashGoogle | 250/mo on Pro | No | 1.05M tokens | Yes | Whole file | Yes | $0.75 / $3.75 |
Every limit is published. Paid plans also have a monthly fair-use limit on AI cost: Plus $3.75, Pro $7.50, Max $20, Ultra $42, Studio $85. Using every message on your plan at typical sizes stays under it; very large messages and heavy research use it faster. Every limit, explained.
More head-to-heads
These families two at a time, and the other pages about several.
Try GPT, Claude, and Gemini on your own question
Start a chat on GPT and ask a real question from your work, with any files it needs.
Switch the model picker to Claude, then Gemini in turn, and ask each for its answer. Each sees the whole chat, the other answers included.
Compare them on what matters to you: accuracy, tone, length, how much you'd have to fix.
The badge by each model in the picker shows what a message uses before you send it.
Where your messages go
In llmwise, a message to GPT, Claude, or Gemini goes to the model's maker, or through OpenRouter when llmwise can't reach the maker directly. The Privacy Policy has the details.
Questions
Which is better, ChatGPT, Claude, or Gemini?
In our test runs on October 15, 2026, the same 50 prompts across 10 jobs: GPT's 4 models passed 186 of 200 replies, Claude's 6 models passed 275 of 300 replies, and Gemini's 3 models passed 142 of 150 replies. Job by job, all 3 families' best models shared the top result on 8 of the 10 jobs; GPT's alone had it on writing; GPT's trailed on customer support; Claude's trailed on writing; Gemini's trailed on writing.
Which is cheaper, GPT, Claude, or Gemini?
At API list prices (October 2026), the least expensive model of each family for a typical message is GPT-6 Luna ($0.0008), Claude Haiku 5.5 ($0.0008), and Gemini 3.8 Flash ($0.0056). In llmwise you pay per message, and every one of them is on the same plan.
Can I use GPT, Claude, and Gemini in the same chat?
Yes. Pick GPT, Claude, and Gemini models message by message in one chat; each model sees the whole conversation, the others' answers included.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.