Skip to content
llmwise
Sign inStart free

Tested prompt · SQL

Customers in one country: every AI model's reply, tested

We sent this everyday SQL prompt to all 20 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.

Start freeSee pricing

Based on 20 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .

Short answer

All 20 models passed this SQL prompt's check (query result). The cheapest reply that passed was GPT-6 Luna's, at $0.000060; the fastest, DeepSeek V4.1 Flash's in 0.3 s. The dearest reply, Claude Fable 5.1's, cost 199 times as much ($0.0120).

The prompt, as sent, and its check

Checked by query result, the same way for every model.

Customers in one country (everyday)

[5 lines every SQL prompt of ours shares, word for word: the whole prompt, on the methods page]
List the names of the customers in Canada, in alphabetical order.
Write one SQLite query and reply with it in a ```sql code block.

The query must return the same rows as this one, on the fixture database below, in the same order:

SELECT name FROM customers WHERE country = 'Canada' ORDER BY name

Exactly what this prompt's replies are checked against, with every other prompt of our test runs.

Every model's result

All 20 models on this prompt, in catalog order.

Every model's reply to “Customers in one country”
ModelResultCostTimeReply
Claude Fable 5.1AnthropicPassed: Returned the right 3 rows.$0.01203.2 s41 tokens
Claude Opus 5.5AnthropicPassed: Returned the right 3 rows.$0.00482.5 s41 tokens
Claude Sonnet 5.5AnthropicPassed: Returned the right 3 rows.$0.00241.8 s41 tokens
Claude Sonnet 5AnthropicPassed: Returned the right 3 rows.$0.00201.8 s41 tokens
Claude Haiku 5.5AnthropicPassed: Returned the right 3 rows.$0.000121.0 s38 tokens
Claude Haiku 4.5AnthropicPassed: Returned the right 3 rows.$0.000651.1 s25 tokens
GPT-6 AstraOpenAIPassed: Returned the right 3 rows.$0.00611.5 s25 tokens
GPT-6.1 SolOpenAIPassed: Returned the right 3 rows.$0.000611.2 s25 tokens
GPT-6 SolOpenAIPassed: Returned the right 3 rows.$0.00121.1 s24 tokens
GPT-6 LunaOpenAIPassed: Returned the right 3 rows.$0.0000601.0 s24 tokens
Gemini 4 ArgonGooglePassed: Returned the right 3 rows.$0.000882.0 s27 tokens
Gemini 3.1 Pro (preview)GooglePassed: Returned the right 3 rows.$0.00294.9 s26 tokens
Gemini 3.8 FlashGooglePassed: Returned the right 3 rows.$0.000483.1 s23 tokens
DeepSeek V4.1 FlashDeepSeekPassed: Returned the right 3 rows.$0.000110.3 s23 tokens
DeepSeek V4 ProDeepSeekPassed: Returned the right 3 rows.$0.000401.2 s21 tokens
Grok 4.7xAIPassed: Returned the right 3 rows.$0.00221.5 s20 tokens
Kimi K3MoonshotPassed: Returned the right 3 rows.$0.00181.1 s30 tokens
GLM 5.3Z.aiPassed: Returned the right 3 rows.$0.000130.8 s20 tokens
GLM 5.3 FlashZ.aiPassed: Returned the right 3 rows.$0.000131.2 s21 tokens
Mistral Large 4MistralPassed: Returned the right 3 rows.$0.000431.2 s17 tokens

Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.

Every reply

Every reply passed: here they are from the cheapest up.

  1. GPT-6 Luna

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    483 tokens in, 24 out · 1.0 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·

  2. DeepSeek V4.1 Flash

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name ASC;
```

    524 tokens in, 26 out (3 of them reasoning) · 0.3 s · $0.0001 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Together ·

  3. Claude Haiku 5.5

    Passed: Returned the right 3 rows.

    ```sql
SELECT name FROM customers WHERE country = 'Canada' ORDER BY name;
```

    809 tokens in, 38 out · 1.0 s · $0.0001 · 1 message on Pro · answered by anthropic/claude-haiku-5.5 via Anthropic ·

  4. GLM 5.3 Flash

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    498 tokens in, 39 out (18 of them reasoning) · 1.2 s · $0.0001 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Wafer ·

  5. GLM 5.3

    Passed: Returned the right 3 rows.

    ```sql
SELECT name FROM customers WHERE country = 'Canada' ORDER BY name;
```

    497 tokens in, 20 out · 0.8 s · $0.0001 · 1 message on Pro · answered by z-ai/glm-5.3 via Baidu ·

  6. DeepSeek V4 Pro

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    496 tokens in, 62 out (41 of them reasoning) · 1.2 s · $0.0004 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·

  7. Mistral Large 4

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    489 tokens in, 47 out (30 of them reasoning) · 1.2 s · $0.0004 · 1 message on Pro · answered by mistralai/mistral-large-4-0 via Mistral ·

  8. Gemini 3.8 Flash

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name ASC;
```

    523 tokens in, 23 out · 3.1 s · $0.0005 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·

  9. GPT-6.1 Sol

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name ASC;
```

    485 tokens in, 25 out · 1.2 s · $0.0006 · 1 message on Pro · answered by openai/gpt-6.1-sol via OpenAI ·

  10. Claude Haiku 4.5

    Passed: Returned the right 3 rows.

    ```sql
SELECT name FROM customers WHERE country = 'Canada' ORDER BY name ASC;
```

    528 tokens in, 25 out · 1.1 s · $0.0007 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·

  11. Gemini 4 Argon

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name ASC;
```

    744 tokens in, 27 out · 2.0 s · $0.0009 · 1 message on Pro · answered by google/gemini-4-argon via Google AI Studio ·

  12. GPT-6 Sol

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    483 tokens in, 24 out · 1.1 s · $0.0012 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·

  13. Kimi K3

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    570 tokens in, 36 out (6 of them reasoning) · 1.1 s · $0.0018 · 1 message on Pro · answered by moonshotai/kimi-k3 via Phala ·

  14. Claude Sonnet 5

    Passed: Returned the right 3 rows.

    ```sql
SELECT name FROM customers WHERE country = 'Canada' ORDER BY name ASC;
```

    806 tokens in, 41 out · 1.8 s · $0.0020 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·

  15. Grok 4.7

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    1,730 tokens in, 79 out (59 of them reasoning) · 1.5 s · $0.0022 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·

  16. Claude Sonnet 5.5

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    810 tokens in, 41 out · 1.8 s · $0.0024 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·

  17. Gemini 3.1 Pro

    Passed: Returned the right 3 rows.

    ```sql
SELECT name 
FROM customers 
WHERE country = 'Canada' 
ORDER BY name ASC;
```

    523 tokens in, 156 out (130 of them reasoning) · 4.9 s · $0.0029 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·

  18. Claude Opus 5.5

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    808 tokens in, 41 out · 2.5 s · $0.0048 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·

  19. GPT-6 Astra

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name ASC;
```

    483 tokens in, 25 out · 1.5 s · $0.0061 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·

  20. Claude Fable 5.1

    Passed: Returned the right 3 rows.

    ```sql
SELECT name
FROM customers
WHERE country = 'Canada'
ORDER BY name;
```

    808 tokens in, 41 out · 3.2 s · $0.0120 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·

More SQL prompts

The other SQL prompts, each with every model's reply, and the results across all five.

Questions

Which AI does best on “Customers in one country”?

All 20 models passed this SQL prompt's check (query result). The cheapest reply that passed was GPT-6 Luna's, at $0.000060; the fastest, DeepSeek V4.1 Flash's in 0.3 s. The dearest reply, Claude Fable 5.1's, cost 199 times as much ($0.0120).

What does a reply to “Customers in one country” cost?

Through the models' APIs, what OpenRouter charged us ran from $0.000060 (GPT-6 Luna) to $0.0120 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.

Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.

See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.

Start freeSee pricing