Tested prompt · RAG and answering from documents
Core hours and start times: every AI model's reply, tested
We sent this everyday RAG and answering from documents prompt to all 20 models in llmwise, the same way the app sends a message, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.
Based on 20 of our test runs on , through OpenRouter with the app's own prompt and settings. Updated .
Short answer
All 20 models passed this RAG and answering from documents prompt's check (key facts). The cheapest reply that passed was GPT-6 Luna's, at $0.000079; the fastest, DeepSeek V4.1 Flash's in 0.3 s. The dearest reply, Claude Fable 5.1's, cost 169 times as much ($0.0135).
The prompt, as sent, and its check
Checked by key facts, the same way for every model.
Core hours and start times (everyday)
[9 lines every RAG and answering from documents prompt of ours shares, word for word: the whole prompt, on the methods page] Question: What are the core hours, and how early can I start?
The answer must state “10:00”, “16:00”, “07:30”, “§1”.
Exactly what this prompt's replies are checked against, with every other prompt of our test runs.
Every model's result
All 20 models on this prompt, in catalog order.
| Model | Result | Cost | Time | Reply |
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | Passed: Stated all 4 facts with the section. | $0.0135 | 3.7 s | 49 tokens |
| Claude Opus 5.5Anthropic | Passed: Stated all 4 facts with the section. | $0.0054 | 2.6 s | 49 tokens |
| Claude Sonnet 5.5Anthropic | Passed: Stated all 4 facts with the section. | $0.0027 | 1.4 s | 52 tokens |
| Claude Sonnet 5Anthropic | Passed: Stated all 4 facts with the section. | $0.0022 | 2.1 s | 40 tokens |
| Claude Haiku 5.5Anthropic | Passed: Stated all 4 facts with the section. | $0.00013 | 1.0 s | 37 tokens |
| Claude Haiku 4.5Anthropic | Passed: Stated all 4 facts with the section. | $0.00091 | 1.1 s | 40 tokens |
| GPT-6 AstraOpenAI | Passed: Stated all 4 facts with the section. | $0.0080 | 2.4 s | 31 tokens |
| GPT-6.1 SolOpenAI | Passed: Stated all 4 facts with the section. | $0.00080 | 1.3 s | 31 tokens |
| GPT-6 SolOpenAI | Passed: Stated all 4 facts with the section. | $0.0016 | 1.1 s | 30 tokens |
| GPT-6 LunaOpenAI | Passed: Stated all 4 facts with the section. | $0.000079 | 1.0 s | 31 tokens |
| Gemini 4 ArgonGoogle | Passed: Stated all 4 facts with the section. | $0.0011 | 4.3 s | 37 tokens |
| Gemini 3.1 Pro (preview)Google | Passed: Stated all 4 facts with the section. | $0.0052 | 5.8 s | 33 tokens |
| Gemini 3.8 FlashGoogle | Passed: Stated all 4 facts with the section. | $0.00065 | 2.9 s | 33 tokens |
| DeepSeek V4.1 FlashDeepSeek | Passed: Stated all 4 facts with the section. | $0.00013 | 0.3 s | 34 tokens |
| DeepSeek V4 ProDeepSeek | Passed: Stated all 4 facts with the section. | $0.00036 | 0.8 s | 28 tokens |
| Grok 4.7xAI | Passed: Stated all 4 facts with the section. | $0.0028 | 1.9 s | 32 tokens |
| Kimi K3Moonshot | Passed: Stated all 4 facts with the section. | $0.0011 | 1.2 s | 44 tokens |
| GLM 5.3Z.ai | Passed: Stated all 4 facts with the section. | $0.00072 | 0.5 s | 29 tokens |
| GLM 5.3 FlashZ.ai | Passed: Stated all 4 facts with the section. | $0.00022 | 3.9 s | 29 tokens |
| Mistral Large 4Mistral | Passed: Stated all 4 facts with the section. | $0.0018 | 6.5 s | 59 tokens |
Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.
Every reply
Every reply passed: here they are from the cheapest up.
GPT-6 Luna
Passed: Stated all 4 facts with the section.
Core hours are 10:00–16:00, and you can start as early as 07:30. (§1)
640 tokens in, 31 out · 1.0 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·
Claude Haiku 5.5
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00 (§1). You can start any time from 07:30 (§1).
894 tokens in, 37 out · 1.0 s · $0.0001 · 1 message on Pro · answered by anthropic/claude-haiku-5.5 via Anthropic ·
DeepSeek V4.1 Flash
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start any time between 07:30 and 10:00 (§1).
687 tokens in, 62 out (28 of them reasoning) · 0.3 s · $0.0001 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Together ·
GLM 5.3 Flash
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start as early as 07:30 (§1).
660 tokens in, 84 out (55 of them reasoning) · 3.9 s · $0.0002 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Wafer ·
DeepSeek V4 Pro
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start as early as 07:30 (§1).
659 tokens in, 49 out (21 of them reasoning) · 0.8 s · $0.0004 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·
Gemini 3.8 Flash
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start as early as 07:30 (§1).
699 tokens in, 33 out · 2.9 s · $0.0006 · 1 message on Pro · answered by google/gemini-3.8-flash via Google ·
GLM 5.3
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start any time from 07:30 (§1).
683 tokens in, 30 out (1 of them reasoning) · 0.5 s · $0.0007 · 1 message on Pro · answered by z-ai/glm-5.3 via Wafer ·
GPT-6.1 Sol
Passed: Stated all 4 facts with the section.
Core hours are **10:00–16:00**, and you can start as early as **07:30** (§1).
642 tokens in, 31 out · 1.3 s · $0.0008 · 1 message on Pro · answered by openai/gpt-6.1-sol via OpenAI ·
Claude Haiku 4.5
Passed: Stated all 4 facts with the section.
According to §1, core hours are 10:00 to 16:00, and you can start any time between 07:30 and 10:00.
710 tokens in, 40 out · 1.1 s · $0.0009 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Amazon Bedrock ·
Gemini 4 Argon
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and the earliest you can start is 07:30 (§1).
916 tokens in, 37 out · 4.3 s · $0.0011 · 1 message on Pro · answered by google/gemini-4-argon via Google AI Studio ·
Kimi K3
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start any time between 07:30 and 10:00. (§1)
730 tokens in, 67 out (23 of them reasoning) · 1.2 s · $0.0011 · 1 message on Pro · answered by moonshotai/kimi-k3 via Wafer ·
GPT-6 Sol
Passed: Stated all 4 facts with the section.
Core hours are 10:00–16:00, and you can start as early as 07:30 (§1).
640 tokens in, 30 out · 1.1 s · $0.0016 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·
Mistral Large 4
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00. You can start as early as 07:30 (§1).
651 tokens in, 645 out (586 of them reasoning) · 6.5 s · $0.0018 · 1 message on Pro · answered by mistralai/mistral-large-4-0 via Mistral ·
Claude Sonnet 5
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start any time between 07:30 and 10:00 (§1).
891 tokens in, 40 out · 2.1 s · $0.0022 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Claude Platform on AWS ·
Claude Sonnet 5.5
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start any time between 07:30 and 10:00, so the earliest start is 07:30. (§1)
895 tokens in, 52 out · 1.4 s · $0.0027 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·
Grok 4.7
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start any time between 07:30 and 10:00 (§1).
1,875 tokens in, 126 out (94 of them reasoning) · 1.9 s · $0.0028 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·
Gemini 3.1 Pro
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start as early as 07:30 (§1).
699 tokens in, 316 out (283 of them reasoning) · 5.8 s · $0.0052 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google ·
Claude Opus 5.5
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start as early as 07:30 (any time between 07:30 and 10:00) (§1).
893 tokens in, 49 out · 2.6 s · $0.0054 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Claude Platform on AWS ·
GPT-6 Astra
Passed: Stated all 4 facts with the section.
Core hours are **10:00–16:00**, and you can start as early as **07:30** (§1).
640 tokens in, 31 out · 2.4 s · $0.0080 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·
Claude Fable 5.1
Passed: Stated all 4 facts with the section.
Core hours are 10:00 to 16:00, and you can start as early as 07:30 (any time between 07:30 and 10:00) (§1).
893 tokens in, 49 out · 3.7 s · $0.0135 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Anthropic ·
More RAG and answering from documents prompts
The other RAG and answering from documents prompts, each with every model's reply, and the results across all five.
Questions
Which AI does best on “Core hours and start times”?
All 20 models passed this RAG and answering from documents prompt's check (key facts). The cheapest reply that passed was GPT-6 Luna's, at $0.000079; the fastest, DeepSeek V4.1 Flash's in 0.3 s. The dearest reply, Claude Fable 5.1's, cost 169 times as much ($0.0135).
What does a reply to “Core hours and start times” cost?
Through the models' APIs, what OpenRouter charged us ran from $0.000079 (GPT-6 Luna) to $0.0135 (Claude Fable 5.1) for this prompt. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.
Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.
See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.