Skip to content

Tested prompt · YouTube summarizer

A headphone review, as a timestamped outline: every AI model's reply, tested

We ran this hard YouTube summarizer test input on all 19 models in llmwise, the way the tool runs it, and checked every reply the same way. Here's each one as it came, with whether it passed, what it cost and how long it took.

Based on 19 of our test runs on , through OpenRouter with the tool's own instructions and the app's settings. Updated .

Short answer

All 19 models passed this YouTube summarizer test input's check (key facts). The cheapest reply that passed was GPT-6 Luna's, at $0.000086; the fastest, DeepSeek V4.1 Flash's in 0.8 s. The dearest reply, Claude Fable 5.1's, cost 332 times as much ($0.0287).

The prompt, as sent, and its check

Checked by key facts, the same way for every model.

A headphone review, as a timestamped outline (hard)

Summarize this YouTube video from its transcript. Start with one sentence on what it's about, then the key points in order. Make it a timestamped outline: each point starts with its timestamp from the transcript.

---
[00:00] Hi, I'm Maya, and this is my review of the Aurora X2 wireless headphones after three weeks of daily use.
[00:48] Build first. They weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price.
[01:42] Battery life: I measured 31 hours with noise cancelling on, against the 35 hours on the box. Ten minutes of charging gets you about five hours.
[03:05] Noise cancelling is very good on planes and trains, but it struggles with voices in an open office.
[04:10] Call quality is the weak point. People told me I sounded distant, even in a quiet room.
[05:30] The app lets you adjust the EQ and pair with two devices at once.
[06:55] They cost $499. For music and travel I'd buy them; if you take a lot of calls, look elsewhere.

Sent with the YouTube summarizer's own instructions as the system prompt, as a free run of the tool sends them.

The answer must state “01:42”, “04:10”, “06:55”, “31”, “254”, “499”.

How the YouTube summarizer's test inputs are scored, with every model's results on all five.

Every model's result

All 19 models on this test input, in catalog order.

Every model's reply to “A headphone review, as a timestamped outline”
ModelResultCostTimeReply
Claude Fable 5.1AnthropicPassed: Stated all 6 facts with the section.$0.02875.0 s383 tokens
Claude Opus 5.5AnthropicPassed: Stated all 6 facts with the section.$0.01505.7 s389 tokens
Claude Sonnet 5.5AnthropicPassed: Stated all 6 facts with the section.$0.00602.9 s408 tokens
Claude Sonnet 5AnthropicPassed: Stated all 6 facts with the section.$0.00534.3 s380 tokens
Claude Haiku 5.5AnthropicPassed: Stated all 6 facts with the section.$0.000302.2 s414 tokens
Claude Haiku 4.5AnthropicPassed: Stated all 6 facts with the section.$0.00192.5 s258 tokens
GPT-6 AstraOpenAIPassed: Stated all 6 facts with the section.$0.00893.4 s247 tokens
GPT-6.1 SolOpenAIPassed: Stated all 6 facts with the section.$0.00173.0 s237 tokens
GPT-6 SolOpenAIPassed: Stated all 6 facts with the section.$0.00212.8 s216 tokens
GPT-6 LunaOpenAIPassed: Stated all 6 facts with the section.$0.0000862.1 s238 tokens
Gemini 3.1 Pro (preview)GooglePassed: Stated all 6 facts with the section.$0.010111.9 s279 tokens
Gemini 3.8 FlashGooglePassed: Stated all 6 facts with the section.$0.000711.9 s263 tokens
DeepSeek V4.1 FlashDeepSeekPassed: Stated all 6 facts with the section.$0.000490.8 s249 tokens
DeepSeek V4 ProDeepSeekPassed: Stated all 6 facts with the section.$0.00176.1 s249 tokens
Grok 4.7xAIPassed: Stated all 6 facts with the section.$0.009520.0 s215 tokens
Kimi K3MoonshotPassed: Stated all 6 facts with the section.$0.003121.5 s265 tokens
GLM 5.3Z.aiPassed: Stated all 6 facts with the section.$0.00131.6 s245 tokens
GLM 5.3 FlashZ.aiPassed: Stated all 6 facts with the section.$0.000213.0 s246 tokens
Mistral Large 4MistralPassed: Stated all 6 facts with the section.$0.008544.8 s111 tokens

Cost: what OpenRouter charged us for the reply. Time: from sending to the whole reply. Reply: its length in tokens, thinking not counted. In llmwise you pay per message, not per token: each of these replies counted as one message on Pro.

Every reply

Every reply passed: here they are from the cheapest up.

  1. GPT-6 Luna

    Passed: Stated all 6 facts with the section.

    This video is Maya’s review of the Aurora X2 wireless headphones after three weeks of daily use, for people considering them for music, travel, or calls.
    
    - 00:00 Maya introduces her review after three weeks of daily use.
    - 00:48 They weigh 254 grams, have an aluminium headband, and feature replaceable ear cushions, which she says is rare at this price.
    - 01:42 Maya measured 31 hours of battery life with noise cancelling on, versus 35 hours stated on the box. Ten minutes of charging provides about five hours.
    - 03:05 Noise cancelling works very well on planes and trains but struggles with voices in an open office.
    - 04:10 Call quality is the weak point: people said Maya sounded distant, even in a quiet room.
    - 05:30 The app allows EQ adjustment and pairing with two devices at once.
    - 06:55 They cost $499. Maya would buy them for music and travel, but recommends looking elsewhere if you take a lot of calls.
    
    Worth watching for: Maya’s three-week-use battery measurement and direct assessment of noise cancelling and call quality.

    538 tokens in, 238 out · 2.1 s · $0.0001 · 1 message on Pro · answered by openai/gpt-6-luna via OpenAI ·

  2. GLM 5.3 Flash

    Passed: Stated all 6 facts with the section.

    This is Maya's hands-on review of the Aurora X2 wireless headphones after three weeks of daily use, for anyone deciding whether to buy them.
    
    - [00:00] Maya introduces her review based on three weeks of daily use.
    - [00:48] Build: 254 grams, aluminium headband, and replaceable ear cushions, which is rare at this price.
    - [01:42] Battery: measured 31 hours with noise cancelling on, versus 35 hours claimed on the box; ten minutes of charging gives about five hours.
    - [03:05] Noise cancelling is very good on planes and trains but struggles with voices in an open office.
    - [04:10] Call quality is the weak point — people said she sounded distant, even in a quiet room.
    - [05:30] The app allows EQ adjustment and pairing with two devices at once.
    - [06:55] Price is $499. Verdict: good for music and travel, but if you take a lot of calls, look elsewhere.
    
    Worth watching for: Maya's real-world measurements (battery and noise cancelling) and her firsthand call-quality experience, which give context beyond the spec sheet.

    553 tokens in, 246 out · 3.0 s · $0.0002 · 1 message on Pro · answered by z-ai/glm-5.3-flash via Friendli ·

  3. Claude Haiku 5.5

    Passed: Stated all 6 facts with the section.

    This video is Maya's three-week review of the Aurora X2 wireless headphones, aimed at people deciding whether to buy them for music, travel or calls.
    
    - [00:00] Maya introduces her review of the Aurora X2 wireless headphones after three weeks of daily use.
    - [00:48] Build: the headphones weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which she calls rare at this price.
    - [01:42] Battery: she measured 31 hours with noise cancelling on, against the 35 hours stated on the box. Ten minutes of charging gives about five hours of use.
    - [03:05] Noise cancelling is very good on planes and trains but struggles with voices in an open office.
    - [04:10] Call quality is the weak point; people told her she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] Price is $499. Her verdict: buy them for music and travel; if you take a lot of calls, look elsewhere.
    
    Worth watching for: her hands-on measurement of battery life against the box claim and her real-world test of call quality are the parts most worth seeing for yourself, since the transcript only gives her conclusions.

    761 tokens in, 414 out · 2.2 s · $0.0003 · 1 message on Pro · answered by anthropic/claude-haiku-5.5 via Anthropic ·

  4. DeepSeek V4.1 Flash

    Passed: Stated all 6 facts with the section.

    Maya reviews the Aurora X2 wireless headphones after three weeks of daily use, for anyone considering buying them.
    
    - [00:00] Maya's review of the Aurora X2 wireless headphones, after three weeks of daily use.
    - [00:48] Build: 254 grams, aluminium headband, replaceable ear cushions, which she calls rare at this price.
    - [01:42] Battery: she measured 31 hours with noise cancelling on, against the 35 hours on the box; ten minutes of charging gives about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but struggles with voices in an open office.
    - [04:10] Call quality is the weak point; people told her she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499; she'd buy them for music and travel, but says look elsewhere if you take a lot of calls.
    
    Worth watching for: the reviewer's own three-week measurements, particularly the 31-hour battery result against the 35 hours claimed on the box.

    569 tokens in, 331 out (82 of them reasoning) · 0.8 s · $0.0005 · 1 message on Pro · answered by deepseek/deepseek-v4.1-flash via Together ·

  5. Gemini 3.8 Flash

    Passed: Stated all 6 facts with the section.

    This video is a review of the Aurora X2 wireless headphones after three weeks of daily use, intended for anyone considering buying them.
    
    - [00:00] Maya introduces her review of the Aurora X2 wireless headphones after three weeks of daily use.
    - [00:48] The headphones weigh 254 grams, feature an aluminium headband, and have replaceable ear cushions.
    - [01:42] Battery life measured 31 hours with noise cancelling on compared to the 35 hours claimed on the box, and a ten-minute charge provides about five hours of playback.
    - [03:05] Active noise cancelling performs very well on planes and trains, but it struggles to block out voices in an open office setting.
    - [04:10] Call quality is weak, with callers reporting that Maya sounded distant even in a quiet room.
    - [05:30] The companion app allows users to adjust the EQ and supports multipoint pairing with two devices simultaneously.
    - [06:55] Priced at $499, they are recommended for music and travel, but not for people who take a lot of calls.
    
    Worth watching for: it adds nothing the summary misses.

    578 tokens in, 263 out · 1.9 s · $0.0007 · 1 message on Pro · answered by google/gemini-3.8-flash via Google AI Studio ·

  6. GLM 5.3

    Passed: Stated all 6 facts with the section.

    This is a three-week user review of the Aurora X2 wireless headphones, for buyers deciding whether the $499 price is worth it for them.
    
    - [00:00] Maya reviews the Aurora X2 wireless headphones after three weeks of daily use.
    - [00:48] They weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price.
    - [01:42] Battery life measured at 31 hours with noise cancelling on, against the 35 hours claimed on the box; ten minutes of charging gives about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but struggles with voices in an open office.
    - [04:10] Call quality is the weak point: people said she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499. For music and travel she'd buy them; if you take a lot of calls, look elsewhere.
    
    Worth watching for: nothing beyond this summary — the review is straight talking-head commentary.

    553 tokens in, 245 out · 1.6 s · $0.0013 · 1 message on Pro · answered by z-ai/glm-5.3 via Friendli ·

  7. DeepSeek V4 Pro

    Passed: Stated all 6 facts with the section.

    This is Maya's three-week review of the Aurora X2 wireless headphones, aimed at anyone considering them for music, travel, or calls.
    - [00:00] Maya introduces the review of the Aurora X2 after three weeks of daily use.
    - [00:48] Build: they weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price.
    - [01:42] Battery life: Maya measured 31 hours with noise cancelling on, against the 35 hours on the box; ten minutes of charging gives about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but struggles with voices in an open office.
    - [04:10] Call quality is the weak point: people said Maya sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499; for music and travel she'd buy them, but if you take a lot of calls, look elsewhere.
    Worth watching for: Maya's real-world battery measurement and her direct call-quality feedback from other people.

    543 tokens in, 372 out (123 of them reasoning) · 6.1 s · $0.0017 · 1 message on Pro · answered by deepseek/deepseek-v4-pro-0813 via Wafer ·

  8. GPT-6.1 Sol

    Passed: Stated all 6 facts with the section.

    Maya reviews the Aurora X2 wireless headphones after three weeks of daily use, for people considering them for music, travel, or calls.
    
    - [00:00] Maya introduces her review after three weeks of daily use.
    - [00:48] Build: They weigh 254 grams, have an aluminium headband, and feature replaceable ear cushions, which Maya says is rare at this price.
    - [01:42] Battery: Maya measured 31 hours with noise cancelling on, against the 35 hours on the box. Ten minutes of charging gets you about five hours.
    - [03:05] Noise cancelling is very good on planes and trains but struggles with voices in an open office.
    - [04:10] Call quality is the weak point: people said Maya sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499. Maya would buy them for music and travel but recommends looking elsewhere if you take a lot of calls.
    
    Worth watching for: Nothing beyond this summary is indicated in the transcript.

    538 tokens in, 237 out · 3.0 s · $0.0017 · 1 message on Pro · answered by openai/gpt-6.1-sol via OpenAI ·

  9. Claude Haiku 4.5

    Passed: Stated all 6 facts with the section.

    Maya reviews the Aurora X2 wireless headphones after three weeks of daily use, covering build quality, battery, noise cancelling, call quality, app features, and whether they're worth the $499 price.
    
    [00:48] Build: They weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price
    
    [01:42] Battery life: Measured 31 hours with noise cancelling on, against the 35 hours claimed on the box; ten minutes of charging gets about five hours
    
    [03:05] Noise cancelling is very good on planes and trains, but struggles with voices in an open office
    
    [04:10] Call quality is the weak point, with people reporting the user sounded distant even in a quiet room
    
    [05:30] The app lets you adjust the EQ and pair with two devices at once
    
    [06:55] At $499, Maya recommends them for music and travel but suggests looking elsewhere if you take a lot of calls
    
    Worth watching for: Maya's real-world testing of noise cancelling performance in different environments and her measured battery results versus the manufacturer's claims.

    576 tokens in, 258 out · 2.5 s · $0.0019 · 1 message on Pro · answered by anthropic/claude-haiku-4.5 via Anthropic ·

  10. GPT-6 Sol

    Passed: Stated all 6 facts with the section.

    Maya reviews the Aurora X2 wireless headphones after three weeks of daily use for people considering them for music, travel or calls.
    - [00:48] They weigh 254 grams, have an aluminium headband and have replaceable ear cushions, which Maya says are rare at this price.
    - [01:42] Maya measured 31 hours of battery life with noise cancelling on, against the 35 hours on the box. Ten minutes of charging gets about five hours.
    - [03:05] Noise cancelling is very good on planes and trains but struggles with voices in an open office.
    - [04:10] Call quality is the weak point: people said Maya sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499. Maya would buy them for music and travel, but says people who take a lot of calls should look elsewhere.
    Worth watching for: It adds nothing the summary misses.

    538 tokens in, 310 out (94 of them reasoning) · 2.8 s · $0.0021 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI ·

  11. Kimi K3

    Passed: Stated all 6 facts with the section.

    This video is a review of the Aurora X2 wireless headphones by Maya after three weeks of daily use, for anyone considering buying them.
    
    - [00:00] Maya introduces her review of the Aurora X2 wireless headphones after three weeks of daily use.
    - [00:48] Build: they weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price.
    - [01:42] Battery life: she measured 31 hours with noise cancelling on, against the 35 hours on the box; ten minutes of charging gets about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but struggles with voices in an open office.
    - [04:10] Call quality is the weak point: people told her she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499; for music and travel she'd buy them, but if you take a lot of calls, look elsewhere.
    
    Worth watching for: the summary covers everything the review states; the video itself may show the headphones and app, but nothing essential is missed.

    624 tokens in, 275 out (10 of them reasoning) · 21.5 s · $0.0031 · 1 message on Pro · answered by moonshotai/kimi-k3 via Wafer ·

  12. Claude Sonnet 5

    Passed: Stated all 6 facts with the section.

    This is Maya's personal review of the Aurora X2 wireless headphones after three weeks of daily use, aimed at anyone deciding whether to buy them.
    
    [00:00] Introduction: review of the Aurora X2 wireless headphones after three weeks of daily use
    [00:48] Build: 254 grams, aluminium headband, replaceable ear cushions, which is rare at this price
    [01:42] Battery life: measured 31 hours with noise cancelling on, versus 35 hours claimed on the box; ten minutes of charging gets about five hours
    [03:05] Noise cancelling is very good on planes and trains, but struggles with voices in an open office
    [04:10] Call quality is the weak point; people said Maya sounded distant, even in a quiet room
    [05:30] The app allows EQ adjustment and pairing with two devices at once
    [06:55] Price is $499; recommended for music and travel, but not recommended for people who take a lot of calls
    
    Worth watching for: Maya's own hands-on demonstration and specific measured figures (like the 31-hour battery test and call quality feedback from others) that add real-world detail beyond the spec sheet.

    759 tokens in, 380 out · 4.3 s · $0.0053 · 1 message on Pro · answered by anthropic/claude-sonnet-5 via Anthropic ·

  13. Claude Sonnet 5.5

    Passed: Stated all 6 facts with the section.

    This video is Maya's review of the Aurora X2 wireless headphones after three weeks of daily use, for people deciding whether to buy them.
    
    - [00:00] Maya introduces her review of the Aurora X2 after three weeks of daily use.
    - [00:48] Build: they weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which she calls rare at this price.
    - [01:42] Battery: she measured 31 hours with noise cancelling on, against the 35 hours stated on the box. Ten minutes of charging gets about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but it struggles with voices in an open office.
    - [04:10] Call quality is the weak point: people told her she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499. For music and travel she would buy them; if you take a lot of calls, she says to look elsewhere.
    
    Worth watching for: nothing the summary misses, as far as the transcript shows; it doesn't mention any demonstration, chart or story, so the visuals and how the call audio actually sounds are the only things I can't tell you about.

    761 tokens in, 408 out · 2.9 s · $0.0060 · 1 message on Pro · answered by anthropic/claude-sonnet-5.5 via Anthropic ·

  14. Mistral Large 4

    Passed: Stated all 6 facts with the section.

    This is Maya's review of the Aurora X2 wireless headphones after three weeks of daily use, for people considering buying them.
    
    - [00:00] Maya introduces herself and states this is her review of the Aurora X2 wireless headphones after three weeks of daily use.
    - [00:48] Build: they weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price.
    - [01:42] Battery life: she measured 31 hours with noise cancelling on, against the 35 hours on the box; Ten minutes of charging gets you about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but it struggles with voices in an open office.
    - [04:10] Call quality is the weak point; people told her she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499; for music and travel she'd buy them, but if you take a lot of calls, look elsewhere.
    
    Worth watching for: it adds nothing the summary misses.

    550 tokens in, 3,895 out (3,784 of them reasoning) · 44.8 s · $0.0085 · 1 message on Pro · answered by mistralai/mistral-large-4-0 via Mistral ·

  15. GPT-6 Astra

    Passed: Stated all 6 facts with the section.

    This video reviews the Aurora X2 wireless headphones after Maya’s three weeks of daily use, for buyers weighing them for music, travel, and calls.
    
    - [00:00] Maya introduces her review after three weeks of daily use.
    - [00:48] Build: They weigh 254 grams, have an aluminium headband, and feature replaceable ear cushions, which Maya says are rare at this price.
    - [01:42] Battery: Maya measured 31 hours with noise cancelling on, against the 35 hours on the box. Ten minutes of charging gets you about five hours.
    - [03:05] Noise cancelling: Very good on planes and trains, but struggles with voices in an open office.
    - [04:10] Call quality: The weak point—people said Maya sounded distant, even in a quiet room.
    - [05:30] App: Lets you adjust the EQ and pair with two devices at once.
    - [06:55] Price and verdict: They cost $499. Maya would buy them for music and travel, but recommends looking elsewhere if you take a lot of calls.
    
    Worth watching for: Based on the transcript, it adds nothing the summary misses.

    538 tokens in, 247 out · 3.4 s · $0.0089 · 1 message on Pro · answered by openai/gpt-6-astra via OpenAI ·

  16. Grok 4.7

    Passed: Stated all 6 facts with the section.

    This is Maya's review of the Aurora X2 wireless headphones after three weeks of daily use, for anyone deciding whether to buy them.
    - [00:48] They weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price.
    - [01:42] She measured 31 hours of battery life with noise cancelling on, against the 35 hours on the box, and ten minutes of charging gets you about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but it struggles with voices in an open office.
    - [04:10] Call quality is the weak point; people told her she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499; for music and travel she would buy them, and if you take a lot of calls, look elsewhere.
    Worth watching for: nothing the summary misses.

    1,773 tokens in, 1,374 out (1,159 of them reasoning) · 20.0 s · $0.0095 · 1 message on Pro · answered by x-ai/grok-4.7 via xAI ·

  17. Gemini 3.1 Pro

    Passed: Stated all 6 facts with the section.

    This video is a review of the Aurora X2 wireless headphones after three weeks of daily use, aimed at anyone looking to buy premium headphones for travel, music, or calls.
    
    - [00:00] Maya introduces her review of the Aurora X2 wireless headphones after three weeks of daily use.
    - [00:48] The headphones weigh 254 grams, feature an aluminium headband, and have replaceable ear cushions, which is rare for the price.
    - [01:42] Battery life measured at 31 hours with noise cancelling on, compared to the 35 hours stated on the box, and a ten-minute charge gives you about five hours of use.
    - [03:05] Noise cancelling works very well on planes and trains, but struggles to block out voices in an open office.
    - [04:10] Call quality is the weak point, making the user sound distant even in a quiet room.
    - [05:30] The companion app allows you to adjust the EQ and pair the headphones with two devices at once.
    - [06:55] They cost $499 and are recommended for music and travel, but you should look elsewhere if you take a lot of calls.
    
    Worth watching for: it adds nothing the summary misses.

    578 tokens in, 1,589 out (1,310 of them reasoning) · 11.9 s · $0.0101 · 1 message on Pro · answered by google/gemini-3.1-pro-preview via Google AI Studio ·

  18. Claude Opus 5.5

    Passed: Stated all 6 facts with the section.

    Maya reviews the Aurora X2 wireless headphones after three weeks of daily use, for anyone deciding whether to buy them.
    
    - [00:00] Maya introduces her review of the Aurora X2 wireless headphones, based on three weeks of daily use.
    - [00:48] Build: they weigh 254 grams, have an aluminium headband, and the ear cushions are replaceable, which she says is rare at this price.
    - [01:42] Battery: she measured 31 hours with noise cancelling on, against the 35 hours claimed on the box. Ten minutes of charging gives about five hours.
    - [03:05] Noise cancelling is very good on planes and trains but struggles with voices in an open office.
    - [04:10] Call quality is the weak point. People said she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499. She'd buy them for music and travel, but if you take a lot of calls, she says look elsewhere.
    
    Worth watching for: nothing the summary misses, going by the transcript. It's a spoken review with no demonstrations or sound tests mentioned.

    761 tokens in, 559 out (170 of them reasoning) · 5.7 s · $0.0150 · 1 message on Pro · answered by anthropic/claude-opus-5.5 via Google ·

  19. Claude Fable 5.1

    Passed: Stated all 6 facts with the section.

    Maya reviews the Aurora X2 wireless headphones after three weeks of daily use, for anyone deciding whether they suit music, travel or calls.
    
    - [00:00] Maya introduces the review: Aurora X2 wireless headphones after three weeks of daily use.
    - [00:48] Build: they weigh 254 grams, the headband is aluminium, and the ear cushions are replaceable, which is rare at this price.
    - [01:42] Battery life: she measured 31 hours with noise cancelling on, against the 35 hours on the box. Ten minutes of charging gets about five hours.
    - [03:05] Noise cancelling is very good on planes and trains, but struggles with voices in an open office.
    - [04:10] Call quality is the weak point: people told her she sounded distant, even in a quiet room.
    - [05:30] The app lets you adjust the EQ and pair with two devices at once.
    - [06:55] They cost $499. For music and travel she'd buy them; if you take a lot of calls, look elsewhere.
    
    Worth watching for: nothing the summary misses; the transcript is a straightforward spoken review with no demonstrations or visuals described.

    761 tokens in, 383 out · 5.0 s · $0.0287 · 1 message on Pro · answered by anthropic/claude-fable-5.1 via Google ·

More YouTube summarizer test inputs

The other YouTube summarizer test inputs, each with every model's reply, and the results across all five.

Questions

Which AI does best on “A headphone review, as a timestamped outline”?

All 19 models passed this YouTube summarizer test input's check (key facts). The cheapest reply that passed was GPT-6 Luna's, at $0.000086; the fastest, DeepSeek V4.1 Flash's in 0.8 s. The dearest reply, Claude Fable 5.1's, cost 332 times as much ($0.0287).

What does a reply to “A headphone review, as a timestamped outline” cost?

Through the models' APIs, what OpenRouter charged us ran from $0.000086 (GPT-6 Luna) to $0.0287 (Claude Fable 5.1) for this test input. In llmwise you don't pay by the token: a reply like these counts as one message on Pro, whichever model answers.

Claude, GPT, Gemini, DeepSeek, Grok, Kimi, GLM, and Mistral, in one chat.

See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.