GPT-6 Sol · Coding

GPT-6 Sol for coding: our test runs

GPT-6 Sol ran our 5 coding prompts in llmwise, through the same pipeline your messages take. Here's every reply as it came, whether it passed, what it cost and what it counts as on Pro, next to the other models.

Start free See pricing

Based on 5 of our test runs on September 27, 2026, through OpenRouter with the app's own prompt and settings. Updated September 28, 2026.

Short answer

In our test runs on September 27, 2026, GPT-6 Sol passed 5 of 5 of our coding prompts (both hard ones): tied 1st of 15 models. Each reply counted as 1 message on Pro, where it has 125 a month, and cost $0.0052 to run on average.

Prompt by prompt

Each of the 5 coding prompts, and how GPT-6 Sol's reply did.

GPT-6 Sol on each coding prompt
Prompt	Result	Cost	Time
Turn a title into a URL slugEveryday	Passed: All 7 tests passed.	$0.0028	3.3 s
Parse a duration like “1h 30m”Everyday	Passed: All 10 tests passed.	$0.0042	4.8 s
Merge overlapping intervalsEveryday	Passed: All 7 tests passed.	$0.0022	1.7 s
Evaluate an arithmetic expression, no evalHard	Passed: All 15 tests passed.	$0.0089	9.7 s
Parse CSV with quoted fieldsHard	Passed: All 8 tests passed.	$0.0081	8.9 s

Every coding reply from GPT-6 Sol

Turn a title into a URL slug
An everyday prompt: “Turn a title into a URL slug”, in full.
Passed: All 7 tests passed.
```
```javascript
function slugify(title) {
  return title
    .normalize("NFD")
    .replace(/\p{M}/gu, "")
    .toLowerCase()
    .replace(/[^a-z0-9]+/g, "-")
    .replace(/^-|-$/g, "");
}
```
```
483 tokens in, 185 out (114 of them reasoning) · 3.3 s · $0.0028 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI · September 27, 2026

Parse a duration like “1h 30m”

An everyday prompt: “Parse a duration like “1h 30m””, in full.

Passed: All 10 tests passed.

```javascript
function parseDuration(text) {
  if (typeof text !== "string") return null;

  const match = /^ *(?:(\d+)h)? *(?:(\d+)m)? *(?:(\d+)s)? *$/.exec(text);
  if (!match || (match[1] === undefined && match[2] === undefined && match[3] === undefined)) {
    return null;
  }

  return Number(match[1] || 0) * 3600
    + Number(match[2] || 0) * 60
    + Number(match[3] || 0);
}
```

468 tokens in, 327 out (187 of them reasoning) · 4.8 s · $0.0042 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI · September 27, 2026

Merge overlapping intervals

An everyday prompt: “Merge overlapping intervals”, in full.

Passed: All 7 tests passed.

```javascript
function mergeIntervals(intervals) {
  const sorted = intervals
    .map(([start, end]) => [start, end])
    .sort((a, b) => a[0] - b[0]);

  const merged = [];

  for (const [start, end] of sorted) {
    const last = merged[merged.length - 1];

    if (last && start <= last[1]) {
      last[1] = Math.max(last[1], end);
    } else {
      merged.push([start, end]);
    }
  }

  return merged;
}
```

449 tokens in, 130 out · 1.7 s · $0.0022 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI · September 27, 2026

Evaluate an arithmetic expression, no eval

A hard prompt: “Evaluate an arithmetic expression, no eval”, in full.

Passed: All 15 tests passed.

```javascript
function evaluate(expression) {
  if (typeof expression !== "string") {
    throw new Error("Expression must be a string");
  }

  let pos = 0;
  const numberPattern = /\d+(?:\.\d+)?/y;

  function peek() {
    while (pos < expression.length && /\s/.test(expression[pos])) pos++;
    return expression[pos];
  }

  function primary() {
    if (peek() === "(") {
      pos++;
      const value = sum();
      if (peek() !== ")") throw new Error("Missing closing parenthesis");
      pos++;
      return value;
    }

    peek();
    numberPattern.lastIndex = pos;
    const match = numberPattern.exec(expression);
    if (!match) throw new Error("Expected a number or '('");
    pos = numberPattern.lastIndex;
    return Number(match[0]);
  }

  function power() {
    const left = primary();
    if (peek() === "^") {
      pos++;
      return left ** unary();
    }
    return left;
  }

  function unary() {
    if (peek() === "-") {
      pos++;
      return -unary();
    }
    return power();
  }

  function product() {
    let value = unary();
    while (true) {
      const op = peek();
      if (op !== "*" && op !== "/") return value;
      pos++;
      const right = unary();
      value = op === "*" ? value * right : value / right;
    }
  }

  function sum() {
    let value = product();
    while (true) {
      const op = peek();
      if (op !== "+" && op !== "-") return value;
      pos++;
      const right = product();
      value = op === "+" ? value + right : value - right;
    }
  }

  const result = sum();
  if (peek() !== undefined) throw new Error("Unexpected input");
  return result;
}
```

549 tokens in, 785 out (369 of them reasoning) · 9.7 s · $0.0089 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI · September 27, 2026

Parse CSV with quoted fields

A hard prompt: “Parse CSV with quoted fields”, in full.

Passed: All 8 tests passed.

```javascript
function parseCsv(text) {
  if (text === "") return [];

  const rows = [];
  let row = [];
  let field = "";
  let inQuotes = false;
  let atFieldStart = true;
  let endedWithRowBreak = false;

  for (let i = 0; i < text.length; i++) {
    const char = text[i];

    if (inQuotes) {
      if (char === '"') {
        if (text[i + 1] === '"') {
          field += '"';
          i++;
        } else {
          inQuotes = false;
        }
      } else {
        field += char;
      }
      endedWithRowBreak = false;
    } else if (char === '"' && atFieldStart) {
      inQuotes = true;
      atFieldStart = false;
      endedWithRowBreak = false;
    } else if (char === ",") {
      row.push(field);
      field = "";
      atFieldStart = true;
      endedWithRowBreak = false;
    } else if (char === "\n" || (char === "\r" && text[i + 1] === "\n")) {
      row.push(field);
      rows.push(row);
      row = [];
      field = "";
      atFieldStart = true;
      endedWithRowBreak = true;
      if (char === "\r") i++;
    } else {
      field += char;
      atFieldStart = false;
      endedWithRowBreak = false;
    }
  }

  if (!endedWithRowBreak) {
    row.push(field);
    rows.push(row);
  }

  return rows;
}
```

481 tokens in, 712 out (363 of them reasoning) · 8.9 s · $0.0081 · 1 message on Pro · answered by openai/gpt-6-sol via OpenAI · September 27, 2026

How it compares on coding

GPT-6 Sol beside the job's picks among every model. 13 models share the hard-problems pick, GPT-6 Sol among them.

GPT-6 Sol beside other models on coding
Model	Passed	On Pro	Cost per reply
GLM 5.3Our pick: hard problems (shared), best value	5 of 5	250 a month on Pro	$0.0015
GLM 5.3 FlashOur pick: hard problems (shared), everyday	5 of 5	60 a day on Pro	$0.0003
GPT-6 SolOur pick: hard problems (shared)	5 of 5	125 a month on Pro	$0.0052

On Pro: Pro's count on each model. Cost: what OpenRouter charged us per reply, on average.

Every limit is published. Paid plans also have a monthly fair-use limit on AI cost: Pro $7.50, Max $20, Ultra $42, Studio $85. Using every message on your plan at typical sizes stays under it; very large messages and heavy research use it faster. Every limit, explained.

GPT-6 Sol next to each model on coding

GPT-6 Sol against each model on the same 5 coding prompts. One run each, through OpenRouter: a wait depends on the provider and the load that day, so a lead under 10% counts as close.

Against Claude Fable 5.1: GPT-6 Sol answered 1.2× sooner (4.8 s to 5.5 s), cost 8.1× less, and passed 5 of 5 to its 5.
Against Claude Opus 5.5: GPT-6 Sol answered 1.5× sooner (4.8 s to 7.2 s), cost 3.3× less, and passed 5 of 5 to its 5.
Against Claude Sonnet 5: GPT-6 Sol answered 1.8× later (4.8 s to 2.7 s), cost 1.9× less, and passed 5 of 5 to its 5.
Against Claude Haiku 4.5: GPT-6 Sol answered 2.0× later (4.8 s to 2.3 s), cost 1.9× more, and passed 5 of 5 to its 3. Only GPT-6 Sol passed Evaluate an arithmetic expression, no eval; Parse CSV with quoted fields.
Against GPT-6 Astra: GPT-6 Sol answered 1.7× sooner (4.8 s to 8.2 s), cost 4.3× less, and passed 5 of 5 to its 5.
Against GPT-6 Luna: GPT-6 Sol answered within 10% of its time (4.8 s to 4.6 s), cost 18.3× more, and passed 5 of 5 to its 5.
Against Gemini 3.1 Pro (preview): GPT-6 Sol answered 2.1× sooner (4.8 s to 10.3 s), cost 3.7× less, and passed 5 of 5 to its 5.
Against Gemini 3.8 Flash: GPT-6 Sol answered 1.1× later (4.8 s to 4.2 s), cost 2.7× more, and passed 5 of 5 to its 5.
Against DeepSeek V4.1 Flash: GPT-6 Sol answered 1.6× sooner (4.8 s to 7.8 s), cost 4.9× more, and passed 5 of 5 to its 5.
Against DeepSeek V4 Pro: GPT-6 Sol answered 4.2× sooner (4.8 s to 20.1 s), cost 2.5× less, and passed 5 of 5 to its 4. Only GPT-6 Sol passed Parse CSV with quoted fields.
Against Grok 4.7: GPT-6 Sol answered 5.3× sooner (4.8 s to 25.3 s), cost 4.2× less, and passed 5 of 5 to its 5.
Against Kimi K3: GPT-6 Sol answered 1.2× later (4.8 s to 4.1 s), cost 1.2× less, and passed 5 of 5 to its 5.
Against GLM 5.3: GPT-6 Sol answered 4.6× later (4.8 s to 1.1 s), cost 3.6× more, and passed 5 of 5 to its 5.
Against GLM 5.3 Flash: GPT-6 Sol answered 1.7× sooner (4.8 s to 8.4 s), cost 20.8× more, and passed 5 of 5 to its 5.

How these runs were done

Tests. Automatic. The function runs against the prompt's tests in a separate Node.js process with a time limit and no file, network or child-process access; it passes when every test passes.

How the runs were done, and every coding prompt.

GPT-6 Sol, and coding, elsewhere

Questions

Is GPT-6 Sol good for coding?

In our test runs it passed 5 of 5 coding prompts, tied 1st of the 15 models in llmwise. Every reply is on this page, so you can judge them yourself.

How many of my messages does a coding reply from GPT-6 Sol use?

1 message each on Pro, where it has 125 a month on Pro. The price of a message is fixed and shown before you send it, however long the reply.

How were these runs done?

The same way for every model: each prompt sent through llmwise's own pipeline, each reply checked the same way. The methods page has every prompt and how each is scored.

Claude, GPT, Gemini, DeepSeek, Grok, Kimi, and GLM, in one chat.

See what a message costs before you send it. Free is 5 messages to try; sign in with an email link, no password or card.