RealRun / Guides
Short answer: It depends on the job, and on which model you pick inside each brand. Head to head, OpenAI's GPT-6.1 Sol beat Claude Opus on three jobs: inbox triage (GPT-6.1 Sol 95.0%, Claude Opus 94.4%), receipts (GPT-6.1 Sol 95.8, Claude Opus 89.7) and finance (GPT-6.1 Sol 96.0, Claude Opus 93.2). They tied at 100% on scheduling. Claude Opus led customer support replies at 98.6. The bigger gap was inside each family: Claude Haiku filed scam emails as Act, and GPT-5.4 mini came last on support.
| Model | Inbox triage | Scheduling | Receipts | Finance | Support replies |
|---|---|---|---|---|---|
| GPT-6.1 Sol | 95.0 | 100.0 | 95.8 | 96.0 | 97.3 |
| GPT-6 Luna | not tested | not tested | 91.4 | 96.3 | 82.2 |
| GPT-5.4 mini | 95.0 | 90.0 | not tested | not tested | 68.0 |
| Claude Opus | 94.4 | 100.0 | 89.7 | 93.2 | 98.6 |
| Claude Sonnet | 91.7 | 100.0 | not tested | not tested | 89.4 |
| Claude Haiku | 85.6 | 96.7 | 92.8 | 91.7 | 80.5 |
Inbox triage and scheduling are percentages; receipts, finance and support are 0 to 100 scores with points off for severe errors. ChatGPT runs on OpenAI's GPT models, so we tested the GPT models directly. We did not test the ChatGPT or Claude apps, their plans, or features like file uploads and connectors.
How the testing works: we wrote our own synthetic test sets with planted traps, like scam emails, calendar conflicts, bad math and fake invoices. Each job also has a separate held-back set, written blind and kept out of all prompt and scoring tuning, that only ran at the end. Every model in a job got the same items. Most ran 2 or more passes; in the support test 3 of 10 models ran 1 pass and are marked less certain. All data is synthetic, never real accounts. Scores differ by job (accuracy %, valid-answer % or a 0 to 100 score with 5 points off per severe error), so compare models within a column, not across columns.
Results updated 15 Oct 2026. Tests run October 2026. Full data: results.json.
The way this goes wrong is picking a brand instead of a model. GPT-5.4 mini scored 95.0% on email but 68.0 on support replies. Claude Opus filed no scams as Act while Claude Haiku did. Whichever app you pay for, check which model it is running before you hand it your inbox or your customer email.
When a client asks "Claude or ChatGPT?", answer with the job and the model name, and show the score. You might put Claude Opus on their support inbox and GPT-6 Luna on their bank exports. That is a better answer than picking a side, and you can defend it.
Want the exact prompt and setup?
Get all five playbooks for $99 (save $46).
Scores reflect our tests on the dates shown, not a guarantee. Claude models ran on a Claude subscription, so they have no metered API cost. cost_tier is relative within a task (low/medium/high) from our run spend; 'subscription' = not metered. Tested October 2026 by RealRun (Base Ledger IP LLC).