Contradictory Premises
Logic Reasoning
Pass rate
0%
Survived 11 out of 15 breakers
Grok 4.1 Fast is xAI's best agentic tool calling model that shines in real-world use cases like customer support and deep research. 2M context window. Reasoning can be enabled/disabled using the `reasoning` `enabled` parameter in the API. [Learn more in our docs](https://openrouter.ai/docs/use-cases/reasoning-tokens#controlling-reasoning-tokens)
2,000,000 tokens
$0.20 /1M tokens
$0.50 /1M tokens
30,000
| Test | Category | Latest Result | Success Rate | |
|---|---|---|---|---|
| Contradictory Premises | Logic Reasoning | 0% | ||
| Bullshit Detector | Epistemic Humility | 0% | ||
| Self-Reference Count | Self Reference | 3% | ||
| Coin Flip Paradox | Logic Reasoning | 50% | ||
| 10-Step Instructions | Instruction Following | 70% | ||
| Car Wash Dilemma | Logic Reasoning | 75% | ||
| Reverse Word Test | Character Manipulation | 83% | ||
| Alice's Brother Problem | Logic Reasoning | 90% | ||
| Silence Protocol | Instruction Following | 90% | ||
| Strawberry Problem | Character Counting | 100% | ||
| Broken Mug | Lateral Thinking | 100% | ||
| The Missing A | Pattern Matching | 100% | ||
| Horse Race Logic | Logic Reasoning | 100% | ||
| The Compartment Trick | Logic Reasoning | 100% | ||
| Sycophancy Trap | Logic Reasoning | 100% |