Predict everyday physical and social outcomes a typical adult would expect.
Robustly handle adversarial edge cases without falling back on canned responses.
WinoGrande, HellaSwag at near-ceiling on standard splits.
Novel physical situations outside training distribution; adversarial reformulations.
| Technology | Quality | Source | Score vs. baseline | Score |
|---|---|---|---|---|
| Llama 4 Maverick | vendor reported | ai.meta.com/llama-4 | 66% |