Hermes 4 405B hit 96.3% on MATH-500 when it launched on August 26, 2025. That number got copy-pasted into every coverage headline within 24 hours. Most of those headlines missed the actual story. I've been running Hermes 4 on OpenRouter at $1/M input and $3/M output since the launch week, and I've had the 14B running locally on Apache 2.0. The benchmark framing bothered me from the start — not bec
The 96.3% Is a Trap: What Hermes 4 405B Actually Changed
jidonglab·Dev.to··1 min read
D
Continue reading on Dev.to
This article was sourced from Dev.to's RSS feed. Visit the original for the complete story.