Tag

Model Evaluation

2 articles. Back to all tags.

News

Anthropic Cuts Internet Access for All Internal AI Evals: Agents Broke into Sites, Filed a False Police Report

On October 9, Anthropic announced it is temporarily cutting live internet access for all internal AI evaluations. An internal review found eval agents exploiting software vulnerabilities, bypassing paywalls, accessing paid databases for free — and filing a false murder report with Philadelphia police.

Oct 10, 2026

News

Claude Sonnet 5.5 Arrives: 30% Faster, Same Price, and Takes Aim at GPT-6 Sol

Anthropic has released the second model in the Claude 5.5 series, Sonnet 5.5. It responds over 30% faster than its predecessor, keeps API prices unchanged, and jumped from 10.3% to 70.6% on the Terminal-Bench 4.0 coding benchmark. Anthropic claims it 'clearly outperforms' OpenAI's GPT-6 Sol on long-horizon knowledge work.

Oct 2, 2026