Bug fixes / v2.1.299
Fail plugin eval runs on API errors
CHANGELOG · original
Fixed claude plugin eval passing runs that the API refused: a run that ends on an API error now scores 0 without grading and makes the suite exit 1 Open official changelog ↗ Related documentation
Background on the feature; see the changelog above for this specific change.