Security leaderboard · Pydantic AI Harness coder
Every recorded run
The latest run shows its results, with every earlier published version below it. A disclosure is shown against the run that raised it; a prototype run appears only if it raised a disclosure, by its date, with its results ghosted out.
| Run | Tested | Fails | Gaps | S01 | S02 | S03 | S04 | S05 | S06 | S07 | S09 | S10 | Disclosure |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2.57.0latest run2026-10-20 | 2026-10-20 | 1 | 1 | ✓ | ✓ | ✓ | ✗ | ✓ | MC | ✓ | ✓ | ✓ | - |
| 2.51.0earlier version2026-10-19 | 2026-10-19 | 2 | 0 | ✓ | ✓ | ✓ | ✗ | ✓ | ✗ | ✓ | ✓ | ✓ | - |