9/30 resolved · labels {'WRONG_FIX': 11, 'RESOLVED': 9, 'LOOP': 4, 'CONTEXT': 3, 'NO_PATCH': 2, 'INTERFACE': 1}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13207 | yes | RESOLVED | PASS | 19 | 3 | 72 |
| fastapi_13537 | yes | RESOLVED | PASS | 18 | 5 | 186 |
| fastapi_14301 | yes | RESOLVED | PASS | 7 | 0 | 68 |
| fastapi_14372 | yes | RESOLVED | PASS | 7 | 2 | 49 |
| fastapi_14786 | yes | RESOLVED | PASS | 8 | 3 | 62 |
| requests_6644 | yes | RESOLVED | PASS | 18 | 3 | 92 |
| requests_7505 | yes | RESOLVED | PASS | 34 | 17 | 215 |
| rich_3905 | yes | RESOLVED | PASS | 9 | 3 | 105 |
| rich_4077 | yes | RESOLVED | PASS | 10 | 0 | 286 |
| fastapi_11355 | no | WRONG_FIX | wrong_fix_unsubmitted(timeout) | 33 | 8 | 0 |
| fastapi_13786 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 23 | 3 | 301 |
| fastapi_14306 | no | LOOP | wrong_fix | 47 | 12 | 216 |
| fastapi_14430 | no | WRONG_FIX | wrong_fix | 30 | 2 | 264 |
| fastapi_14448 | no | WRONG_FIX | wrong_fix | 31 | 0 | 174 |
| fastapi_14482 | no | WRONG_FIX | wrong_fix | 34 | 4 | 158 |
| fastapi_14605 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 33 | 3 | 311 |
| fastapi_14609 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 23 | 0 | 308 |
| fastapi_14791 | no | WRONG_FIX | wrong_fix | 4 | 0 | 56 |
| fastapi_14964 | no | WRONG_FIX | wrong_fix | 16 | 4 | 99 |
| fastapi_5624 | no | NO_PATCH | empty_patch(budget) | 10 | 2 | 301 |
| requests_7427 | no | INTERFACE | wrong_fix_unsubmitted(budget) | 27 | 16 | 307 |
| rich_3471 | no | WRONG_FIX | wrong_fix | 28 | 3 | 71 |
| rich_3535 | no | LOOP | empty_patch(budget) | 29 | 17 | 304 |
| rich_3675 | no | WRONG_FIX | wrong_fix | 6 | 1 | 62 |
| rich_3882 | no | NO_PATCH | empty_patch(budget) | 23 | 2 | 305 |
| rich_3934 | no | LOOP | wrong_fix | 22 | 1 | 141 |
| rich_3938 | no | CONTEXT | agent_error | 39 | 0 | 206 |
| rich_3944 | no | CONTEXT | agent_error | 13 | 0 | 15 |
| rich_3953 | no | CONTEXT | agent_error | 18 | 3 | 119 |
| rich_4070 | no | LOOP | wrong_fix_unsubmitted(timeout) | 25 | 7 | 0 |