9/30 resolved · labels {'WRONG_FIX': 11, 'RESOLVED': 9, 'LOOP': 5, 'NO_PATCH': 3, 'CONTEXT': 2}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13207 | yes | RESOLVED | PASS | 28 | 7 | 172 |
| fastapi_14077 | yes | RESOLVED | PASS | 57 | 47 | 210 |
| fastapi_14303 | yes | RESOLVED | PASS | 4 | 0 | 33 |
| fastapi_14458 | yes | RESOLVED | PASS | 12 | 3 | 160 |
| fastapi_14791 | yes | RESOLVED | PASS | 4 | 0 | 64 |
| fastapi_9555 | yes | RESOLVED | PASS | 16 | 6 | 103 |
| requests_7205 | yes | RESOLVED | PASS | 18 | 7 | 131 |
| requests_7433 | yes | RESOLVED | PASS | 5 | 0 | 28 |
| rich_3882 | yes | RESOLVED | PASS | 7 | 1 | 41 |
| fastapi_11355 | no | NO_PATCH | empty_patch(submitted) | 58 | 9 | 107 |
| fastapi_12942 | no | WRONG_FIX | wrong_fix | 22 | 2 | 264 |
| fastapi_13713 | no | CONTEXT | agent_error | 24 | 0 | 126 |
| fastapi_13920 | no | WRONG_FIX | wrong_fix | 14 | 2 | 76 |
| fastapi_14349 | no | WRONG_FIX | wrong_fix | 6 | 0 | 33 |
| fastapi_14455 | no | WRONG_FIX | wrong_fix | 25 | 1 | 163 |
| fastapi_14463 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 7 | 0 | 199 |
| fastapi_14485 | no | WRONG_FIX | wrong_fix | 28 | 4 | 129 |
| fastapi_14605 | no | NO_PATCH | empty_patch(budget) | 4 | 0 | 301 |
| fastapi_14978 | no | LOOP | wrong_fix | 28 | 4 | 175 |
| fastapi_15280 | no | LOOP | wrong_fix | 25 | 0 | 197 |
| fastapi_5624 | no | NO_PATCH | empty_patch(budget) | 6 | 0 | 302 |
| rich_3063 | no | LOOP | empty_patch(submitted) | 56 | 14 | 138 |
| rich_3471 | no | WRONG_FIX | wrong_fix | 7 | 2 | 89 |
| rich_3506 | no | LOOP | empty_patch(submitted) | 35 | 3 | 101 |
| rich_3676 | no | WRONG_FIX | wrong_fix | 34 | 9 | 229 |
| rich_3718 | no | WRONG_FIX | wrong_fix | 7 | 0 | 34 |
| rich_3782 | no | LOOP | empty_patch(submitted) | 35 | 1 | 165 |
| rich_3944 | no | WRONG_FIX | wrong_fix | 10 | 0 | 29 |
| rich_3953 | no | WRONG_FIX | wrong_fix | 9 | 1 | 46 |
| rich_4070 | no | CONTEXT | agent_error | 37 | 5 | 134 |