8/30 resolved · labels {'WRONG_FIX': 9, 'RESOLVED': 8, 'LOOP': 6, 'NO_PATCH': 5, 'CONTEXT': 2}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_14077 | yes | RESOLVED | PASS | 22 | 6 | 141 |
| fastapi_14303 | yes | RESOLVED | PASS | 9 | 5 | 21 |
| fastapi_14349 | yes | RESOLVED | PASS | 9 | 1 | 67 |
| fastapi_14458 | yes | RESOLVED | PASS | 9 | 0 | 122 |
| fastapi_9555 | yes | RESOLVED | PASS | 9 | 1 | 145 |
| requests_7205 | yes | RESOLVED | PASS | 34 | 1 | 306 |
| requests_7433 | yes | RESOLVED | PASS | 6 | 1 | 18 |
| rich_3882 | yes | RESOLVED | PASS | 5 | 1 | 45 |
| fastapi_11355 | no | WRONG_FIX | wrong_fix | 25 | 2 | 130 |
| fastapi_12942 | no | NO_PATCH | empty_patch(budget) | 24 | 8 | 313 |
| fastapi_13207 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 24 | 5 | 301 |
| fastapi_13713 | no | WRONG_FIX | wrong_fix | 33 | 1 | 153 |
| fastapi_13920 | no | LOOP | wrong_fix | 51 | 45 | 109 |
| fastapi_14455 | no | WRONG_FIX | wrong_fix | 19 | 0 | 120 |
| fastapi_14463 | no | NO_PATCH | empty_patch(budget) | 6 | 0 | 125 |
| fastapi_14485 | no | LOOP | empty_patch(submitted) | 55 | 19 | 46 |
| fastapi_14605 | no | WRONG_FIX | wrong_fix | 32 | 8 | 193 |
| fastapi_14791 | no | WRONG_FIX | wrong_fix | 4 | 0 | 69 |
| fastapi_14978 | no | WRONG_FIX | wrong_fix | 23 | 3 | 89 |
| fastapi_15280 | no | NO_PATCH | empty_patch(timeout) | 27 | 4 | 0 |
| fastapi_5624 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 52 | 1 | 300 |
| rich_3063 | no | LOOP | empty_patch(submitted) | 57 | 27 | 309 |
| rich_3471 | no | LOOP | wrong_fix | 51 | 1 | 232 |
| rich_3506 | no | LOOP | wrong_fix | 51 | 0 | 236 |
| rich_3676 | no | WRONG_FIX | wrong_fix | 15 | 0 | 80 |
| rich_3718 | no | NO_PATCH | empty_patch(budget) | 6 | 0 | 312 |
| rich_3782 | no | NO_PATCH | empty_patch(budget) | 17 | 0 | 216 |
| rich_3944 | no | LOOP | empty_patch(timeout) | 27 | 9 | 0 |
| rich_3953 | no | CONTEXT | agent_error | 20 | 9 | 98 |
| rich_4070 | no | CONTEXT | agent_error | 55 | 2 | 290 |