17/45 resolved · labels {'RESOLVED': 17, 'WRONG_FIX': 13, 'CONTEXT': 7, 'NO_PATCH': 5, 'LOOP': 3}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13537 | yes | RESOLVED | PASS | 16 | 5 | 178 |
| fastapi_14301 | yes | RESOLVED | PASS | 7 | 0 | 40 |
| fastapi_14372 | yes | RESOLVED | PASS | 13 | 4 | 89 |
| fastapi_14430 | yes | RESOLVED | PASS | 32 | 5 | 291 |
| fastapi_14458 | yes | RESOLVED | PASS | 14 | 2 | 139 |
| fastapi_14605 | yes | RESOLVED | PASS | 25 | 1 | 112 |
| fastapi_14786 | yes | RESOLVED | PASS | 5 | 0 | 39 |
| fastapi_14791 | yes | RESOLVED | PASS | 7 | 0 | 64 |
| fastapi_14794 | yes | RESOLVED | PASS | 23 | 5 | 105 |
| httpx_3672 | yes | RESOLVED | PASS | 39 | 3 | 258 |
| requests_6644 | yes | RESOLVED | PASS | 22 | 5 | 106 |
| requests_7433 | yes | RESOLVED | PASS | 6 | 1 | 31 |
| requests_7505 | yes | RESOLVED | PASS | 8 | 0 | 36 |
| rich_3454 | yes | RESOLVED | PASS | 39 | 2 | 166 |
| rich_3882 | yes | RESOLVED | PASS | 8 | 2 | 76 |
| rich_3894 | yes | RESOLVED | PASS | 14 | 0 | 94 |
| rich_3905 | yes | RESOLVED | PASS | 5 | 0 | 40 |
| fastapi_11355 | no | WRONG_FIX | wrong_fix | 57 | 9 | 165 |
| fastapi_13207 | no | CONTEXT | agent_error | 46 | 32 | 172 |
| fastapi_13786 | no | CONTEXT | agent_error | 16 | 0 | 280 |
| fastapi_14186 | no | CONTEXT | agent_error | 30 | 1 | 231 |
| fastapi_14246 | no | CONTEXT | agent_error | 44 | 0 | 98 |
| fastapi_14306 | no | CONTEXT | agent_error | 50 | 3 | 212 |
| fastapi_14448 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 37 | 1 | 303 |
| fastapi_14482 | no | WRONG_FIX | wrong_fix | 40 | 3 | 214 |
| fastapi_14609 | no | CONTEXT | agent_error | 36 | 0 | 82 |
| fastapi_14964 | no | WRONG_FIX | wrong_fix | 15 | 1 | 90 |
| fastapi_14986 | no | WRONG_FIX | wrong_fix | 31 | 2 | 222 |
| fastapi_15588 | no | WRONG_FIX | wrong_fix | 22 | 1 | 163 |
| fastapi_15589 | no | NO_PATCH | empty_patch(budget) | 25 | 1 | 301 |
| fastapi_5624 | no | NO_PATCH | empty_patch(submitted) | 45 | 3 | 296 |
| requests_7427 | no | WRONG_FIX | wrong_fix | 22 | 4 | 289 |
| rich_2725 | no | NO_PATCH | empty_patch(budget) | 38 | 5 | 314 |
| rich_3052 | no | WRONG_FIX | wrong_fix | 8 | 0 | 126 |
| rich_3063 | no | NO_PATCH | empty_patch(budget) | 53 | 5 | 303 |
| rich_3180 | no | WRONG_FIX | wrong_fix | 16 | 0 | 257 |
| rich_3471 | no | LOOP | wrong_fix | 55 | 1 | 195 |
| rich_3535 | no | WRONG_FIX | wrong_fix | 59 | 12 | 177 |
| rich_3675 | no | WRONG_FIX | wrong_fix | 5 | 0 | 35 |
| rich_3934 | no | NO_PATCH | empty_patch(timeout) | 51 | 0 | 0 |
| rich_3938 | no | LOOP | empty_patch(submitted) | 51 | 3 | 277 |
| rich_3944 | no | WRONG_FIX | wrong_fix | 24 | 3 | 122 |
| rich_3953 | no | CONTEXT | agent_error | 49 | 6 | 287 |
| rich_4070 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 40 | 3 | 315 |
| rich_4077 | no | LOOP | wrong_fix | 59 | 2 | 253 |