17/45 resolved · labels {'RESOLVED': 17, 'WRONG_FIX': 9, 'NO_PATCH': 9, 'LOOP': 6, 'CONTEXT': 4}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13537 | yes | RESOLVED | PASS | 33 | 0 | 302 |
| fastapi_14301 | yes | RESOLVED | PASS | 7 | 1 | 52 |
| fastapi_14372 | yes | RESOLVED | PASS | 9 | 1 | 64 |
| fastapi_14458 | yes | RESOLVED | PASS | 17 | 1 | 106 |
| fastapi_14786 | yes | RESOLVED | PASS | 4 | 0 | 26 |
| fastapi_14794 | yes | RESOLVED | PASS | 11 | 4 | 84 |
| fastapi_14964 | yes | RESOLVED | PASS | 18 | 3 | 124 |
| httpx_3672 | yes | RESOLVED | PASS | 41 | 1 | 215 |
| requests_6644 | yes | RESOLVED | PASS | 54 | 1 | 229 |
| requests_7433 | yes | RESOLVED | PASS | 6 | 0 | 33 |
| requests_7505 | yes | RESOLVED | PASS | 11 | 1 | 30 |
| rich_2725 | yes | RESOLVED | PASS | 26 | 5 | 161 |
| rich_3454 | yes | RESOLVED | PASS | 37 | 1 | 185 |
| rich_3882 | yes | RESOLVED | PASS | 13 | 1 | 86 |
| rich_3894 | yes | RESOLVED | PASS | 6 | 0 | 29 |
| rich_3905 | yes | RESOLVED | PASS | 5 | 0 | 26 |
| rich_4077 | yes | RESOLVED | PASS | 55 | 2 | 229 |
| fastapi_11355 | no | LOOP | empty_patch(submitted) | 59 | 22 | 166 |
| fastapi_13207 | no | CONTEXT | agent_error | 29 | 0 | 240 |
| fastapi_13786 | no | WRONG_FIX | wrong_fix_unsubmitted(timeout) | 20 | 0 | 0 |
| fastapi_14186 | no | LOOP | empty_patch(submitted) | 59 | 0 | 234 |
| fastapi_14246 | no | NO_PATCH | empty_patch(budget) | 43 | 2 | 305 |
| fastapi_14306 | no | CONTEXT | agent_error | 50 | 1 | 226 |
| fastapi_14430 | no | NO_PATCH | empty_patch(budget) | 21 | 0 | 302 |
| fastapi_14448 | no | NO_PATCH | empty_patch(timeout) | 22 | 0 | 0 |
| fastapi_14482 | no | WRONG_FIX | wrong_fix | 34 | 4 | 178 |
| fastapi_14605 | no | WRONG_FIX | wrong_fix | 30 | 3 | 119 |
| fastapi_14609 | no | NO_PATCH | empty_patch(submitted) | 58 | 3 | 114 |
| fastapi_14791 | no | WRONG_FIX | wrong_fix | 8 | 1 | 69 |
| fastapi_14986 | no | WRONG_FIX | wrong_fix | 37 | 1 | 138 |
| fastapi_15588 | no | WRONG_FIX | wrong_fix | 29 | 1 | 116 |
| fastapi_15589 | no | CONTEXT | agent_error | 43 | 2 | 226 |
| fastapi_5624 | no | NO_PATCH | empty_patch(budget) | 21 | 1 | 305 |
| requests_7427 | no | NO_PATCH | empty_patch(budget) | 24 | 0 | 314 |
| rich_3052 | no | WRONG_FIX | wrong_fix | 10 | 1 | 94 |
| rich_3063 | no | LOOP | empty_patch(budget) | 41 | 1 | 306 |
| rich_3180 | no | NO_PATCH | empty_patch(timeout) | 58 | 0 | 0 |
| rich_3471 | no | LOOP | empty_patch(budget) | 50 | 1 | 304 |
| rich_3535 | no | NO_PATCH | empty_patch(budget) | 42 | 0 | 309 |
| rich_3675 | no | WRONG_FIX | wrong_fix | 10 | 1 | 40 |
| rich_3934 | no | NO_PATCH | empty_patch(submitted) | 59 | 0 | 288 |
| rich_3938 | no | LOOP | empty_patch(submitted) | 59 | 0 | 305 |
| rich_3944 | no | LOOP | wrong_fix | 59 | 1 | 139 |
| rich_3953 | no | CONTEXT | agent_error | 9 | 0 | 34 |
| rich_4070 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 47 | 8 | 308 |