19/45 resolved · labels {'RESOLVED': 19, 'LOOP': 13, 'CONTEXT': 6, 'WRONG_FIX': 5, 'NO_PATCH': 2}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13207 | yes | RESOLVED | PASS | 14 | 2 | 50 |
| fastapi_14301 | yes | RESOLVED | PASS | 6 | 0 | 13 |
| fastapi_14372 | yes | RESOLVED | PASS | 9 | 2 | 19 |
| fastapi_14458 | yes | RESOLVED | PASS | 15 | 0 | 179 |
| fastapi_14786 | yes | RESOLVED | PASS | 8 | 2 | 44 |
| fastapi_14791 | yes | RESOLVED | PASS | 4 | 0 | 27 |
| fastapi_14794 | yes | RESOLVED | PASS | 22 | 7 | 150 |
| fastapi_14964 | yes | RESOLVED | PASS | 11 | 2 | 37 |
| fastapi_15589 | yes | RESOLVED | PASS | 13 | 0 | 136 |
| httpx_3672 | yes | RESOLVED | PASS | 24 | 9 | 294 |
| requests_6644 | yes | RESOLVED | PASS | 28 | 5 | 70 |
| requests_7427 | yes | RESOLVED | PASS | 8 | 1 | 60 |
| requests_7433 | yes | RESOLVED | PASS | 7 | 1 | 83 |
| requests_7505 | yes | RESOLVED | PASS | 7 | 0 | 16 |
| rich_2725 | yes | RESOLVED | PASS | 18 | 3 | 109 |
| rich_3882 | yes | RESOLVED | PASS | 5 | 1 | 18 |
| rich_3894 | yes | RESOLVED | PASS | 12 | 0 | 40 |
| rich_3905 | yes | RESOLVED | PASS | 7 | 2 | 86 |
| rich_4077 | yes | RESOLVED | PASS | 25 | 6 | 74 |
| fastapi_11355 | no | LOOP | empty_patch(submitted) | 58 | 36 | 262 |
| fastapi_13537 | no | LOOP | empty_patch(budget) | 14 | 7 | 181 |
| fastapi_13786 | no | CONTEXT | agent_error | 18 | 0 | 241 |
| fastapi_14186 | no | WRONG_FIX | wrong_fix_unsubmitted(timeout) | 21 | 8 | 0 |
| fastapi_14246 | no | CONTEXT | agent_error | 31 | 2 | 152 |
| fastapi_14306 | no | LOOP | empty_patch(submitted) | 31 | 0 | 46 |
| fastapi_14430 | no | CONTEXT | agent_error | 40 | 3 | 77 |
| fastapi_14448 | no | WRONG_FIX | wrong_fix | 24 | 4 | 138 |
| fastapi_14482 | no | LOOP | empty_patch(submitted) | 52 | 8 | 104 |
| fastapi_14605 | no | NO_PATCH | empty_patch(budget) | 4 | 0 | 308 |
| fastapi_14609 | no | NO_PATCH | empty_patch(budget) | 10 | 0 | 303 |
| fastapi_14986 | no | LOOP | wrong_fix | 52 | 40 | 189 |
| fastapi_15588 | no | CONTEXT | agent_error | 51 | 35 | 198 |
| fastapi_5624 | no | LOOP | wrong_fix | 51 | 0 | 88 |
| rich_3052 | no | WRONG_FIX | wrong_fix | 11 | 0 | 170 |
| rich_3063 | no | LOOP | empty_patch(submitted) | 58 | 15 | 197 |
| rich_3180 | no | WRONG_FIX | wrong_fix | 51 | 0 | 105 |
| rich_3454 | no | LOOP | empty_patch(budget) | 43 | 2 | 305 |
| rich_3471 | no | LOOP | wrong_fix | 51 | 0 | 151 |
| rich_3535 | no | LOOP | empty_patch(budget) | 45 | 23 | 301 |
| rich_3675 | no | WRONG_FIX | wrong_fix | 11 | 0 | 22 |
| rich_3934 | no | LOOP | wrong_fix | 51 | 0 | 232 |
| rich_3938 | no | LOOP | empty_patch(budget) | 43 | 1 | 310 |
| rich_3944 | no | LOOP | empty_patch(timeout) | 29 | 21 | 0 |
| rich_3953 | no | CONTEXT | agent_error | 7 | 0 | 9 |
| rich_4070 | no | CONTEXT | agent_error | 35 | 5 | 258 |