11/45 resolved · labels {'LOOP': 20, 'RESOLVED': 11, 'CONTEXT': 5, 'WRONG_FIX': 5, 'NO_PATCH': 4}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13537 | yes | RESOLVED | PASS | 12 | 1 | 132 |
| fastapi_14301 | yes | RESOLVED | PASS | 10 | 2 | 95 |
| fastapi_14430 | yes | RESOLVED | PASS | 44 | 4 | 290 |
| fastapi_14458 | yes | RESOLVED | PASS | 14 | 2 | 303 |
| fastapi_14786 | yes | RESOLVED | PASS | 13 | 3 | 118 |
| fastapi_14794 | yes | RESOLVED | PASS | 21 | 8 | 212 |
| requests_7433 | yes | RESOLVED | PASS | 57 | 9 | 267 |
| rich_2725 | yes | RESOLVED | PASS | 17 | 2 | 202 |
| rich_3882 | yes | RESOLVED | PASS | 12 | 2 | 94 |
| rich_3894 | yes | RESOLVED | PASS | 12 | 1 | 126 |
| rich_3905 | yes | RESOLVED | PASS | 14 | 2 | 232 |
| fastapi_11355 | no | LOOP | empty_patch(budget) | 52 | 0 | 300 |
| fastapi_13207 | no | LOOP | empty_patch(budget) | 60 | 0 | 60 |
| fastapi_13786 | no | CONTEXT | agent_error | 47 | 18 | 296 |
| fastapi_14186 | no | CONTEXT | agent_error | 37 | 2 | 134 |
| fastapi_14246 | no | CONTEXT | agent_error | 50 | 3 | 169 |
| fastapi_14306 | no | LOOP | wrong_fix_unsubmitted(budget) | 60 | 7 | 161 |
| fastapi_14372 | no | LOOP | empty_patch(budget) | 6 | 48 | 300 |
| fastapi_14448 | no | NO_PATCH | empty_patch(timeout) | 22 | 0 | 0 |
| fastapi_14482 | no | NO_PATCH | empty_patch(timeout) | 57 | 0 | 0 |
| fastapi_14605 | no | LOOP | empty_patch(budget) | 51 | 12 | 303 |
| fastapi_14609 | no | CONTEXT | agent_error | 36 | 3 | 184 |
| fastapi_14791 | no | CONTEXT | agent_error | 17 | 8 | 153 |
| fastapi_14964 | no | WRONG_FIX | wrong_fix | 58 | 22 | 304 |
| fastapi_14986 | no | WRONG_FIX | wrong_fix | 57 | 18 | 148 |
| fastapi_15588 | no | WRONG_FIX | wrong_fix | 23 | 2 | 193 |
| fastapi_15589 | no | LOOP | wrong_fix | 58 | 3 | 237 |
| fastapi_5624 | no | LOOP | empty_patch(budget) | 17 | 2 | 302 |
| httpx_3672 | no | LOOP | wrong_fix_unsubmitted(budget) | 57 | 19 | 300 |
| requests_6644 | no | LOOP | wrong_fix_unsubmitted(budget) | 50 | 36 | 310 |
| requests_7427 | no | LOOP | wrong_fix_unsubmitted(budget) | 56 | 1 | 302 |
| requests_7505 | no | LOOP | empty_patch(budget) | 14 | 66 | 185 |
| rich_3052 | no | LOOP | wrong_fix | 30 | 11 | 294 |
| rich_3063 | no | LOOP | empty_patch(budget) | 60 | 10 | 230 |
| rich_3180 | no | LOOP | empty_patch(budget) | 60 | 2 | 226 |
| rich_3454 | no | LOOP | empty_patch(budget) | 50 | 9 | 311 |
| rich_3471 | no | NO_PATCH | empty_patch(timeout) | 55 | 0 | 0 |
| rich_3535 | no | LOOP | empty_patch(budget) | 57 | 7 | 305 |
| rich_3675 | no | WRONG_FIX | wrong_fix | 12 | 2 | 111 |
| rich_3934 | no | LOOP | wrong_fix_unsubmitted(budget) | 60 | 1 | 194 |
| rich_3938 | no | NO_PATCH | empty_patch(timeout) | 55 | 0 | 0 |
| rich_3944 | no | LOOP | empty_patch(budget) | 60 | 14 | 112 |
| rich_3953 | no | LOOP | agent_error | 43 | 0 | 155 |
| rich_4070 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 49 | 6 | 305 |
| rich_4077 | no | LOOP | wrong_fix | 56 | 3 | 150 |