8/30 resolved · labels {'RESOLVED': 8, 'NO_PATCH': 8, 'LOOP': 6, 'CONTEXT': 4, 'WRONG_FIX': 4}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13537 | yes | RESOLVED | PASS | 10 | 0 | 143 |
| fastapi_14301 | yes | RESOLVED | PASS | 6 | 0 | 40 |
| fastapi_14372 | yes | RESOLVED | PASS | 10 | 3 | 44 |
| fastapi_14786 | yes | RESOLVED | PASS | 11 | 4 | 30 |
| requests_6644 | yes | RESOLVED | PASS | 11 | 2 | 58 |
| requests_7427 | yes | RESOLVED | PASS | 12 | 3 | 164 |
| requests_7505 | yes | RESOLVED | PASS | 16 | 2 | 106 |
| rich_3905 | yes | RESOLVED | PASS | 9 | 2 | 115 |
| fastapi_11355 | no | LOOP | empty_patch(budget) | 52 | 2 | 304 |
| fastapi_13207 | no | NO_PATCH | empty_patch(budget) | 7 | 1 | 302 |
| fastapi_13786 | no | CONTEXT | agent_error | 15 | 0 | 118 |
| fastapi_14306 | no | LOOP | wrong_fix | 55 | 4 | 144 |
| fastapi_14430 | no | NO_PATCH | empty_patch(submitted) | 21 | 1 | 150 |
| fastapi_14448 | no | WRONG_FIX | wrong_fix | 23 | 0 | 133 |
| fastapi_14482 | no | LOOP | empty_patch(submitted) | 50 | 1 | 70 |
| fastapi_14605 | no | NO_PATCH | empty_patch(budget) | 5 | 1 | 310 |
| fastapi_14609 | no | CONTEXT | agent_error | 19 | 0 | 277 |
| fastapi_14791 | no | WRONG_FIX | wrong_fix | 5 | 0 | 73 |
| fastapi_14964 | no | NO_PATCH | empty_patch(budget) | 5 | 0 | 168 |
| fastapi_5624 | no | WRONG_FIX | wrong_fix | 13 | 1 | 65 |
| rich_3471 | no | LOOP | wrong_fix | 52 | 0 | 116 |
| rich_3535 | no | NO_PATCH | empty_patch(budget) | 15 | 2 | 306 |
| rich_3675 | no | NO_PATCH | empty_patch(budget) | 10 | 2 | 302 |
| rich_3882 | no | NO_PATCH | empty_patch(budget) | 4 | 1 | 140 |
| rich_3934 | no | LOOP | empty_patch(budget) | 44 | 0 | 236 |
| rich_3938 | no | NO_PATCH | empty_patch(budget) | 32 | 3 | 304 |
| rich_3944 | no | CONTEXT | agent_error | 13 | 0 | 20 |
| rich_3953 | no | CONTEXT | agent_error | 7 | 0 | 12 |
| rich_4070 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 36 | 8 | 304 |
| rich_4077 | no | LOOP | empty_patch(budget) | 31 | 3 | 301 |