11/30 resolved · labels {'RESOLVED': 11, 'LOOP': 9, 'WRONG_FIX': 7, 'CONTEXT': 3}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13207 | yes | RESOLVED | PASS | 30 | 2 | 308 |
| fastapi_13537 | yes | RESOLVED | PASS | 5 | 0 | 96 |
| fastapi_14301 | yes | RESOLVED | PASS | 6 | 0 | 16 |
| fastapi_14372 | yes | RESOLVED | PASS | 11 | 3 | 24 |
| fastapi_14786 | yes | RESOLVED | PASS | 8 | 2 | 84 |
| fastapi_14964 | yes | RESOLVED | PASS | 21 | 8 | 302 |
| requests_6644 | yes | RESOLVED | PASS | 27 | 5 | 35 |
| requests_7505 | yes | RESOLVED | PASS | 6 | 0 | 37 |
| rich_3882 | yes | RESOLVED | PASS | 5 | 1 | 18 |
| rich_3905 | yes | RESOLVED | PASS | 12 | 4 | 133 |
| rich_4077 | yes | RESOLVED | PASS | 31 | 2 | 144 |
| fastapi_11355 | no | LOOP | wrong_fix | 30 | 0 | 276 |
| fastapi_13786 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 16 | 0 | 300 |
| fastapi_14306 | no | CONTEXT | agent_error | 37 | 3 | 113 |
| fastapi_14430 | no | LOOP | empty_patch(submitted) | 53 | 0 | 298 |
| fastapi_14448 | no | WRONG_FIX | wrong_fix | 30 | 0 | 141 |
| fastapi_14482 | no | LOOP | wrong_fix | 37 | 8 | 281 |
| fastapi_14605 | no | WRONG_FIX | wrong_fix | 30 | 7 | 223 |
| fastapi_14609 | no | WRONG_FIX | wrong_fix | 19 | 0 | 179 |
| fastapi_14791 | no | WRONG_FIX | wrong_fix | 4 | 0 | 16 |
| fastapi_5624 | no | WRONG_FIX | wrong_fix | 51 | 0 | 211 |
| requests_7427 | no | LOOP | wrong_fix_unsubmitted(budget) | 30 | 19 | 302 |
| rich_3471 | no | LOOP | empty_patch(budget) | 45 | 0 | 304 |
| rich_3535 | no | LOOP | empty_patch(budget) | 38 | 23 | 303 |
| rich_3675 | no | WRONG_FIX | wrong_fix | 10 | 0 | 45 |
| rich_3934 | no | LOOP | empty_patch(budget) | 30 | 0 | 174 |
| rich_3938 | no | LOOP | empty_patch(budget) | 43 | 0 | 302 |
| rich_3944 | no | LOOP | empty_patch(timeout) | 19 | 0 | 0 |
| rich_3953 | no | CONTEXT | agent_error | 22 | 7 | 114 |
| rich_4070 | no | CONTEXT | agent_error | 32 | 1 | 275 |