7/20 resolved · labels {'RESOLVED': 7, 'LOOP': 7, 'CONTEXT': 4, 'WRONG_FIX': 2}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_14301 | yes | RESOLVED | PASS | 13 | 3 | 49 |
| fastapi_14372 | yes | RESOLVED | PASS | 17 | 8 | 60 |
| fastapi_14786 | yes | RESOLVED | PASS | 9 | 3 | 42 |
| fastapi_5624 | yes | RESOLVED | PASS | 51 | 8 | 116 |
| requests_7427 | yes | RESOLVED | PASS | 31 | 8 | 111 |
| rich_3454 | yes | RESOLVED | PASS | 59 | 3 | 169 |
| rich_3882 | yes | RESOLVED | PASS | 13 | 4 | 46 |
| fastapi_11355 | no | LOOP | empty_patch(budget) | 60 | 56 | 218 |
| fastapi_13207 | no | CONTEXT | agent_error | 50 | 5 | 131 |
| fastapi_14430 | no | LOOP | empty_patch(submitted) | 57 | 1 | 250 |
| fastapi_14482 | no | LOOP | empty_patch(submitted) | 59 | 38 | 254 |
| fastapi_14605 | no | WRONG_FIX | wrong_fix | 58 | 9 | 118 |
| fastapi_14964 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 28 | 10 | 307 |
| rich_3061 | no | LOOP | empty_patch(submitted) | 59 | 55 | 119 |
| rich_3278 | no | CONTEXT | agent_error | 24 | 18 | 85 |
| rich_3471 | no | LOOP | empty_patch(submitted) | 59 | 3 | 220 |
| rich_3938 | no | LOOP | empty_patch(submitted) | 55 | 49 | 146 |
| rich_3944 | no | LOOP | empty_patch(submitted) | 57 | 8 | 236 |
| rich_3953 | no | CONTEXT | agent_error | 7 | 0 | 27 |
| rich_4070 | no | CONTEXT | agent_error | 20 | 2 | 46 |