1/20 resolved · labels {'LOOP': 9, 'CONTEXT': 5, 'INTERFACE': 2, 'NO_PATCH': 2, 'RESOLVED': 1, 'WRONG_FIX': 1}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_14786 | yes | RESOLVED | PASS | 34 | 4 | 135 |
| fastapi_11355 | no | LOOP | empty_patch(submitted) | 59 | 47 | 125 |
| fastapi_13207 | no | CONTEXT | agent_error | 32 | 13 | 94 |
| fastapi_14301 | no | LOOP | empty_patch(submitted) | 59 | 57 | 140 |
| fastapi_14372 | no | LOOP | empty_patch(submitted) | 59 | 57 | 130 |
| fastapi_14430 | no | INTERFACE | empty_patch(submitted) | 59 | 46 | 138 |
| fastapi_14482 | no | INTERFACE | empty_patch(submitted) | 59 | 45 | 129 |
| fastapi_14605 | no | CONTEXT | agent_error | 12 | 0 | 27 |
| fastapi_14964 | no | WRONG_FIX | wrong_fix | 12 | 5 | 43 |
| fastapi_5624 | no | NO_PATCH | empty_patch(timeout) | 59 | 0 | 0 |
| requests_7427 | no | LOOP | empty_patch(submitted) | 59 | 58 | 92 |
| rich_3061 | no | LOOP | empty_patch(budget) | 48 | 40 | 307 |
| rich_3278 | no | LOOP | empty_patch(budget) | 53 | 8 | 306 |
| rich_3454 | no | CONTEXT | agent_error | 11 | 0 | 26 |
| rich_3471 | no | LOOP | empty_patch(submitted) | 50 | 49 | 117 |
| rich_3882 | no | LOOP | empty_patch(submitted) | 59 | 54 | 139 |
| rich_3938 | no | NO_PATCH | empty_patch(timeout) | 59 | 0 | 0 |
| rich_3944 | no | CONTEXT | agent_error | 41 | 8 | 81 |
| rich_3953 | no | LOOP | empty_patch(submitted) | 50 | 47 | 96 |
| rich_4070 | no | CONTEXT | agent_error | 11 | 0 | 27 |