10/45 resolved · labels {'LOOP': 21, 'RESOLVED': 10, 'CONTEXT': 7, 'WRONG_FIX': 4, 'NO_PATCH': 3}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_14301 | yes | RESOLVED | PASS | 14 | 5 | 44 |
| fastapi_14372 | yes | RESOLVED | PASS | 57 | 49 | 103 |
| fastapi_14786 | yes | RESOLVED | PASS | 6 | 0 | 53 |
| fastapi_14794 | yes | RESOLVED | PASS | 15 | 5 | 115 |
| fastapi_14964 | yes | RESOLVED | PASS | 17 | 5 | 116 |
| httpx_3672 | yes | RESOLVED | PASS | 20 | 7 | 138 |
| requests_6644 | yes | RESOLVED | PASS | 51 | 32 | 84 |
| requests_7505 | yes | RESOLVED | PASS | 22 | 10 | 127 |
| rich_3894 | yes | RESOLVED | PASS | 52 | 45 | 80 |
| rich_3905 | yes | RESOLVED | PASS | 10 | 5 | 91 |
| fastapi_11355 | no | NO_PATCH | empty_patch(timeout) | 56 | 0 | 0 |
| fastapi_13207 | no | LOOP | empty_patch(submitted) | 57 | 50 | 65 |
| fastapi_13537 | no | LOOP | empty_patch(submitted) | 59 | 57 | 135 |
| fastapi_13786 | no | CONTEXT | agent_error | 17 | 0 | 74 |
| fastapi_14186 | no | CONTEXT | agent_error | 30 | 4 | 24 |
| fastapi_14246 | no | CONTEXT | agent_error | 47 | 5 | 49 |
| fastapi_14306 | no | LOOP | empty_patch(submitted) | 54 | 48 | 109 |
| fastapi_14430 | no | LOOP | wrong_fix | 53 | 48 | 140 |
| fastapi_14448 | no | CONTEXT | agent_error | 27 | 4 | 107 |
| fastapi_14458 | no | LOOP | empty_patch(submitted) | 59 | 56 | 50 |
| fastapi_14482 | no | LOOP | empty_patch(submitted) | 59 | 55 | 73 |
| fastapi_14605 | no | WRONG_FIX | wrong_fix_unsubmitted(budget) | 35 | 7 | 307 |
| fastapi_14609 | no | CONTEXT | agent_error | 33 | 7 | 109 |
| fastapi_14791 | no | WRONG_FIX | wrong_fix | 4 | 0 | 83 |
| fastapi_14986 | no | LOOP | empty_patch(submitted) | 59 | 56 | 87 |
| fastapi_15588 | no | WRONG_FIX | wrong_fix | 18 | 3 | 120 |
| fastapi_15589 | no | LOOP | empty_patch(submitted) | 50 | 20 | 105 |
| fastapi_5624 | no | LOOP | empty_patch(submitted) | 59 | 56 | 279 |
| requests_7427 | no | LOOP | wrong_fix | 56 | 6 | 260 |
| requests_7433 | no | LOOP | empty_patch(submitted) | 59 | 58 | 78 |
| rich_2725 | no | LOOP | empty_patch(submitted) | 59 | 55 | 80 |
| rich_3052 | no | CONTEXT | agent_error | 8 | 56 | 236 |
| rich_3063 | no | LOOP | empty_patch(submitted) | 55 | 51 | 40 |
| rich_3180 | no | LOOP | wrong_fix | 54 | 34 | 193 |
| rich_3454 | no | LOOP | empty_patch(submitted) | 50 | 13 | 102 |
| rich_3471 | no | LOOP | empty_patch(submitted) | 59 | 3 | 68 |
| rich_3535 | no | NO_PATCH | empty_patch(submitted) | 58 | 11 | 177 |
| rich_3675 | no | WRONG_FIX | wrong_fix | 20 | 5 | 99 |
| rich_3882 | no | LOOP | wrong_fix_unsubmitted(budget) | 12 | 67 | 311 |
| rich_3934 | no | LOOP | wrong_fix | 58 | 51 | 60 |
| rich_3938 | no | LOOP | empty_patch(submitted) | 59 | 49 | 217 |
| rich_3944 | no | NO_PATCH | empty_patch(budget) | 20 | 1 | 304 |
| rich_3953 | no | LOOP | empty_patch(submitted) | 59 | 57 | 55 |
| rich_4070 | no | CONTEXT | agent_error | 17 | 2 | 69 |
| rich_4077 | no | LOOP | wrong_fix | 51 | 6 | 95 |