5/20 resolved · labels {'LOOP': 9, 'RESOLVED': 5, 'WRONG_FIX': 5, 'NO_PATCH': 1}
| Task | Resolved | Label | Outcome | Tool calls | Tool errors | Time (s) |
|---|---|---|---|---|---|---|
| fastapi_13207 | yes | RESOLVED | PASS | 38 | 10 | 82 |
| fastapi_14361 | yes | RESOLVED | PASS | 6 | 1 | 14 |
| fastapi_14794 | yes | RESOLVED | PASS | 8 | 2 | 67 |
| requests_7309 | yes | RESOLVED | PASS | 10 | 2 | 28 |
| rich_2725 | yes | RESOLVED | PASS | 11 | 1 | 62 |
| fastapi_14246 | no | WRONG_FIX | wrong_fix | 54 | 8 | 115 |
| fastapi_14609 | no | LOOP | wrong_fix | 51 | 4 | 80 |
| fastapi_14962 | no | WRONG_FIX | wrong_fix | 51 | 6 | 82 |
| fastapi_14978 | no | LOOP | empty_patch(submitted) | 50 | 21 | 104 |
| fastapi_15800 | no | LOOP | empty_patch(submitted) | 54 | 12 | 225 |
| fastapi_9425 | no | NO_PATCH | empty_patch(submitted) | 59 | 0 | 141 |
| requests_7427 | no | LOOP | wrong_fix | 55 | 0 | 90 |
| rich_3061 | no | LOOP | wrong_fix | 52 | 1 | 100 |
| rich_3180 | no | WRONG_FIX | wrong_fix | 52 | 0 | 72 |
| rich_3278 | no | LOOP | empty_patch(submitted) | 57 | 6 | 124 |
| rich_3471 | no | WRONG_FIX | wrong_fix | 54 | 1 | 78 |
| rich_3934 | no | LOOP | wrong_fix | 53 | 1 | 106 |
| rich_3942 | no | LOOP | empty_patch(submitted) | 47 | 4 | 178 |
| rich_3944 | no | LOOP | empty_patch(submitted) | 57 | 6 | 97 |
| rich_4070 | no | WRONG_FIX | wrong_fix | 59 | 8 | 181 |