← all runs

tpu_run2/results/eval_submission

10/30 resolved · labels {'RESOLVED': 10, 'LOOP': 10, 'WRONG_FIX': 4, 'CONTEXT': 4, 'NO_PATCH': 2}

TaskResolvedLabelOutcomeTool callsTool errorsTime (s)
fastapi_13207yesRESOLVEDPASS214268
fastapi_14077yesRESOLVEDPASS11046
fastapi_14303yesRESOLVEDPASS83107
fastapi_14458yesRESOLVEDPASS110149
fastapi_14463yesRESOLVEDPASS13139
fastapi_9555yesRESOLVEDPASS114258
requests_7205yesRESOLVEDPASS360252
requests_7433yesRESOLVEDPASS5027
rich_3506yesRESOLVEDPASS320248
rich_3882yesRESOLVEDPASS6125
fastapi_11355noWRONG_FIXwrong_fix271252
fastapi_12942noLOOPempty_patch(budget)407304
fastapi_13713noCONTEXTagent_error270141
fastapi_13920noLOOPwrong_fix529213
fastapi_14349noLOOPempty_patch(budget)210300
fastapi_14455noCONTEXTagent_error250215
fastapi_14485noLOOPempty_patch(submitted)5430132
fastapi_14605noNO_PATCHempty_patch(budget)60300
fastapi_14791noWRONG_FIXwrong_fix5031
fastapi_14978noWRONG_FIXwrong_fix233133
fastapi_15280noLOOPempty_patch(timeout)44200
fastapi_5624noLOOPwrong_fix511296
rich_3063noLOOPempty_patch(budget)4913302
rich_3471noLOOPempty_patch(budget)500301
rich_3676noWRONG_FIXwrong_fix212179
rich_3718noNO_PATCHempty_patch(budget)60305
rich_3782noLOOPwrong_fix261121
rich_3944noCONTEXTagent_error16567
rich_3953noCONTEXTagent_error7014
rich_4070noLOOPempty_patch(submitted)2712177