Refined SWE BENCH
-
Traceback should be given. 36 steps taken to reproduce else the agent is trying to fix the issue for that particular version of code instead of find the root cause
-
Traceback using old version of code is not good.
Unnecessary computation is needed to resolve that
- The M in MRE should be justified.
Sample MRE for this issue Reduction for this issue