DecisionPivot is a diagnostic benchmark for evaluating decision models in LLM systems.
DecisionPivot benchmarks LLM decision models with contrast groups, calibration, ordering, and coverage, revealing gaps hidden by aggregate scores.
DecisionPivot benchmarks LLM decision models with contrast groups, calibration, ordering, and coverage, revealing gaps hidden by aggregate scores.
A study shows weak LLM actors can teach agents via step-level judge rewards, improving ALFWorld and WebShop performance in long-horizon tasks.