A human-grounded granular evaluation for proactive agents is proposed.
HALO adds human annotations to evaluate proactive agents, finding over-proactivity in timing and intensity is the main failure mode.
HALO adds human annotations to evaluate proactive agents, finding over-proactivity in timing and intensity is the main failure mode.