Massive multitask decision making is measured.
MMDM evaluates decision models on 5,448 questions, 16 tasks, long contexts, and 1,024 options, revealing weak logic, constraints, and multi-select.
MMDM evaluates decision models on 5,448 questions, 16 tasks, long contexts, and 1,024 options, revealing weak logic, constraints, and multi-select.