Are LLMs reliable enough to assess whether a research idea is novel?
Allen Institute benchmark tests LLM novelty judges using top conference peer reviews. Prompt wording caused accuracy swings, limiting reliability.
Allen Institute benchmark tests LLM novelty judges using top conference peer reviews. Prompt wording caused accuracy swings, limiting reliability.