Establishing an Instruction Hierarchy: Teaching LLMs to Give Priority to Privileged Instructions
Large language models remain vulnerable to prompt injections and jailbreak attacks that replace built-in instructions with malicious prompts. Establishing an instruction hierarchy teaches LLMs to prio…