Less Size, Stronger Recall: How Qwen2.5-1.5B Beats the 3B Model (With Four Hypotheses)
SRRM shows Qwen2.5-1.5B beats Qwen2.5-3B on long-context recall: 86.7% retrieval and 45.7% reconstruction, challenging size-equals-memory assumptions.
SRRM shows Qwen2.5-1.5B beats Qwen2.5-3B on long-context recall: 86.7% retrieval and 45.7% reconstruction, challenging size-equals-memory assumptions.