Recurrent Depth in LLMs Comes from the Arithmetic Behind Looped Transformers.
Dory and GLiDE show looped LLMs add depth by reusing layers, but gains cost compute and latency; cache choices decide real serving cost.
Dory and GLiDE show looped LLMs add depth by reusing layers, but gains cost compute and latency; cache choices decide real serving cost.