Recurrent-depth, P/R/C looped transformer with MoE, GQA, and stable recurrence
ml transformers pytorch mixture-of-experts gqa flash-attention looped-transformers recurrent-depth lti-stability
-
Updated
Jul 9, 2026 - Python