Sep 30, 2026 Long context with RoPE scaling, YaRN and FlashAttention Sep 01, 2025 What Llama changed in the Transformer: RoPE, RMSNorm, SwiGLU