Tag: transformer efficiency
Sparse Attention and Performer Variants: Efficient Transformer Ideas for LLMs
Explore how Sparse Attention and Performer variants solve the quadratic complexity bottleneck in Transformers. Learn about Longformer, BigBird, and practical implementation tips for efficient LLMs.
Transformer Efficiency Tricks: KV Caching and Continuous Batching in LLM Serving
Learn how KV caching and continuous batching optimize LLM serving. Explore memory trade-offs, vLLM implementation, and compression techniques like NVFP4 for faster inference.
