Quantization Methods for Large Language Models From Theory to Real-World Implementations

By: Vemula, Anand

The book provides an in-depth understanding of quantization techniques and their impact on model efficiency, performance, and deployment.

The book starts with a foundational overview of quantization, explaining its significance in reducing the computational and memory requirements of LLMs. It delves into various quantization methods, including uniform and non-uniform quantization, per-layer and per-channel quantization, and hybrid approaches...

• Format: Paperback
• Language: English
• ISBN13: 9798227328335
• Release Date: August 2024
• Publisher: Anand Vemula
• Length: 76 Pages
• Weight: 0.24 lbs.
• Dimensions: 0.2" x 5.5" x 8.5"