Menu
Zistiť stav objednávky
Kontaktujte nás
Kniha AI Inference Optimization Engineering ChatVariety Team

AI Inference Optimization Engineering

Quantization, Speculative Decoding, and Hardware-Specific LLM Deployment

Autor: ChatVariety Team
Jazyk: Angličtina
Väzba: Brožovaná
Vydavateľ: Independently published
Dostupnosť: Očakávané naskladnenie
Naskladnenie 07. 06. 2026
10.48 €
Slash LLM Deployment Costs and LatencyDeploying Large Language Models (LLMs) in production is a mass...

Informácie o knihe

Autor
ChatVariety Team
Jazyk
Angličtina
Väzba
Kniha - Brožovaná
Vydalo
2026
Stránok
96
EAN
9798199720021
Enbook ID
52770465
Vydavateľ
Independently published
Hmotnosť
142
Rozmery
152 x 229 x 5

Kompletný popis

Slash LLM Deployment Costs and Latency

Deploying Large Language Models (LLMs) in production is a massive economic and engineering hurdle. AI Inference Optimization Engineering is your comprehensive, hands-on guide to mastering the full stack of modern LLM optimization techniques. From memory-bandwidth solutions to hardware-specific compilation, this book bridges the gap between research-level models and enterprise-grade execution.

What you will master inside this book:
  • Hardware-Aware Optimization: Dive deep into KV cache mechanics, autoregressive decoding, and GPU memory hierarchies to eliminate latency bottlenecks.
  • State-of-the-Art Quantization: Apply GPTQ, AWQ, and GGUF compression algorithms to scale down massive neural networks without sacrificing model accuracy.
  • Advanced Acceleration Methods: Implement speculative decoding with draft models (like Medusa and Eagle), PagedAttention, and FlashAttention to boost throughput by 2-3x.
  • Production-Grade Serving: Build ultra-low-latency deployment infrastructures using vLLM, Triton Inference Server, and continuous batching.
  • Cross-Platform Deployment: Optimize models for specific target hardware, including NVIDIA H100 (TensorRT-LLM), Apple Silicon (llama.cpp/Metal), and Qualcomm mobile/edge accelerators.

Whether you are an ML infrastructure engineer, an AI platform architect, or a technical leader looking to scale LLMs cost-effectively, this book provides the production-ready code, equations, and architectural patterns you need to build hyper-efficient AI pipelines.