top of page

articles and knowledge
Search


Inference at Full Throttle: 5 Key Takeaways on vLLM, Quantization, KV Cache Tuning and Speculative Decoding
Your model works, but every request is slow and every GPU hour is expensive. Here are five key takeaways behind Inference at Full Throttle, a practical guide from the Scaling AI Systems Series on LLM serving performance. On Kindle and in paperback.

Choochai Thianthae
Oct 214 min read


Scaling AI Systems Series Guide: Reading Order for LLM Inference Performance, GPU Cluster Operations and AI Cost Management
Three focused engineering books from ChatVariety Team for teams running AI in production — fast LLM serving with vLLM, quantization and speculative decoding, reliable GPU cluster operations, and AI unit economics — with a recommended reading order and Kindle and paperback links.

Choochai Thianthae
Oct 204 min read


Running the GPU Fleet Review: A Practical Guide to Operating GPU Clusters for AI
A focused guide from the Scaling AI Systems Series on running GPU clusters for AI: container orchestration, scheduling, observability and failure management. Available on Kindle and in paperback.

Choochai Thianthae
Oct 204 min read


AI Engineering Bookshelf 2026: 6 LLM Engineering eBooks Worth Reading on Google Play Books
Six ChatStick Team guides to building LLM applications in production — RAG, MCP, AI agents, multi-agent systems, observability and security — with what each covers and where to start.

Choochai Thianthae
Oct 195 min read
bottom of page



