articles and knowledge

Your model works, but every request is slow and every GPU hour is expensive. Here are five key takeaways behind Inference at Full Throttle, a practical guide from the Scaling AI Systems Series on LLM serving performance. On Kindle and in paperback.

Three focused engineering books from ChatVariety Team for teams running AI in production — fast LLM serving with vLLM, quantization and speculative decoding, reliable GPU cluster operations, and AI unit economics — with a recommended reading order and Kindle and paperback links.

A focused guide from the Scaling AI Systems Series on running GPU clusters for AI: container orchestration, scheduling, observability and failure management. Available on Kindle and in paperback.

Four ChatVariety Team books on Amazon – Semiconductor Engineering History, Pre-Training LLM Engineering, AI Cost Management and Quantum Computing Engineering – compared side by side, with a reading order and a link for every book.

An engineering guide from the Software-Defined Vehicle Engineering Series that brings ISO 26262, SOTIF, cybersecurity, ADAS and safety-critical software together for electric and autonomous vehicles. On Kindle and in paperback.