The Inference Engineering Masterclass — Philip Kiely & Ali Taha, Baseten

Baseten has raised $13B, becoming a major AI infrastructure player amid the Inference Inflection. Philip Kiely and Ali Taha highlight inference engineering's rise as a key AI discipline, focusing on optimizing model deployment for speed and cost. Recent research shows advanced quantization techniques can boost throughput without sacrificing model quality.