Running Kimi K3 on MI355X at Better Performance per Dollar Than B300

Hacker News
Read full post
AMD's MI355X GPU runs the large 2.8 trillion parameter Kimi K3 model at 952 tokens per second per node, outperforming NVIDIA's B200 nodes in throughput per dollar despite some performance trade-offs. This demonstrates AMD's cost-effective hardware viability for serving frontier open-source AI models, overcoming previous software support challenges.

More in Chips & Compute

DOJ Probes Nvidia’s Tie-Up With Groq on Antitrust Concerns

Covered by 2 sources
Chips & Compute5 min read

D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion

Covered by 2 sources
Chips & Compute5 min read

Celero raises $275m to bring coherent optics inside AI data centres

The Next Web