Red Hat AI 3.5 tackles the GPU queue that can stall AI pilots27m ago CNN Just Ran One of the Worst AI Puff Pieces We’ve Ever Seen in Our Lives About That “AI Actor” Tilly Northwood40m ago How Credit Genie keeps codebase docs fresh with OpenWiki41m ago Closing The Gap Between AI Ambition And Data Reality43m ago Universal Music is launching an AI music platform with ElevenLabs49m ago Top Pentagon Official Rejects Anthropic Researcher’s AI Warning2h ago Arlequin AI raises €28M to build novel AI models that learn complex relationships at scale53m ago SpaceX sues to block release of tax-break records for its Texas Terafab project53m ago Salesforce closes Fin and eyes $2bn Listen Labs, Business Insider reports54m ago Google brings Gemini for desktop app to Windows55m ago AI’s Hidden Apprenticeship Tax (And How Firms Can Avoid It)58m ago Abacus.AI Releases Three Open-Weight Smaug Models for Agentic Workloads1h ago Clay raises $115m at a $7.1bn valuation, more than double its 2025 price1h ago Before AI Agents Take Action, Enterprises Need A New Data Rule Book1h ago

Red Hat AI 3.5 tackles the GPU queue that can stall AI pilots27m ago CNN Just Ran One of the Worst AI Puff Pieces We’ve Ever Seen in Our Lives About That “AI Actor” Tilly Northwood40m ago How Credit Genie keeps codebase docs fresh with OpenWiki41m ago Closing The Gap Between AI Ambition And Data Reality43m ago Universal Music is launching an AI music platform with ElevenLabs49m ago Top Pentagon Official Rejects Anthropic Researcher’s AI Warning2h ago Arlequin AI raises €28M to build novel AI models that learn complex relationships at scale53m ago SpaceX sues to block release of tax-break records for its Texas Terafab project53m ago Salesforce closes Fin and eyes $2bn Listen Labs, Business Insider reports54m ago Google brings Gemini for desktop app to Windows55m ago AI’s Hidden Apprenticeship Tax (And How Firms Can Avoid It)58m ago Abacus.AI Releases Three Open-Weight Smaug Models for Agentic Workloads1h ago Clay raises $115m at a $7.1bn valuation, more than double its 2025 price1h ago Before AI Agents Take Action, Enterprises Need A New Data Rule Book1h ago

Machine Learning25 min reading time

How a Frontier Model Gets Built, Read from the Kimi K3 Report

Towards Data SciencePublished Aug 5, 2026

Moonshot AI released a detailed technical report on their Kimi K3 model, a 2.8-trillion-parameter mixture-of-experts transformer with innovations enabling million-token context windows and improved scaling efficiency. The report reveals how architectural tweaks and training refinements reduced compute costs while maintaining performance near top closed models.

More on this story

Deploying Kimi K3 on AWS
Jul 30· AWS Blog
With Moonshot’s free Kimi K3, China changes the sovereign AI playbook
Jul 30· Rest of World
Open weights vs. closed: An AI civil war's afoot, and the stakes are existential
Jul 29· ZDNet
Anthropic on open weights 🔓, Kimi releases K3 weights 🤖, MAI Cyber model 🔐
Jul 28· TLDR AI
Why China is giving away its best AI models
Jul 27· 3 sources
Moonshot Opens Kimi K3 Weights Under a Revenue-Tiered License
Jul 27· Unite.AI

#kimi-k3 #long-context-transformers #mixture-of-experts-models #moonshot-ai #transformer-architecture

More in Machine Learning

Machine Learning4 min read

Arlequin AI raises €28M to build novel AI models that learn complex relationships at scale

SiliconANGLE53m ago

Machine Learning4 min read

DeepSeek launches V4.1-Flash and retires V4-Pro, its flagship model

The Next Web2h ago

Machine Learning3 min read

Nvidia and Palantir fine-tune a 30B Nemotron model for Nvidia’s supply chain. It beats a model 18 times its size.

Covered by 3 sources8h ago