Get the app
Machine LearningDev5 min reading time

Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon

MarkTechPost
Read full post
Perplexity has open sourced Lily, a Rust and Metal-based inference engine optimized for running the Qwen3.6-35B-A3B model on Apple Silicon Macs with at least 24 GB RAM. Lily bypasses PyTorch and MLX for improved performance by specializing its runtime for this model and hardware, enabling efficient 4-bit quantized inference with a minimal OpenAI-compatible API.
#apple-silicon#inference-engine#lily#model-optimization#perplexity#qwen3-6-35b-a3b#rust

More in Machine Learning

Machine Learning3 min read

Nvidia and Palantir fine-tune a 30B Nemotron model for Nvidia’s supply chain. It beats a model 18 times its size.

Covered by 3 sources
Machine Learning6 min read

CoreWeave Puts Field Engineers Inside Customer Teams for Physical AI

Covered by 2 sources
Machine Learning2 min read

Weatherwatch: AI model beats standard methods at predicting cyclones

The Guardian