← All news

Artificial Intelligence

Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon

Perplexity has open sourced Lily, the local inference engine behind Hybrid Compute in Perplexity Computer. Built in Rust with custom Metal kernels for one model on one chip family, it averages 1.23x MLX-LM’s prefill throughput and 1.35x its decode throughput on a 40-core, 128 GB M5 Max.

Read the full story on MarkTechPost.

Read at source (opens in a new tab)

Latest from MarkTechPost