← All news

Artificial Intelligence

Podcast: Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM

In this episode, Edoardo Vacchi discusses the evolving landscape of WebAssembly on the backend, running Java workloads on GPUs using TornadoVM, and optimizing distributed AI inference using llm-d and vLLM on Kubernetes.

Read the full story on InfoQ.

Read at source (opens in a new tab)

Latest from InfoQ