← All news

Artificial Intelligence

Tsinghua AI Open-Sources AKV, a Cache Engineering Server for LLM Agents on SGLang

Tsinghua researchers released AKV, an SGLang-based serving system for cache engineering. LLM agents drop and reposition KV cache instead of summarizing history, cutting average cost 27.7% across 4 agent benchmarks.

Read the full story on MarkTechPost.

Read at source (opens in a new tab)

Latest from MarkTechPost