Presentation: Scaling LLM-Based Ranking Systems for Latency-Critical Search & Recommendation Workloads
Sundara Raman Ramachandran shares how LinkedIn productionizes LLM ranking under strict P99 latency SLAs.
Read the full story on InfoQ.