Concept detail
vLLM
3 tagged videos · 1 connection videos · degree 0
Publication timeline
- 2026-093 videos
Source videos
Observed neighbors
continuous batching
the summary attributes the technique as an ancestor/inspiration for vLLM's serving model
1 source videos
The Frontier AI Inference Cloud for Agents — Byung-Gon (Gon) Chun, FriendliAI