TAG
#vllm
Stories connected through a shared idea, actor, technology or theme.
vLLM 0.31 adds faster restarts and broader large-scale serving supportvLLM 0.31 introduces a weight-cache daemon and snapshot create/restore workflows for faster engine recovery. The release also expands speculative decoding, large-scale expert-parallel serving and DeepSeek-V4.1-Flash optimisations.→GLM-5.3-Flash launch exposed a cross-runtime reasoning-efficiency problemSGLang said GLM-5.3-Flash initially generated about twice as many reasoning tokens on open-source engines as on Z.ai's API on AIME and GPQA, despite similar scores. Fireworks, vLLM, SGLang and Z.ai then reran tests and updated the serving path; SGLang said the excess was concentrated in some reasoning prompts and was not seen on the cited agentic benchmarks.→