TAG
#sglang
Stories connected through a shared idea, actor, technology or theme.
SGLang 0.5.22 delivers faster model loading and a critical state-correctness fixSGLang 0.5.22 introduces an InstantTensor loader that maintainers say makes models load up to ten times faster, adds new model and diffusion support, and improves DeepSeek-V4.1 throughput on H200 GPUs. It also fixes a bug that could resume hybrid-linear models from incorrect Mamba states when speculative decoding and structured output were combined.→GLM-5.3-Flash launch exposed a cross-runtime reasoning-efficiency problemSGLang said GLM-5.3-Flash initially generated about twice as many reasoning tokens on open-source engines as on Z.ai's API on AIME and GPQA, despite similar scores. Fireworks, vLLM, SGLang and Z.ai then reran tests and updated the serving path; SGLang said the excess was concentrated in some reasoning prompts and was not seen on the cited agentic benchmarks.→SGLang and AntLing cut trillion-parameter restart time to 32 secondsAntLingAGI and Alibaba reported 0.63-second weight loading for the Ling-2.6-1T FP8 model, up to 780 times faster than disk loading. The end-to-end engine restart fell to about 32 seconds by avoiding repeated disk reads.→