TAG
#gpu
Stories connected through a shared idea, actor, technology or theme.
vLLM 0.31 adds faster restarts and broader large-scale serving supportvLLM 0.31 introduces a weight-cache daemon and snapshot create/restore workflows for faster engine recovery. The release also expands speculative decoding, large-scale expert-parallel serving and DeepSeek-V4.1-Flash optimisations.→Think launches hosted heterogeneous AI compute with Think GridEach initial SuperNode combines four NVIDIA PRO 6000 Blackwell accelerators with 384GB of pooled VRAM, networking, storage, cooling and support. The service is available to Saudi government and enterprise customers from Riyadh and is being rolled out globally for inference, training and agent workloads.→