TAG

#deepinfer

Stories connected through a shared idea, actor, technology or theme.

22 OctDeepSeek open-sources its production inference engineDeepInfer supports NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, with optimisations for scheduling, speculative decoding and large-model execution. The release does not include DeepSeek’s full cache-management, prefill/decode-disaggregation or load-balancing stack.→