TAG
#model-serving
Stories connected through a shared idea, actor, technology or theme.
RF-DETR 1.11 widens deployment exports for computer-vision applicationsThe release supports additional deployment formats and lets TensorRT engines serve a range of batch sizes through one optimisation profile. It also restructures export internals around a registry and removes several deprecated APIs.→SGLang and AntLing cut trillion-parameter restart time to 32 secondsAntLingAGI and Alibaba reported 0.63-second weight loading for the Ling-2.6-1T FP8 model, up to 780 times faster than disk loading. The end-to-end engine restart fell to about 32 seconds by avoiding repeated disk reads.→