DeepSeek open-sourced DeepInfer, the engine behind its inference empire
DeepInfer, the inference engine that served 155 trillion tokens a day for DeepSeek V4.1 Flash, is now public under Apache 2.0. The catch: the KV cache tier and load balancers stayed closed.