如何运行从 HuggingFace 下载的满血版 DeepSeek R1 671b 模型
0
所有回答(1)
0
通过这篇博文了解到可以使用 vLLM
博文链接：How to Install and Run DeepSeek R1 Locally With vLLM V1
vLLM is a fast and easy-to-use library for LLM inference and serving.
With vLLM v1, you can run DeepSeek R1 efficiently, even on GPUs with limited memory.
