New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

可以支持多张卡推理吗？现在是一张卡，容易撑爆内存 #148

Open

liulint opened this issue Feb 7, 2025 · 2 comments

liulint commented Feb 7, 2025

No description provided.

deepsicker commented Feb 8, 2025 •

edited

Loading

你可以装一个ollama ，ollama 提供了并行计算的能力。用ollama 部署

ollama run erwan2/DeepSeek-Janus-Pro-7B

详细看这里https://www.yuque.com/unreal/gpynrn/qhgczo0u7p2gdgny

Author

liulint commented Feb 8, 2025

好的，感谢大佬

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment