Chat模块的GPU使用
#4982
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
web_ui执行推理的时候默认使用CPU（我用CUDA_VISIBLE_DEVICES=1 llamafactory-cli webui可以使用GPU推理），可以在界面里面选择GPU进行推理吗，还是只能通过命令行选择GPU来启动
Beta Was this translation helpful? Give feedback.
All reactions