New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

INT8支持计划 #631

Open

wangyong03 opened this issue Feb 10, 2025 · 0 comments

wangyong03 commented Feb 10, 2025

请问下，现有的GPU卡只支持int8，目前社区只有fp8的权重，没有bf16的权重，从fp8->bf16->int8会损失不少精度，后续是否有开源bf16权重的计划，直接从bf16->int8精度能提升不少

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment