New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于consecutive_groups #78

Open

VincentZ-2020 opened this issue Sep 13, 2024 · 1 comment

VincentZ-2020 commented Sep 13, 2024

谢谢分享。
consecutive_groups这个参数怎么理解，Torch-Pruning里中MetaPruner没有该参数。

Author

VincentZ-2020 commented Oct 11, 2024 •

edited

Loading

        "consecutive_groups": {
            layer.self_attn.k_proj: layer.self_attn.head_dim for layer in model.model.layers
        },

请问这里设置kv是head_dim的整数倍数是以head为组进行剪枝的吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment