You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello!
The paper denotes that hidden states of WavLM are weighted sum for downstream tasks, and the weight assigned for each layer and downstream tasks are denoted in Figure 2 of the WavLM paper.
I want to use the exact weight values for my research.
Can I get any help on this? Or is there any place that I can find the exact weights for each downstream task and layer?
Also I have a question regarding the normalization before the weighted sum.
It is stated "We normalize the weights from differnet layers based on the hidden states values". How are they exactly normalized e.g. applying layernorm for each layer hidden states...?
Thank you.
The text was updated successfully, but these errors were encountered:
Hello!
The paper denotes that hidden states of WavLM are weighted sum for downstream tasks, and the weight assigned for each layer and downstream tasks are denoted in Figure 2 of the WavLM paper.
I want to use the exact weight values for my research.
Can I get any help on this? Or is there any place that I can find the exact weights for each downstream task and layer?
Also I have a question regarding the normalization before the weighted sum.
It is stated "We normalize the weights from differnet layers based on the hidden states values". How are they exactly normalized e.g. applying layernorm for each layer hidden states...?
Thank you.
The text was updated successfully, but these errors were encountered: