-
您好大佬,请问 ”模型计算损失时会忽略标记"##回答:"之前的部分“ 这一块在您哪部分代码实现的?我好像没找到,感谢!! |
Beta Was this translation helpful? Give feedback.
Answered by
charent
Mar 27, 2024
Replies: 1 comment 1 reply
-
这个是 |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
jackfsuia
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
这个是
DataCollatorForCompletionOnlyLM
实现的(from trl import DataCollatorForCompletionOnlyLM
),你可以看下源码。直接看attention_mask
也行。