Qwen2VL 增量预训练脚本 #6711
Unanswered
Road2Redemption
asked this question in
Q&A
Qwen2VL 增量预训练脚本
#6711
Replies: 1 comment
-
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Reminder
System Info
我想对Qwen2VL做增量预训练,请问应该使用哪个配置文件? 直接使用train_full/qwen2vl_full_sft.yaml 或者 train_lora/qwen2vl_lora_sft.yaml 吗?
因为我只看到了llama3有一个lora pretrain的配置文件,没有看到vl模型相关的,谢谢~
还有,如果增量预训练完毕,继续lora sft的话,如果是full post-pretrain那就直接再lora一下,如果是lora post-pretrain那就--adapter_name_or_path这个lora adapter训就行是吗?
Reproduction
Others
No response
Beta Was this translation helpful? Give feedback.
All reactions