ORPO Integration #2989
GitIgnoreMaybe
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Better performance than SFT + OPO
https://medium.com/@zaiinn440/orpo-outperforms-sft-dpo-train-phi-2-with-orpo-3ee6bf18dbf2
Beta Was this translation helpful? Give feedback.
All reactions