Code

🏎️ vllm for Online DPO#2558

Code

Merged

qgallouedec merged 34 commits intomainhuggingface/trl:mainfrom vllm-onlinedpohuggingface/trl:vllm-onlinedpoCopy head branch name to clipboardJan 17, 2025

+249-57

Commits

Commits on Jan 10, 2025

• vllm online dpo

  qgallouedec

  committed
  56f7865

  Copy full SHA for 56f7865

• new arg and add back generation config [skip ci]

  qgallouedec

  committed
  c667990

  Copy full SHA for c667990

• import utils

  qgallouedec

  committed
  cbe8083

  Copy full SHA for cbe8083

• optional import and comment

  qgallouedec

  committed
  d4c16d5

  Copy full SHA for d4c16d5

• is_vllm_available

  qgallouedec

  committed
  cc9bd44

  Copy full SHA for cc9bd44

• support conv and not conv [ci skip]

  qgallouedec

  committed
  e0840ae

  Copy full SHA for e0840ae

• add old code back

  qgallouedec

  committed
  99982e1

  Copy full SHA for 99982e1

• use func [skip ci]

  qgallouedec

  committed
  04d595a

  Copy full SHA for 04d595a

• fix _generate call

  qgallouedec

  committed
  c4af44f

  Copy full SHA for c4af44f

• fix and dedicated func

  qgallouedec

  committed
  481006d

  Copy full SHA for 481006d

• top k 50

  qgallouedec

  committed
  444f29d

  Copy full SHA for 444f29d

Commits on Jan 11, 2025

• style

  qgallouedec

  committed
  e88bcab

  Copy full SHA for e88bcab

• add import error

  qgallouedec

  committed
  3081ec0

  Copy full SHA for 3081ec0

Commits on Jan 12, 2025

• new testing model

  qgallouedec

  committed
  bde6fc3

  Copy full SHA for bde6fc3

• Update OnlineDPOTrainer class with new features

  qgallouedec

  committed
  385f81d

  Copy full SHA for 385f81d

• test vllm

  qgallouedec

  committed
  3586d68

  Copy full SHA for 3586d68

• fix generate tiny script

  qgallouedec

  committed
  dc6a024

  Copy full SHA for dc6a024

• max len arg

  qgallouedec

  committed
  c4dee90

  Copy full SHA for c4dee90

• fix comment [ci skip]

  qgallouedec

  committed
  637e653

  Copy full SHA for 637e653

• Merge branch 'main' into vllm-onlinedpo

  qgallouedec

  authored
  5da5d0b

  Copy full SHA for 5da5d0b

• revert num_return_sequences

  qgallouedec

  committed
  5c5fd5d

  Copy full SHA for 5c5fd5d

• Merge branch 'vllm-onlinedpo' of https://github.com/huggingface/trl into vllm-onlinedpo

  qgallouedec

  committed
  6169984

  Copy full SHA for 6169984

• vllm dep

  qgallouedec

  committed
  4c191ff

  Copy full SHA for 4c191ff

Commits on Jan 13, 2025

• Add require_torch_accelerator import and skip test if vllm is not available

  qgallouedec

  committed
  6af5340

  Copy full SHA for 6af5340

Commits on Jan 15, 2025

• proper require_torch_accelerator

  qgallouedec

  committed
  b39f54a

  Copy full SHA for b39f54a

• Merge branch 'main' into vllm-onlinedpo

  qgallouedec

  authored
  ac5e31f

  Copy full SHA for ac5e31f

• add vllm section

  qgallouedec

  committed
  e2fc58f

  Copy full SHA for e2fc58f

• Merge branch 'vllm-onlinedpo' of https://github.com/huggingface/trl into vllm-onlinedpo

  qgallouedec

  committed
  b7112fb

  Copy full SHA for b7112fb

• Add hfoption sections to speeding_up_training.md

  qgallouedec

  committed
  aeed6c5

  Copy full SHA for aeed6c5

• no, an id

  qgallouedec

  committed
  ed2fd05

  Copy full SHA for ed2fd05

Commits on Jan 16, 2025

• Update vllm dependency to exclude Windows platform

  qgallouedec

  committed
  4cc94d6

  Copy full SHA for 4cc94d6

• Note on future release

  qgallouedec

  committed
  28af8af

  Copy full SHA for 28af8af

Commits on Jan 17, 2025

• Merge branch 'main' into vllm-onlinedpo

  qgallouedec

  authored
  742d31d

  Copy full SHA for 742d31d

• style

  qgallouedec

  committed
  53bca09

  Copy full SHA for 53bca09