Code

add parallel sampling using vllm#409

Code

Draft

daspartho wants to merge 2 commits intoanarchy-ai:mainanarchy-ai/LLM-VM:mainfrom daspartho:parallel_sampling_vllmdaspartho/LLM-VM:parallel_sampling_vllmCopy head branch name to clipboard

+12-1

Commits

Commits on Nov 29, 2023

• parallel sampling using vllm

  daspartho

  committed
  6694965

Commits on Dec 4, 2023

• vllm_support default true

  daspartho

  committed
  3e6a87e