Code

test#7

Code

Draft

robertgshaw2-redhat wants to merge 7 commits intomainneuralmagic/vllm:mainfrom zmq-frontend-optimize-rsneuralmagic/vllm:zmq-frontend-optimize-rsCopy head branch name to clipboard

+565-71

Commits

Commits on Aug 28, 2024

• [Frontend] Minor optimizations to zmq decoupled front-end

  Show description for 9c37d5b
  njhill

  committed
  9c37d5b

  Copy full SHA for 9c37d5b

• [Benchmark] Add async throughput benchmark

  Show description for a7a6e43
  njhill

  committed
  a7a6e43

  Copy full SHA for a7a6e43

• Merge remote-tracking branch 'njhill/async-llm-eng-bench' into zmq-frontend-optimize

  robertgshaw2-redhat

  committed
  0471d11

  Copy full SHA for 0471d11

• rs merged

  robertgshaw2-redhat

  committed
  d179dc2

  Copy full SHA for d179dc2

• fixt

  robertgshaw2-redhat

  committed
  c90927b

  Copy full SHA for c90927b

• nit

  robertgshaw2-redhat

  committed
  55a8351

  Copy full SHA for 55a8351

• nit

  robertgshaw2-redhat

  committed
  750eb98

  Copy full SHA for 750eb98