Code

add speculatice decoding to opea#617

Code

Open

ClarkChin08 wants to merge 5 commits intoopea-project:mainopea-project/GenAIComps:mainfrom ClarkChin08:spec_decodeClarkChin08/GenAIComps:spec_decodeCopy head branch name to clipboard

+1,211-1

Commits

Commits on Sep 25, 2024

• add speculatice decoding to opea

  Show description for 21a2bf4
  ClarkChin08

  committed
  21a2bf4

  Copy full SHA for 21a2bf4

• add dispatched drafter and scorer to spec_decode

  Show description for 13d8f85
  ClarkChin08

  committed
  13d8f85

  Copy full SHA for 13d8f85

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 193aaba
  pre-commit-ci[bot]

  committed
  193aaba

  Copy full SHA for 193aaba

• add dispatched scorer to the spec decode

  Show description for a96c6eb
  ClarkChin08

  committed
  a96c6eb

  Copy full SHA for a96c6eb

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 72dcc2e
  pre-commit-ci[bot]

  committed
  72dcc2e

  Copy full SHA for 72dcc2e