Code

[JSON Mode] Constrained Sampling#175

Code

Merged

sunggg merged 21 commits intobatch-servingoctoml/mlc-llm:batch-servingfrom lvega/csoctoml/mlc-llm:lvega/csCopy head branch name to clipboardFeb 8, 2024

+261-16

Commits

Commits on Feb 8, 2024

• initial hack to get cs

  

  vegaluisjose

  authored and

  sunggg

  committed
  4f59de1

  Copy full SHA for 4f59de1

• updated prompt

  

  vegaluisjose

  authored and

  sunggg

  committed
  cb1abc6

  Copy full SHA for cb1abc6

• works

  sunggg

  committed
  7934ba7

  Copy full SHA for 7934ba7

• fixed smoke test

  

  vegaluisjose

  authored and

  sunggg

  committed
  7022ef5

  Copy full SHA for 7022ef5

• added a nested structure test

  

  vegaluisjose

  authored and

  sunggg

  committed
  09a8878

  Copy full SHA for 09a8878

• fixed fmt

  

  vegaluisjose

  authored and

  sunggg

  committed
  1bbbd62

  Copy full SHA for 1bbbd62

• added outlines as dependency

  

  vegaluisjose

  authored and

  sunggg

  committed
  87bae61

  Copy full SHA for 87bae61

• removed log info

  

  vegaluisjose

  authored and

  sunggg

  committed
  3f23707

  Copy full SHA for 3f23707

• put test back in the right placce

  

  vegaluisjose

  authored and

  sunggg

  committed
  4ea1667

  Copy full SHA for 4ea1667

• added outlines

  

  vegaluisjose

  authored and

  sunggg

  committed
  3d1c406

  Copy full SHA for 3d1c406

• added outlines pkg

  

  vegaluisjose

  authored and

  sunggg

  committed
  aaf75b8

  Copy full SHA for aaf75b8

• fixed types

  

  vegaluisjose

  authored and

  sunggg

  committed
  d12c181

  Copy full SHA for d12c181

• changed type

  

  vegaluisjose

  authored and

  sunggg

  committed
  3d026e6

  Copy full SHA for 3d026e6

• added _tokenizer

  

  vegaluisjose

  authored and

  sunggg

  committed
  82ff2c9

  Copy full SHA for 82ff2c9

• removed deadcode

  

  vegaluisjose

  authored and

  sunggg

  committed
  57b55bc

  Copy full SHA for 57b55bc

• added json mode to latency and throughput benchmark

  

  vegaluisjose

  authored and

  sunggg

  committed
  53c1329

  Copy full SHA for 53c1329

• fixed poetry dependencies

  

  vegaluisjose

  authored and

  sunggg

  committed
  5e507b4

  Copy full SHA for 5e507b4

• added schema to api

  

  vegaluisjose

  authored and

  sunggg

  committed
  1466a48

  Copy full SHA for 1466a48

• updated constrained sampling loop

  

  vegaluisjose

  authored and

  sunggg

  committed
  6ddabcf

  Copy full SHA for 6ddabcf

• reverted back loop

  

  vegaluisjose

  authored and

  sunggg

  committed
  323172f

  Copy full SHA for 323172f

• rebased

  sunggg

  committed
  982d751

  Copy full SHA for 982d751