Code

Refactor the sequence generation#366

Code

Merged

rlouf merged 25 commits intodottxt-ai:maindottxt-ai/outlines:mainfrom rlouf:refactor-generatorrlouf/outlines:refactor-generatorCopy head branch name to clipboardDec 8, 2023

+1,662-1,777

Commits

Commits on Dec 8, 2023

• Move prompts.py to root folder

  rlouf

  committed
  f70a05f

  Copy full SHA for f70a05f

• Rename sample.py to samplers.py

  rlouf

  committed
  f942fb1

  Copy full SHA for f942fb1

• Separate indexing from generation. /text -> /generate and flatten

  rlouf

  committed
  84b70c2

  Copy full SHA for 84b70c2

• Add Index type

  rlouf

  committed
  009f02a

  Copy full SHA for 009f02a

• Add generator that samples the next tokens

  rlouf

  committed
  121e983

  Copy full SHA for 121e983

• Create FSM that stops generation when token found

  rlouf

  committed
  f0ef464

  Copy full SHA for f0ef464

• Create Regex FSM

  rlouf

  committed
  190cac0

  Copy full SHA for 190cac0

• Add user interface for text generation

  rlouf

  committed
  0ed3609

  Copy full SHA for 0ed3609

• Remove old text generation logic

  rlouf

  committed
  0e599ef

  Copy full SHA for 0e599ef

• Use torch.multinomial instead of custom sampler

  rlouf

  committed
  dc3c1ef

  Copy full SHA for dc3c1ef

• Fix datetime.time regex

  rlouf

  committed
  557fb73

  Copy full SHA for 557fb73

• Add aliases and deprecation warnings for old API

  rlouf

  committed
  f6a711d

  Copy full SHA for f6a711d

• Convert JSON output to pydantic model or dictionary

  rlouf

  committed
  45c7571

  Copy full SHA for 45c7571

• Move index to fsm

  rlouf

  committed
  97a62d6

  Copy full SHA for 97a62d6

• Update the documentation

  rlouf

  committed
  3f1c955

  Copy full SHA for 3f1c955

• Make max_token change FSM state

  rlouf

  committed
  71b2003

  Copy full SHA for 71b2003

• Add torch.inference_mode decorator

  rlouf

  committed
  3c0edde

  Copy full SHA for 3c0edde

• Rename next_instruction to forbidden_logits

  rlouf

  committed
  0357640

  Copy full SHA for 0357640

• Move init of generator state outside of SequenceGeneration

  rlouf

  committed
  40019eb

  Copy full SHA for 40019eb

• Move SequenceGenerator to api.py

  rlouf

  committed
  7c82d66

  Copy full SHA for 7c82d66

• Return FSM states with the sequence generator

  rlouf

  committed
  17096a4

  Copy full SHA for 17096a4

• Make FSM return allowed tokens

  rlouf

  committed
  dd8e21a

  Copy full SHA for dd8e21a

• Make stream output tokens with whitespaces

  rlouf

  committed
  3e15a11

  Copy full SHA for 3e15a11

• Bump Pytorch version

  rlouf

  committed
  36feb3c

  Copy full SHA for 36feb3c

• Update the documentation

  rlouf

  committed
  8190126

  Copy full SHA for 8190126