Code

Adding TRT-LLM + Triton truss#55

Code

Open

aspctu wants to merge 20 commits intomainbasetenlabs/truss-examples:mainfrom abuqader/add-trtllm-triton-examplebasetenlabs/truss-examples:abuqader/add-trtllm-triton-exampleCopy head branch name to clipboard

+1,393

Commits

Commits on Oct 27, 2023

• init

  aspctu

  committed
  60faf86

  Copy full SHA for 60faf86

• adding remove me file

  aspctu

  committed
  52cdf9f

  Copy full SHA for 52cdf9f

• adding creation of version dir

  aspctu

  committed
  b0f419f

  Copy full SHA for b0f419f

• remove extraneous file

  aspctu

  committed
  5e81f43

  Copy full SHA for 5e81f43

• fixing data dir

  aspctu

  committed
  2d6732d

  Copy full SHA for 2d6732d

• fixing load method

  aspctu

  committed
  c593037

  Copy full SHA for c593037

Commits on Oct 29, 2023

• update path

  aspctu

  committed
  a2caf7f

  Copy full SHA for a2caf7f

• updating path to engine

  aspctu

  committed
  c5734f7

  Copy full SHA for c5734f7

• updating model.py with correct waiting logic

  aspctu

  committed
  970e12e

  Copy full SHA for 970e12e

• Adding readme

  aspctu

  committed
  775668a

  Copy full SHA for 775668a

Commits on Oct 30, 2023

• update grpc client logic

  aspctu

  committed
  ef24e7c

  Copy full SHA for ef24e7c

• set up streaming on truss server

  aspctu

  committed
  535abfc

  Copy full SHA for 535abfc

Commits on Oct 31, 2023

• update postprocessing logic for correct spacing

  aspctu

  committed
  d8eea27

  Copy full SHA for d8eea27

• increase predict concurrency

  aspctu

  committed
  8726b03

  Copy full SHA for 8726b03

Commits on Nov 1, 2023

• refactor

  aspctu

  committed
  471cbb9

  Copy full SHA for 471cbb9

• adding support for hf key, tokenizer and mpi

  aspctu

  committed
  fcb5c6c

  Copy full SHA for fcb5c6c

Commits on Nov 2, 2023

• add thread safety

  aspctu

  committed
  ec3b286

  Copy full SHA for ec3b286

Commits on Nov 3, 2023

• Update config.yaml

  aspctu

  authored
  44a412c

  Copy full SHA for 44a412c

Commits on Nov 7, 2023

• adding readme

  aspctu

  committed
  90061cc

  Copy full SHA for 90061cc

Commits on Nov 8, 2023

• update base image

  aspctu

  committed
  69a28b6

  Copy full SHA for 69a28b6