Code

Add new_deployment option for serve#275

Code

Merged

KepingYan merged 4 commits intointel:mainintel/llm-on-ray:mainfrom cheehook:maincheehook/llm-on-ray:mainCopy head branch name to clipboardAug 23, 2024

+8-1

Commits

Commits on Aug 19, 2024

• Add custom route prefix option

  Show description for d8d162b
  cheehook

  committed
  d8d162b

  Copy full SHA for d8d162b

• fix the option with proper properties

  Show description for cf81ec4
  cheehook

  committed
  cf81ec4

  Copy full SHA for cf81ec4

• Merge branch 'main' into main

  Show description for f580eba
  cheehook

  authored
  f580eba

  Copy full SHA for f580eba

Commits on Aug 23, 2024

• user will enter their own route prefix with --openai_route_prefix option

  Show description for d3bd052
  cheehook

  committed
  d3bd052

  Copy full SHA for d3bd052