Support alternative metrics on accelerated TGI / TEI instances#454

Merged

yongfengdu merged 2 commits intoopea-project:mainfrom eero-t:hpa-gaudi

Sep 27, 2024

+122-71

Commits on Sep 25, 2024

Add tgi.accelDevice to rest of top-level gaudi-values.yaml files

eero-t
authored and
lianhao
committed
Different TGI/TEI custom metrics & HPA rules for accelerated devices

eero-t
authored and
lianhao
committed