Skip to content

Latest commit

 

History

History
78 lines (55 loc) · 1.46 KB

installation.md

File metadata and controls

78 lines (55 loc) · 1.46 KB

Installation Guide

Prerequisites

  • Kubernetes version >= 1.27
  • Helm 3

Install a released version

Install

helm repo add inftyai https://inftyai.github.io/llmaz
helm repo update
helm install llmaz inftyai/llmaz --namespace llmaz-system --create-namespace --version 0.0.6

Uninstall

helm uninstall llmaz
kubectl delete ns llmaz-system

If you want to delete the CRDs as well, run

kubectl delete crd \
    openmodels.llmaz.io \
    backendruntimes.inference.llmaz.io \
    playgrounds.inference.llmaz.io \
    services.inference.llmaz.io

Install from source

Install

git clone https://github.com/inftyai/llmaz.git && cd llmaz
kubectl create ns llmaz-system && kubens llmaz-system
make helm-install

Uninstall

helm uninstall llmaz
kubectl delete ns llmaz-system

If you want to delete the CRDs as well, run

kubectl delete crd \
    openmodels.llmaz.io \
    backendruntimes.inference.llmaz.io \
    playgrounds.inference.llmaz.io \
    services.inference.llmaz.io

Change configurations

If you want to change the default configurations, please change the values in values.global.yaml, then run

make helm-install

Do you change the values in values.yaml because it's auto-generated and will be overwritten.

Upgrade

Once you changed your code, run the command to upgrade the controller:

IMG=<image-registry>:<tag> make helm-upgrade