Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: migration job only runs if there is a change in values #7536

Open
mikstew opened this issue Jan 3, 2025 · 0 comments
Open

[Bug]: migration job only runs if there is a change in values #7536

mikstew opened this issue Jan 3, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@mikstew
Copy link
Contributor

mikstew commented Jan 3, 2025

What happened?

We recently updated our helm chart version for the litellm proxy and saw that there was a job added to handle the database migration work. The job was successfully created and ran the first time, but didn't run on subsequent updates because the job already exists. Looking at the migrations-job.yaml template file I see that this checksum annotation exists: checksum/config: {{ toYaml .Values | sha256sum }}. The problem is that if nothing changes in the values.yaml file then that checksum doesn't change, so the job is not re-created. Is there a mechanism in place to ensure the migration job will run when required?

Relevant log output

No response

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.55.10

Twitter / LinkedIn details

No response

@mikstew mikstew added the bug Something isn't working label Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant