You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@NeonKirill if you can point me at the place(s) where Klat receives available models from the vLLM container, I can probably troubleshoot and resolve this.
Description
After restarting vLLM, Klat continues to request the old models rather than the updated ones.
Steps to Reproduce
neon-llm-vllm
containerneon-llm-vllm
container (also reported to Sentry)Relevant Code
No response
Other Notes
Previously, these invalid requests would fail; they now log errors with NeonGeckoCom/neon-llm-vllm#9
The text was updated successfully, but these errors were encountered: