Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: error 504 returned after 60s even if timeout settings are set to 900. #7518

Open
stephaneminisini opened this issue Jan 3, 2025 · 0 comments
Open

[Bug]: error 504 returned after 60s even if timeout settings are set to 900. #7518

stephaneminisini opened this issue Jan 3, 2025 · 0 comments
Labels
bug Something isn't working mlops user request

Comments

@stephaneminisini
Copy link

What happened?

I have the following settings in config.yaml:

litellm_settings:
request_timeout: 900

router_settings:
timeout: 900

But getting a HTTP 504 error after 60s. There is no log on the Litellm side.

Relevant log output

No logs

Are you a ML Ops Team?

Yes

What LiteLLM version are you on ?

v1.56.6

Twitter / LinkedIn details

No response
@stephaneminisini stephaneminisini added the bug Something isn't working label Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working mlops user request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@stephaneminisini