Timeout for o1-preview model #4111
Replies: 2 comments 4 replies
-
|
Not enough information to reproduce and cannot reproduce. |
Beta Was this translation helpful? Give feedback.
-
|
It is harder to reproduce but I will describe it - I post a long lasting question to the o1-preview - response takes more than 1 minute for sure which is normal for o1 - than on frontend there is "no response from backend please refres the page" - then if I refresh the page response is there so backend received response OK. But the naming of chat is not updated in this case. |
Beta Was this translation helpful? Give feedback.
-
|
This is affected by your nginx/traefik/reverse-proxy config, which may timeout connnections that take long to response. Are you using a service like that? |
Beta Was this translation helpful? Give feedback.
-
MANY thanks - my fault - there was 60s and I didn't realize this can cause the timeout bacause frontend is already loaded and there are javascript requests. |
Beta Was this translation helpful? Give feedback.
-
|
I wanted to add for others facing this issue. We deployed the application to Azure and are leveraging an application gateway. To resolve the timeout issues, I had to both increase the timeout within the NGINX config, but also had to increase it within the app gateway's backend settings. I was going mad because of 20 second timesouts after I increased the timeouts to 300 seconds within NGINX, realizing the app gateway was at 20 seconds. Problem solved and now we can generate DALL-E and o1 responses without timeouts. |
Beta Was this translation helpful? Give feedback.
-
|
@thrillhousedev, would you be willing to share the updated files? I'm facing a similar issue. |
Beta Was this translation helpful? Give feedback.
-
What happened?
Frontend is reporting timeout - the chat name is not updated, bud after waiting without refresh there is response in the "New Chat" present.
Steps to Reproduce
o1-preview model with longer response time
What browsers are you seeing the problem on?
No response
Relevant log output
No response
Screenshots
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions