Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem with setting GPT-4 as language model #59

Open
iamshab opened this issue Oct 11, 2023 · 5 comments
Open

Problem with setting GPT-4 as language model #59

iamshab opened this issue Oct 11, 2023 · 5 comments

Comments

@iamshab
Copy link

iamshab commented Oct 11, 2023

I set the environment variable "OPENAI_MODEL_NAME" with the value "gpt-4" but still it uses gpt3.5.
based on OpenAI API documentation the value "gpt-4" is correct.


Used config:
docker run -d --restart unless-stopped
-e MATTERMOST_URL=https://********
-e MATTERMOST_TOKEN=*********
-e OPENAI_API_KEY=********
-e OPENAI_MODEL_NAME=gpt-4 --name testGPT ghcr.io/yguy/chatgpt-mattermost-bot:latest

@yGuy
Copy link
Owner

yGuy commented Oct 11, 2023

How did you verify that it's still using gpt3.5? Did you check the logs or did you ask the model?

@JonasAK
Copy link

JonasAK commented Oct 13, 2023

We thought we had the same problem. When asked about its version the GPT-4 model will state that it is running on GPT-3. However the docker logs and OpenAI API usage statistics will show that the request was using version 4. When OPENAI_MODEL_NAME is set to gpt-4 it will default to gpt-4-0613 at the moment.

@yGuy
Copy link
Owner

yGuy commented Oct 13, 2023

Well - how can a model trained on data that is several years old know anything about itself?
You can add that information to the prompt and system message and it will happily tell you that it is running on "GPT-5-next" with a context window of a billion tokens, if you like, too! ;-)

@iamshab
Copy link
Author

iamshab commented Oct 13, 2023

I checked the same question in the web panel via the 3.5 and 4 versions. In mattermost even when I set it to GPT-4 it responds the same answer that the 3.5 web panel shows.

I can send you an API key for testing if it will help.

@yGuy
Copy link
Owner

yGuy commented Oct 13, 2023

Check and send the logs, first.
And to be clear. Just because I respond here from time to time, doesn't mean I am providing support services. Anyone can help. This is OSS.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants