Llama 3.1 8B gguf failing to load, n_ctx automaticaly set to "131072", is this a bug? #6265
Unanswered
TiagoTiago
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
If I just touch the slider n_ctx snaps to the maximum value of "32768", and that way it does load.
Should I file a bug report? Or did I do something wrong when picking the files to put on the folder or something?
Beta Was this translation helpful? Give feedback.
All reactions