Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I had already written this GGUF reader few weekends back, I just added few new GGML types introduced.
Marking as draft since it's not properly part of the codebase, as I'm not sure how things should be structured here.
Feel free to comment and ask for changes, hoping this will help push this project forward.
Snippet of the debug method printing out info for Mistral-Small-Instruct Q2_K_L gguf file: