Code

FEAT: Support gguf#446

Code

Merged

aresnow1 merged 7 commits intoxorbitsai:mainxorbitsai/inference:mainfrom aresnow1:feat/ggufaresnow1/inference:feat/ggufCopy head branch name to clipboardSep 15, 2023

+1,734-15

Commits

Commits on Sep 14, 2023

• Support converting ggml to gguf

  aresnow1

  committed
  a973fbd

  Copy full SHA for a973fbd

• llamacpp version

  aresnow1

  committed
  473f022

  Copy full SHA for 473f022

• Support gguf format

  aresnow1

  committed
  0d70d1b

  Copy full SHA for 0d70d1b

• Add gguf support for codellama instruct

  aresnow1

  committed
  9621e5d

  Copy full SHA for 9621e5d

• Add gguf support for other codellama models

  aresnow1

  committed
  d09b276

  Copy full SHA for d09b276

• Fix

  aresnow1

  committed
  05c1112

  Copy full SHA for 05c1112

Commits on Sep 15, 2023

• case-insensitive

  aresnow1

  committed
  5f37d03

  Copy full SHA for 5f37d03