Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
marty1885 authored Jan 1, 2024
1 parent 32ccc10 commit 8f3ac0d
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,12 @@

Inference of [LLaMA](https://arxiv.org/abs/2302.13971) model in pure C/C++

### About this branch

This branch my development branch working on implementing RK3588 NPU support. Currently it is functional but is not faster then CPU due to various reasons. For how to use the branch. Please refer to my comment introducing my fork.

https://github.com/ggerganov/llama.cpp/issues/722#issuecomment-1780333765

### Hot topics

- Added Mixtral support: https://github.com/ggerganov/llama.cpp/pull/4406
Expand Down

0 comments on commit 8f3ac0d

Please sign in to comment.