Skip to content

Commit

Permalink
docs: update mllama issue notes
Browse files Browse the repository at this point in the history
  • Loading branch information
danbev committed Jan 23, 2025
1 parent f3d31fa commit 4b9fd19
Showing 1 changed file with 13 additions and 1 deletion.
14 changes: 13 additions & 1 deletion notes/llama.cpp/llama-3-2-vision.md
Original file line number Diff line number Diff line change
Expand Up @@ -763,7 +763,19 @@ ubatch does not support "cutting" the tensor in half if it does not fit into the
physical batch limit.
```
So lets try what he suggested and set the image patch embeddings on the
batch.embd and see if we can get that to work.
batch.embd and see if we can get that to work. I actually could not get this
to work either which surprised me. I'll need make sure that I'm actually using
the exact same code as I did before. Just as test I removed the copying and
it generated "It appears to be a cat", or "This image appears to be a blank
space. It does not contain any visible content" which is what I've been getting
before. So there is something incorrect with what I'm doing compared to the
previous version. The strange thing is that now and again it gets the image
correct (I'm using an image of the New York skyline) so it is not completely
off but it is not consistent.
```console
It looks like a picture of the New York City skyline, specifically the Empire State
Building. Is that correct
```

_work in progress_

Expand Down

0 comments on commit 4b9fd19

Please sign in to comment.