Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update for Stable version of Sentis #4

Open
JGrant15 opened this issue Sep 26, 2024 · 3 comments
Open

Update for Stable version of Sentis #4

JGrant15 opened this issue Sep 26, 2024 · 3 comments
Labels
enhancement New feature or request

Comments

@JGrant15
Copy link

Describe the feature

Now that Sentis 2.1.0 is released as a stable version will you be updating this package to work with that? Also I know there was discussion on rolling this package into LLM for Unity did that ever happen?

@JGrant15 JGrant15 added the enhancement New feature or request label Sep 26, 2024
@amakropoulos
Copy link
Contributor

Hi! I'm working on porting the RAG functionality in LLMUnity as we speak, it will be ready next week.
The LLMUnity version will not use Sentis anymore, it will use directly GGUF files and will allow for a huge variety of models.

@JGrant15
Copy link
Author

That's great to hear! Thank you for all the work on this asset, looking forward to the update.

@winxalex
Copy link

winxalex commented Sep 30, 2024

First hat down Toni. Dinata Dinata File. I checked new version of Sentis. IBackend backend=worker.GetBackend(). Now classes and methods are internal also some OPS are changed. It is Unity habit to use private, internal on their source disabling streamline development. It would be good also if you also include nomic. Here or in LLMUnity. (If I was unity I would do Sentis to do gguf). Maybe if I have I'll contribute updating the Embedding.cs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants