Element should be able to add open-source LLM extension support (including models like Command R+, Meta Llama models, Phi, ......)

[gmanskibiditoilet]

Your use case

Hi devs,

We would like to propose to the devs that Element should have extensive custom LLM support right inside the element web/desktop client in order to compete against current proprietary models like ChatGPT . We hope that the devs will start adding API support for many open-source Large Language Models (LLMs) into the Element client, so the users can use those AIs right out of the box.

Some examples include Phi 4, Command R+, Meta Llama 3.3 70B, Google Gemma 27B, ..........

Thanks

Have you considered any alternatives?

No response

Additional context

Please remember to add LLM support in the "extensions" category

[gmanskibiditoilet]

hi @dbkr and @florianduros do u hav any plans of adding this new feature

We hope that this new feature will be released soon

[florianduros]

Hi, it's not planned