Openrouter or custom model with Openapi compatible

[yamijuan]

Is there any way or plan to add open router as model provider or be able to set up a custom model provider that's openapi compatible? thanks

[mrT23]

We support a lot of different providers:

Openai-compatible providers (like vllm) are supported, among others, via litellm
https://qodo-merge-docs.qodo.ai/usage-guide/changing_a_model/#ollama

[user753]

@yamijuan Did you figure out how to use openrouter?

[yamijuan]

I haven't implemented it yet, but I read the documentation, and seems clear what to do with litellm

[mrT23]

if open-router (which i have not used) are providing openai-compatible mechanism, that it is fully supported with pr-agent

something like:

[openai]
custom_llm_provider ="openai"
api_base ="..."

[config]
model="openai/Qwen2.5-32B"
model_turbo="openai/Qwen2.5-32B"
fallback_models=["openai/Qwen2.5-32B"]