Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support using a custom base_url for LLM APIs/ellmer providers #82

Closed
balling-dev opened this issue Feb 4, 2025 · 2 comments
Closed

Comments

@balling-dev
Copy link

Hi,

Thanks a lot for pal (and gander). Would it be possible to add support (e.g. via options) to use a custom base_url for the LLM APIs (the ellmer providers) that support it?

My use case is using pal in an enterprise setting where I need to use a custom base_url for the LLM APIs. This works great today with ellmer (where I can pass base_url as an argument), but I cannot figure out a way to make pal use a custom base_url.

Thanks for your time and effort!

Best,

./ Kristoffer

@simonpcouch
Copy link
Owner

@balling-dev, thanks for the issue!

This is indeed possible. As the options are currently set up, you would supply .pal_args = list(base_url = ...) and that argument will be passed to the function defined in .pal_fn. That said, those two options are about to be reformatted to just be one option that takes a plain ellmer Chat, so the inclusion of your base_url may be a bit clearer at that point.

Keep an eye on #81 for more!

@balling-dev
Copy link
Author

@simonpcouch Ah yes, of course 😄 . Passing the base_url in .pal_args works great. Thank you so much. I will follow the config changes in #81.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants