Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: set my Vertex AI and gemini api_base #7578

Open
langgg0511 opened this issue Jan 6, 2025 · 0 comments
Open

[Feature]: set my Vertex AI and gemini api_base #7578

langgg0511 opened this issue Jan 6, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@langgg0511
Copy link

The Feature

Set my Vertex AI and gemini api_base.

model_list:
  - model_name: gemini-vision
    litellm_params:
      model: vertex_ai/gemini-1.5-pro
      api_base: "my-aiplatform-googleapis.com"
      vertex_project: "project-id"
      vertex_location: "us-central1"
      vertex_credentials: "/app/my-vertex-credentials.json"

https://github.com/BerriAI/litellm/blob/main/litellm/llms/vertex_ai/common_utils.py#L75

When I provide my own API base, I want to replace aiplatform.googleapis.com with my own my-aiplatform-googleapis.com.

Motivation, pitch

Set my Vertex AI and gemini api_base.

Are you a ML Ops Team?

No

Twitter / LinkedIn details

No response

@langgg0511 langgg0511 added the enhancement New feature or request label Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant