Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Invalid parameters being sent in Amazon Titan requests #7548

Open
viniciuspinto opened this issue Jan 4, 2025 · 0 comments
Open

[Bug]: Invalid parameters being sent in Amazon Titan requests #7548

viniciuspinto opened this issue Jan 4, 2025 · 0 comments
Labels
bug Something isn't working mlops user request

Comments

@viniciuspinto
Copy link

What happened?

When sending a request to the amazon.titan-embed-text-v2:0 model with the following configuration, LiteLLM is sending the aws_bedrock_runtime_endpoint field in the request body, which generates an error from AWS Bedrock.

  - model_name: titan-v2
    litellm_params:
      model: "bedrock/amazon.titan-embed-text-v2:0"
      aws_bedrock_runtime_endpoint: "<URL>"
      aws_region_name: "<REGION>"

Relevant log output

No response

Are you a ML Ops Team?

Yes

What LiteLLM version are you on ?

v1.56.9

Twitter / LinkedIn details

No response
@viniciuspinto viniciuspinto added the bug Something isn't working label Jan 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working mlops user request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@viniciuspinto