Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: (non deprecated) boto3 support or awsume interoperability #7526

Open
jonha892 opened this issue Jan 3, 2025 · 0 comments
Open
Labels
enhancement New feature or request mlops user request

Comments

@jonha892
Copy link

jonha892 commented Jan 3, 2025

The Feature

awsume is a library/tool to authenticate with the AWS. It has some caching built in such that users only have to type in MFA codes once per day.

Used as a library, it provides this functionality to boto3 clients (https://awsu.me/advanced/non-interactive-awsume.html).

This way developers don't have to provide new MFA codes on every program execution, which comes in handy during local testing.

I'd like this functionality in litellm. The simplest/most flexible way for me as a user would be to fix the usage of boto3-bedrock-client. Currently this is deprecated (https://docs.litellm.ai/docs/providers/bedrock#passing-an-external-bedrockruntimeclient-as-a-parameter---completion).

Motivation, pitch

Huge initial productivity boost when developing with aws bedrock.

Many organizations use dedicated aws profiles, secured by MFA.
Using awsume is one popular and convinient way to locally access aws resources in professional settings.

Are you a ML Ops Team?

No

Twitter / LinkedIn details

No response

@jonha892 jonha892 added the enhancement New feature or request label Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request mlops user request
Projects
None yet
Development

No branches or pull requests

1 participant