[Bug]: API Key not being passed to Langchain Client for LiteLLM

[ishaan812]

What happened?

API Key not getting detected in client even though i'm passing it explicitly

import litellm
from agents.constants.tenant_maps import TenantOpenAIKeyMap
from langchain_community.chat_models import ChatLiteLLM


def LiteLLMWrapper(tenantId: str, model: str, json_flag: bool = False):
    provider, modelName = model.split("/")
    litellm.set_verbose= True
    api_key = TenantOpenAIKeyMap[tenantId]
    if provider == "openai":
        if api_key:
            if json_flag == True:
                chat = ChatLiteLLM(model=modelName, model_kwargs={"response_format": {"type": "json_object"}}, api_key=api_key, openai_api_key=api_key)
            else:
                chat = ChatLiteLLM(model=modelName, api_key=api_key, openai_api_key=api_key)
        else:
            raise Exception("No API key found for tenant")  
    return chat

Relevant log output

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ishaan812/Code/Niti-Workspace/genai-backend/venv/lib/python3.12/site-packages/litellm/main.py", line 2958, in completion
    raise exception_type(
          ^^^^^^^^^^^^^^^
  File "/Users/ishaan812/Code/Niti-Workspace/genai-backend/venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2189, in exception_type
    raise e
  File "/Users/ishaan812/Code/Niti-Workspace/genai-backend/venv/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 355, in exception_type
    raise AuthenticationError(
litellm.exceptions.AuthenticationError: litellm.AuthenticationError: AuthenticationError: OpenAIException - The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

1.56.10

Twitter / LinkedIn details

@ishaan812