Texture2D Submission Throwing 404?

[taylorbrown2686]

When I submit an image-based request:

public async Task<string> GetImageBasedReply(string prompt, Texture2D image)
        {
            ChatSession.chatMessages.Add(new Message(Role.System, new List<Content> {
                new Content(ContentType.Text, "Use this image for context to the prompt."),
                image
            }));
            ChatSession.chatMessages.Add(new Message(Role.User, prompt));

            ChatRequest request = new ChatRequest(ChatSession.chatMessages, model: "gpt-4-vision-preview", maxTokens: 200);
            ChatResponse response = await ChatSession.client.ChatEndpoint.GetCompletionAsync(request);

            if (response.Choices is not null && response.Choices.Count > 0)
            {
                var gptMessage = response.Choices[0].Message;

                print("GPT Response: " + gptMessage.Content.ToString());

                ChatSession.chatMessages.Add(gptMessage);

                return gptMessage.Content.ToString();
            }
            else
            {
                return null;
            }
        }

It throws a [POST:404] RestException, simply saying it 'Failed' with no additional information. The error itself shows the preprompt given along with a long string (Base64 assumed?) that is truncated for length.

What exactly is the '404' referring to, and how can I resolve it?

[StephenHodgson]

gpt-4-vision-preview is no longer a valid model. Try using gpt-4o

Also if you could provide the full response output that would also be helpful.

[taylorbrown2686]

Log output (EnableDebug: True)

RestException: [POST:400] https://api.openai.com/v1/chat/completions Failed!
{
  "request": {
    "url": "https://api.openai.com/v1/chat/completions",
    "body": {
      "messages": [
        {
          "role": "system",
          "content": "PROMPT HIDDEN"
        },
        {
          "role": "system",
          "content": [
            {
              "type": "text",
              "text": "PROMPT HIDDEN"
            },
            {
              "type": "image_url",
              "image_url": {
                "url":

Request/Response (called after image is captured, response returned from Task and processed elsewhere, but the response code here is where the failure is):

public async Task<string> GetImageBasedReply(string prompt, Texture2D image)
        {
            ChatSession.chatMessages.Add(new Message(Role.System, new List<Content> {
                new Content(ContentType.Text, "PROMPT HIDDEN"),
                image
            }));
            ChatSession.chatMessages.Add(new Message(Role.User, prompt));

            ChatRequest request = new ChatRequest(ChatSession.chatMessages, OpenAI.Models.Model.GPT4o, maxTokens: 200);
            ChatResponse response = await ChatSession.client.ChatEndpoint.GetCompletionAsync(request);

            if (response.Choices is not null && response.Choices.Count > 0)
            {
                var gptMessage = response.Choices[0].Message;

                print("GPT Response: " + gptMessage.Content.ToString());

                ChatSession.chatMessages.Add(gptMessage);

                return gptMessage.Content.ToString();
            }
            else
            {
                return null;
            }
        }

[taylorbrown2686]

Sorry for the formatting issue, I am putting the whole string of code in the " ` " like it wants me to, but some of the code refuses to display properly.

[StephenHodgson]

it's ok I fixed it. you need 3x `

I don't see the full output of your log which is strange. Not sure why it is getting cut off. Try looking in editor log for the full string.

[taylorbrown2686]

Hmm, I've never had to do that for a log message before. I didn't even know that option existed!

The B64 string was hiding the full message for the '400' error, which specifies that image queries need to be sent under the 'User' role and not the 'System' role. Changing this fixed my problem.

Thanks for the help!