[Enhancement]: Integration of Gemini 2.0 (text and images output)

[goreply-de]

What features would you like to see added?

Adding support to generate a combination of text and image as output would be great.

More details

With gemini-2.0-flash-exp Gemini can now support the generation of text and images as output.

To access this feature on GCP you need to navigate to ‘Vertex AI’ → ‘Vertex AI Studio’ → ‘Freeform’ → Select ‘gemini-2.0-flash-exp’ as model and ‘Image and text’ as response output type.

For this an option in the UI needs to be added to support this kind of output if the chosen model supports it. Probably endpoints need be extended as well to handle this.

Note: Currently the feature is still experimental and needs to be activated.

Which components are impacted by your request?

Endpoints, UI

Pictures

Code of Conduct

• I agree to follow this project's Code of Conduct

[marlonka]

+1 this would be really powerful for us as this eliminates the need for a image generation model