[Feature Request] Image Editor / Paint Tool

[ikmalsaid]

Description

It would be a great addition to have a built-in image editor and/or paint tool for Stable Diffusion inpainting, etc.

Suggested Solution

Example:
Gradio Image Editor component

Alternatives

No response

Additional Context

No response

Related Issues/Pull Requests

No response

[mad-moo]

Relevant discussion: #168

TLDR: Given how specific this component is, and that requirements in this field change rapidly, I believe this should be a third-party component and published on PyPI separately rather than be added to Rio directly.

[iwr-redmond]

Given [...] that requirements in this field change rapidly

Is that assumption correct? The edit functionality from the abandoned DreamStudio, as captured in May 2023 and with reference to the December 2022 FAQ, shows two basic features:

• Inpainting (mask creation)
• Outpainting (crop / canvas area selection)

My summary of recent developments in #168 include a note about Black Forest Labs focusing on these two features in their November 2024 feature releases. That's a fair way down the road, and while the underlying technologies have improved, the targeted feature set, and therefore the frontend requirement!, has remained static. The main "change" has been the switch from 512x512 resolution to 1024x1024.

See also Flow issue 12 for an example of real-world end user expectations. The OP does not request a fully-featured Invoke-style canvas, but rather basic inpainting mask capabilities very similar to DreamStudio's functionality a full two years earlier.

[iwr-redmond]

Given how specific this component is...

Would this be better stated as Rio being primarily focused on displaying or rendering generated content rather than facilitating user input? For example, the MultiLineTextInput component does not have a Markdown style rich text editor.

[iwr-redmond]

Apologies for multi-posting.

Another approach would be to create an interactive image component similar to NiceGUI that can then be operationalized as an image editor, ideally with an example that shows how this code can be used to create a basic image editor.

[mad-moo]

Wouldn't that just be a rio.Image inside of a rio.PointerEventListener?

[iwr-redmond]

Only if there is drawing functionality. The blank canvas example shows that objects can be created on top of the underlying canvas (or image).