sd-webui-inpaint-anything

Inpaint Anything for Stable Diffusion Web UI

The "Inpaint Anything" extension is an innovative tool designed for the Stable Diffusion Web UI that allows users to perform inpainting directly within their browser. Utilizing advanced mask generation capabilities powered by the "Segment Anything" project, this extension streamlines the inpainting process, making it more efficient and user-friendly.

Overview

"Inpaint Anything" empowers users to create masks by simply pointing out desired areas, rather than manually outlining them. This approach not only speeds up the process but also enhances the precision of mask creation, potentially leading to superior inpainting results.

Installation

To integrate this extension into the Stable Diffusion Web UI, follow these steps:

1. Access the Extensions tab within AUTOMATIC1111's Stable Diffusion Web UI.
2. Choose the Install from URL option.
3. Enter the repository URL: https://github.com/Uminosachi/sd-webui-inpaint-anything.git.
4. Click on the Install button.
5. Restart the Web UI once the installation is complete. Ensure that you're using version 1.3.0 or higher of AUTOMATIC1111's interface.

Running the Application

For a more memory-efficient operation, users can append the --xformers argument to the startup command. It's important to note that privacy protection extensions might interfere with mask retrieval.

Downloading the Model

In the Web UI, users can download various models by navigating to the Inpaint Anything tab:

• SAM 2, High Quality Model ID, Fast Segment Anything, and MobileSAM are available.
• Choose the model size—Base, Large, or Huge—keeping in mind that larger models require more VRAM.
• The downloaded model files are stored in the models directory.

Usage

1. Image Input: Drag and drop your image into the input area.
2. Outpainting: Use padding options to configure and extend your image.
3. Segment Anything: Click Run Segment Anything to begin.
4. Sketching: Highlight the areas for inpainting and manage mask adjustments.
5. Mask Creation: Use Create mask to generate and display your mask.

Mask Adjustment Options:

• Expand mask region: Broaden the mask's coverage.
• Trim mask by sketch: Remove unwanted mask areas via sketching.
• Add mask by sketch: Incorporate additional sketched areas into the mask.

Inpainting Flow:

1. Specify prompts and select an Inpainting Model ID.
2. Click Run Inpainting and optionally adjust advanced settings like Sampler and Guidance Scale.
3. Enable Mask area Only to contain modifications strictly within the mask area.

Additional Features

• Cleaner Tab: Utilize the Cleaner Model ID and execute with Lama Cleaner.
• Inpainting webui Tab: Facilitates quick inpainting when the model is pre-downloaded.
• ControlNet Inpaint Tab: Offers extensive customization for inpainting with ControlNet.
• Mask Only Tab: Option to save and later utilize masks independently in different projects.

Image and Model Management

• Automatically saves inpainted images organized by date.
• Cached models can be managed to prevent errors during inpainting runs.

Development and Licensing

Developers can take advantage of the "Inpaint Anything" library to incorporate these functionalities into other projects. The source code is made available under the Apache 2.0 license, ensuring flexibility and wide usability.

The "Inpaint Anything" extension represents a robust approach to inpainting, offering versatility and simplicity through its integration with Stable Diffusion's Web UI. Whether for professional artists or hobbyists, it provides a streamlined and efficient solution for digital image enhancement.