Advertisement

Seamlessly integrating generative AI into Krita's image drawing and editing workflow

Today I came across an amazing AI plugin that provides a smooth image generation interface specifically for Krita. It supports image inpainting and outpainting, and allows users to choose whether to add text prompts, all without any complicated settings.

developed by a group of artists who wish to provide affordable art tools for everyone. This plugin can seamlessly integrate generative AI into Krita's image creation and editing workflows.

Showcase

  • Real-time image generation based on layer regions.

  • Use a realistic model to repair and adjust photos.

  • Modify AI-generated images by adding more details or new elements.

  • Gradually refine the details in the image and iteratively optimize the local areas of the image.

  • Edit the pose vector layer to adjust character actions.

  • Supports multiple control methods: - Doodles - Line art - Depth - Pose

Core Objective:

  1. By selecting specific areas, fine-tuning existing content, and referencing sketches, line art, or depth maps, the controllability of image generation is enhanced, avoiding the unpredictability that comes with direct text-based generation.

  2. Seamless integration with Krita's editing process. No need to worry about resolution or technical details; you can draw, edit, and generate directly.

  3. Supports open-source models that run entirely locally. You can freely customize presets or quickly experience them via the cloud without high costs.


Plugin Functionality

  • Generate fills using selections for expansion, making it easy to add or remove objects.

  • AI can real-time analyze your canvas and provide instant feedback.

  • No need to worry about insufficient memory, enlarge images to 4K, 8K or higher.

  • Supports Stable Diffusion 1.5 and XL, partial support for SD3.

  • Provides various control options such as doodles, line art, Canny edges, poses, depth, normals, segmentation, etc.

  • Supports style and composition transfer based on reference images, as well as face replacement.

  • Assign personalized text descriptions to image regions defined via layers.

  • Allows queuing or canceling generation tasks during the workflow, optimizing efficiency.

  • Preview results at any time and browse the history of generated records and prompts.

  • Provide multi-functional default style presets to simplify interface operations.

  • Users can create custom presets, including custom checkpoints, LoRAs, samplers, etc.


Installation Guide

  1. If not installed yet, download and install Krita (

  2. Obtain the ZIP file of the plugin.

  3. Install the plugin

  • Open Krita, then click in sequence:

  • Select the ZIP file to download.

  • Open Krita, create a new document or open an existing image.

  • Display the plugin Docker

    • Click:

  • Configure plugin

    • In the Plugin Docker, click **"Configure"**, to launch the local server installation or connection.

  • Trial use