Previouslyshared AI-generated illustrationsToday, I'll share AI-generated anime art.It feels like it can be connected.
There are a few things we can do:
Cartoon Interpolation for animation in-between frames 
Cartoon Sketch Interpolation 
Reference-based Sketch Colorization 
Intermediate sketch animation
Finally
Sparse Sketch Guidance 
Sparse sketch reference:
Final result
Experience
A demo can be run on Huggingface: https://huggingface.co/spaces/Doubiiu/tooncrafter
Input image:
Input Prompt:
Generated video:
Input image:
Input Prompt:
Generated video:
Technical details
Overview of ToonCrafter
as detail guidance. Optionally, interpolation can be controlled via sparse sketch guidance.
Explanation of the Detail Injection 3D Decoder
via shallow cross-attention, while simultaneously performing residual learning, i.e., adding the features of Frame 1 and Frame L at deeper layers.
Examples
Examples of different sketch guidance modes: (top) bisection (n=1) and (bottom) random positions.
Comparison
Visual comparison of anime interpolation results between ToonCrafter, AnimeInterp, EISAI, FILM, and SEINE.
