FlipSketch：将静态图形翻转为文本引导的草图动画

摘要

素描动画为视觉叙事提供了强大的媒介，从简单的翻页手绘到专业的工作室制作。传统动画需要一支技艺娴熟的艺术家团队来绘制关键帧和中间帧，而现有的自动化尝试仍然需要通过精确的运动路径或关键帧规范来投入大量艺术工作。我们提出了FlipSketch，这是一个系统，它带回了翻页手绘动画的魔力--只需绘制您的想法并描述您希望它如何移动！我们的方法利用文本到视频扩散模型中的运动先验，通过三个关键创新来生成素描动画：(i) 为素描风格帧生成进行微调，(ii) 通过噪声细化保留输入素描的视觉完整性的参考帧机制，以及(iii) 一种双重注意力组合，实现流畅运动而不失视觉一致性。与受限的矢量动画不同，我们的光栅帧支持动态素描变换，捕捉了传统动画的表现自由。其结果是一个直观的系统，使素描动画变得像涂鸦和描述一样简单，同时保持了手绘动画的艺术本质。

English

Sketch animations offer a powerful medium for visual storytelling, from simple flip-book doodles to professional studio productions. While traditional animation requires teams of skilled artists to draw key frames and in-between frames, existing automation attempts still demand significant artistic effort through precise motion paths or keyframe specification. We present FlipSketch, a system that brings back the magic of flip-book animation -- just draw your idea and describe how you want it to move! Our approach harnesses motion priors from text-to-video diffusion models, adapting them to generate sketch animations through three key innovations: (i) fine-tuning for sketch-style frame generation, (ii) a reference frame mechanism that preserves visual integrity of input sketch through noise refinement, and (iii) a dual-attention composition that enables fluid motion without losing visual consistency. Unlike constrained vector animations, our raster frames support dynamic sketch transformations, capturing the expressive freedom of traditional animation. The result is an intuitive system that makes sketch animation as simple as doodling and describing, while maintaining the artistic essence of hand-drawn animation.

FlipSketch：将静态图形翻转为文本引导的草图动画

FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations

摘要

Summary

Support