AniDoc：简化动画创作

AniDoc: Animation Creation Made Easier

December 18, 2024

作者: Yihao Meng, Hao Ouyang, Hanlin Wang, Qiuyu Wang, Wen Wang, Ka Leong Cheng, Zhiheng Liu, Yujun Shen, Huamin Qu

cs.AI

摘要

2D动画制作遵循行业标准工作流程，包括四个关键阶段：角色设计、关键帧动画、中间画以及上色。我们的研究旨在通过利用日益强大的生成AI潜力来降低上述过程中的劳动成本。以视频扩散模型为基础，AniDoc作为一种视频线条着色工具出现，能够自动将草图序列转换为符合参考角色规范的彩色动画。我们的模型利用对应匹配作为明确指导，从而在参考角色与每个线条艺术帧之间的变化（例如姿势）上具有很强的鲁棒性。此外，我们的模型甚至可以自动化中间画过程，使用户只需提供角色图像以及起始和结束草图，就能轻松创建时间上连贯的动画。我们的代码可在以下链接找到：https://yihao-meng.github.io/AniDoc_demo。

English

The production of 2D animation follows an industry-standard workflow, encompassing four essential stages: character design, keyframe animation, in-betweening, and coloring. Our research focuses on reducing the labor costs in the above process by harnessing the potential of increasingly powerful generative AI. Using video diffusion models as the foundation, AniDoc emerges as a video line art colorization tool, which automatically converts sketch sequences into colored animations following the reference character specification. Our model exploits correspondence matching as an explicit guidance, yielding strong robustness to the variations (e.g., posture) between the reference character and each line art frame. In addition, our model could even automate the in-betweening process, such that users can easily create a temporally consistent animation by simply providing a character image as well as the start and end sketches. Our code is available at: https://yihao-meng.github.io/AniDoc_demo.