AniDoc：讓動畫製作更輕鬆

AniDoc: Animation Creation Made Easier

December 18, 2024

作者: Yihao Meng, Hao Ouyang, Hanlin Wang, Qiuyu Wang, Wen Wang, Ka Leong Cheng, Zhiheng Liu, Yujun Shen, Huamin Qu

cs.AI

摘要

2D動畫的製作遵循行業標準的工作流程，包括四個基本階段：角色設計、關鍵幀動畫、中間幀製作和上色。我們的研究旨在通過利用日益強大的生成式人工智能來降低上述過程中的勞動成本。以視頻擴散模型為基礎，AniDoc成為一個視頻線條著色工具，可以自動將草圖序列轉換為符合參考角色規範的彩色動畫。我們的模型利用對應匹配作為明確引導，使其對參考角色與每個線條藝術幀之間的變化（例如姿勢）具有很強的魯棒性。此外，我們的模型甚至可以自動化中間幀製作過程，使用戶只需提供角色圖像以及起始和結束草圖，就能輕鬆創建一個時間上一致的動畫。我們的代碼可在以下鏈接找到：https://yihao-meng.github.io/AniDoc_demo。

English

The production of 2D animation follows an industry-standard workflow, encompassing four essential stages: character design, keyframe animation, in-betweening, and coloring. Our research focuses on reducing the labor costs in the above process by harnessing the potential of increasingly powerful generative AI. Using video diffusion models as the foundation, AniDoc emerges as a video line art colorization tool, which automatically converts sketch sequences into colored animations following the reference character specification. Our model exploits correspondence matching as an explicit guidance, yielding strong robustness to the variations (e.g., posture) between the reference character and each line art frame. In addition, our model could even automate the in-betweening process, such that users can easily create a temporally consistent animation by simply providing a character image as well as the start and end sketches. Our code is available at: https://yihao-meng.github.io/AniDoc_demo.