MangaNinja:线条着色与精准参考跟随

MangaNinja: Line Art Colorization with Precise Reference Following

January 14, 2025
作者: Zhiheng Liu, Ka Leong Cheng, Xi Chen, Jie Xiao, Hao Ouyang, Kai Zhu, Yu Liu, Yujun Shen, Qifeng Chen, Ping Luo
cs.AI

摘要

MangaNinjia源自扩散模型,专注于参考引导的线条着色任务。我们融合了两种周到的设计,以确保精确的角色细节转录,包括一个补丁重排模块,以促进参考彩色图像与目标线条艺术之间的对应学习,以及一个基于点驱动的控制方案,以实现细粒度的颜色匹配。在自行收集的基准测试上进行的实验表明,我们的模型在精确着色方面优于当前解决方案。我们进一步展示了所提出的交互式点控制在处理具有挑战性的情况,跨角色着色,多参考协调等方面的潜力,超越了现有算法的能力范围。
English
Derived from diffusion models, MangaNinjia specializes in the task of reference-guided line art colorization. We incorporate two thoughtful designs to ensure precise character detail transcription, including a patch shuffling module to facilitate correspondence learning between the reference color image and the target line art, and a point-driven control scheme to enable fine-grained color matching. Experiments on a self-collected benchmark demonstrate the superiority of our model over current solutions in terms of precise colorization. We further showcase the potential of the proposed interactive point control in handling challenging cases, cross-character colorization, multi-reference harmonization, beyond the reach of existing algorithms.

Summary

AI-Generated Summary

PDF503January 15, 2025