MangaNinja:线条着色与精准参考跟随
MangaNinja: Line Art Colorization with Precise Reference Following
January 14, 2025
作者: Zhiheng Liu, Ka Leong Cheng, Xi Chen, Jie Xiao, Hao Ouyang, Kai Zhu, Yu Liu, Yujun Shen, Qifeng Chen, Ping Luo
cs.AI
摘要
MangaNinjia源自扩散模型,专注于参考引导的线条着色任务。我们融合了两种周到的设计,以确保精确的角色细节转录,包括一个补丁重排模块,以促进参考彩色图像与目标线条艺术之间的对应学习,以及一个基于点驱动的控制方案,以实现细粒度的颜色匹配。在自行收集的基准测试上进行的实验表明,我们的模型在精确着色方面优于当前解决方案。我们进一步展示了所提出的交互式点控制在处理具有挑战性的情况,跨角色着色,多参考协调等方面的潜力,超越了现有算法的能力范围。
English
Derived from diffusion models, MangaNinjia specializes in the task of
reference-guided line art colorization. We incorporate two thoughtful designs
to ensure precise character detail transcription, including a patch shuffling
module to facilitate correspondence learning between the reference color image
and the target line art, and a point-driven control scheme to enable
fine-grained color matching. Experiments on a self-collected benchmark
demonstrate the superiority of our model over current solutions in terms of
precise colorization. We further showcase the potential of the proposed
interactive point control in handling challenging cases, cross-character
colorization, multi-reference harmonization, beyond the reach of existing
algorithms.Summary
AI-Generated Summary