MangaNinja:使用精確參考追蹤的線條著色

MangaNinja: Line Art Colorization with Precise Reference Following

January 14, 2025
作者: Zhiheng Liu, Ka Leong Cheng, Xi Chen, Jie Xiao, Hao Ouyang, Kai Zhu, Yu Liu, Yujun Shen, Qifeng Chen, Ping Luo
cs.AI

摘要

MangaNinjia源自擴散模型,專注於參考引導的線條著色任務。我們結合了兩個周到的設計,以確保精確的角色細節轉錄,包括一個補丁洗牌模組,以促進參考彩色圖像與目標線條藝術之間的對應學習,以及一個點驅動控制方案,以實現精細的顏色匹配。在自行收集的基準測試中,實驗證明我們的模型在精確著色方面優於當前解決方案。我們進一步展示了所提出的互動式點控制在處理具有挑戰性的情況,跨角色著色,多參考和諧等方面的潛力,超越現有算法的能力範圍。
English
Derived from diffusion models, MangaNinjia specializes in the task of reference-guided line art colorization. We incorporate two thoughtful designs to ensure precise character detail transcription, including a patch shuffling module to facilitate correspondence learning between the reference color image and the target line art, and a point-driven control scheme to enable fine-grained color matching. Experiments on a self-collected benchmark demonstrate the superiority of our model over current solutions in terms of precise colorization. We further showcase the potential of the proposed interactive point control in handling challenging cases, cross-character colorization, multi-reference harmonization, beyond the reach of existing algorithms.

Summary

AI-Generated Summary

PDF483January 15, 2025