Hunyuan3D 2.0：擴展擴散模型以生成高解析度紋理3D資產

Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation

January 21, 2025

作者: Zibo Zhao, Zeqiang Lai, Qingxiang Lin, Yunfei Zhao, Haolin Liu, Shuhui Yang, Yifei Feng, Mingxin Yang, Sheng Zhang, Xianghui Yang, Huiwen Shi, Sicong Liu, Junta Wu, Yihang Lian, Fan Yang, Ruining Tang, Zebin He, Xinzhou Wang, Jian Liu, Xuhui Zuo, Zhuo Chen, Biwen Lei, Haohan Weng, Jing Xu, Yiling Zhu, Xinhai Liu, Lixin Xu, Changrong Hu, Tianyu Huang, Lifu Wang, Jihong Zhang, Meng Chen, Liang Dong, Yiwen Jia, Yulin Cai, Jiaao Yu, Yixuan Tang, Hao Zhang, Zheng Ye, Peng He, Runzhou Wu, Chao Zhang, Yonghao Tan, Jie Xiao, Yangyu Tao, Jianchen Zhu, Jinbao Xue, Kai Liu, Chongqing Zhao, Xinming Wu, Zhichao Hu, Lei Qin, Jianbing Peng, Zhan Li, Minghui Chen, Xipeng Zhang, Lin Niu, Paige Wang, Yingkai Wang, Haozhao Kuang, Zhongyi Fan, Xu Zheng, Weihao Zhuang, YingPing He, Tian Liu, Yong Yang, Di Wang, Yuhong Liu, Jie Jiang, Jingwei Huang, Chunchao Guo

cs.AI

摘要

我們介紹了Hunyuan3D 2.0，這是一個先進的大規模3D合成系統，用於生成高分辨率紋理化的3D資產。該系統包括兩個基礎組件：一個大規模形狀生成模型--Hunyuan3D-DiT，以及一個大規模紋理合成模型--Hunyuan3D-Paint。形狀生成模型建立在可擴展的基於流的擴散轉換器上，旨在創建與給定條件圖像恰當對齊的幾何形狀，為下游應用奠定堅實基礎。紋理合成模型受益於強大的幾何和擴散先驗知識，為生成或手工製作的網格生成高分辨率和生動的紋理貼圖。此外，我們建立了Hunyuan3D-Studio--一個多功能且用戶友好的生產平台，簡化了3D資產的重新創建過程。它使專業和業餘用戶能夠高效地操作甚至動畫化他們的網格。我們系統地評估了我們的模型，顯示Hunyuan3D 2.0在幾何細節、條件對齊、紋理質量等方面優於先前的最先進模型，包括開源模型和封閉源模型。Hunyuan3D 2.0公開發布，以填補開源3D社區中大規模基礎生成模型的空白。我們的模型代碼和預訓練權重可在以下網址獲得：https://github.com/Tencent/Hunyuan3D-2

English

We present Hunyuan3D 2.0, an advanced large-scale 3D synthesis system for generating high-resolution textured 3D assets. This system includes two foundation components: a large-scale shape generation model -- Hunyuan3D-DiT, and a large-scale texture synthesis model -- Hunyuan3D-Paint. The shape generative model, built on a scalable flow-based diffusion transformer, aims to create geometry that properly aligns with a given condition image, laying a solid foundation for downstream applications. The texture synthesis model, benefiting from strong geometric and diffusion priors, produces high-resolution and vibrant texture maps for either generated or hand-crafted meshes. Furthermore, we build Hunyuan3D-Studio -- a versatile, user-friendly production platform that simplifies the re-creation process of 3D assets. It allows both professional and amateur users to manipulate or even animate their meshes efficiently. We systematically evaluate our models, showing that Hunyuan3D 2.0 outperforms previous state-of-the-art models, including the open-source models and closed-source models in geometry details, condition alignment, texture quality, and etc. Hunyuan3D 2.0 is publicly released in order to fill the gaps in the open-source 3D community for large-scale foundation generative models. The code and pre-trained weights of our models are available at: https://github.com/Tencent/Hunyuan3D-2