HiScene：构建层次化3D场景与等距视图生成

HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation

April 17, 2025

作者: Wenqi Dong, Bangbang Yang, Zesong Yang, Yuan Li, Tao Hu, Hujun Bao, Yuewen Ma, Zhaopeng Cui

cs.AI

摘要

场景级三维生成是多媒体与计算机图形学领域的关键前沿，然而现有方法要么受限于物体类别，要么缺乏交互应用所需的编辑灵活性。本文提出HiScene，一种新颖的分层框架，它弥合了二维图像生成与三维物体生成之间的鸿沟，能够生成具有组合特性与美学场景内容的高保真场景。我们的核心洞见在于将场景视为等距视图下的分层“物体”，其中房间作为一个复杂物体，可进一步分解为可操控的组件。这种分层方法使我们能够生成与二维表示对齐且保持组合结构的三维内容。为确保每个分解实例的完整性与空间对齐，我们开发了一种基于视频扩散的模态补全技术，有效处理物体间的遮挡与阴影，并引入形状先验注入以确保场景内的空间一致性。实验结果表明，我们的方法能生成更自然的物体布局与完整的物体实例，适用于交互应用，同时保持物理合理性并与用户输入对齐。

English

Scene-level 3D generation represents a critical frontier in multimedia and computer graphics, yet existing approaches either suffer from limited object categories or lack editing flexibility for interactive applications. In this paper, we present HiScene, a novel hierarchical framework that bridges the gap between 2D image generation and 3D object generation and delivers high-fidelity scenes with compositional identities and aesthetic scene content. Our key insight is treating scenes as hierarchical "objects" under isometric views, where a room functions as a complex object that can be further decomposed into manipulatable items. This hierarchical approach enables us to generate 3D content that aligns with 2D representations while maintaining compositional structure. To ensure completeness and spatial alignment of each decomposed instance, we develop a video-diffusion-based amodal completion technique that effectively handles occlusions and shadows between objects, and introduce shape prior injection to ensure spatial coherence within the scene. Experimental results demonstrate that our method produces more natural object arrangements and complete object instances suitable for interactive applications, while maintaining physical plausibility and alignment with user inputs.