SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending
원문 초록
There is increased interest in using generative AI to create 3D spaces for Virtual Reality (VR) applications. However, today's models produce artificial environments, falling short of supporting collaborative tasks that benefit from incorporating the user's physical context. To generate environments that support VR telepresence, we introduce SpaceBlender, a novel pipeline that utilizes generative AI techniques to blend users' physical surroundings into unified virtual spaces. This pipeline transforms user-provided 2D images into context-rich 3D environments through an iterative process consisting of depth estimation, mesh alignment, and diffusion-based space completion guided by geometric priors and adaptive text prompts. In a preliminary within-subjects study, where 20 participants performed a collaborative VR affinity diagramming task in pairs, we compared SpaceBlender with a generic virtual environment and a state-of-the-art scene generation framework, evaluating its ability to create virtual spaces suitable for collaboration. Participants appreciated the enhanced familiarity and context provided by SpaceBlender but also noted complexities in the generative environments that could detract from task focus. Drawing on participant feedback, we propose directions for improving the pipeline and discuss the value and design of blended spaces for different scenarios.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene Generation
DreamCube: 3D Panorama Generation via Multi-plane Synchronization
Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation
WonderVerse: Extendable 3D Scene Generation with Video Generative Models
Efficient Calisthenics Skills Classification through Foreground Instance Selection and Depth Estimation
MonoMVSNet: Monocular Priors Guided Multi-View Stereo Network
토론
이 논문과 연결된 포럼 글이 아직 없습니다.