Skyeyes: Ground Roaming using Aerial View Images
원문 초록
Integrating aerial imagery-based scene generation into applications like autonomous driving and gaming enhances realism in 3D environments, but challenges remain in creating detailed content for occluded areas and ensuring real-time, consistent rendering. In this paper, we introduce Skyeyes, a novel framework that can generate photorealistic sequences of ground view images using only aerial view inputs, thereby creating a ground roaming experience. More specifically, we combine a 3D representation with a view consistent generation model, which ensures coherence between generated images. This method allows for the creation of geometrically consistent ground view images, even with large view gaps. The images maintain improved spatial-temporal coherence and realism, enhancing scene comprehension and visualization from aerial perspectives. To the best of our knowledge, there are no publicly available datasets that contain pairwise geo-aligned aerial and ground view imagery. Therefore, we build a large, synthetic, and geo-aligned dataset using Unreal Engine. Both qualitative and quantitative analyses on this synthetic dataset display superior results compared to other leading synthesis approaches. See the project page for more results: https://chaoren2357.github.io/website-skyeyes/.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
$I^{2}$-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting
World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
From 2D to 3D Cognition: A Brief Survey of General World Models
X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllability
LifelongPR: Lifelong knowledge fusion for point cloud place recognition based on replay and prompt learning
MCAM: Multimodal Causal Analysis Model for Ego-Vehicle-Level Driving Video Understanding
토론
이 논문과 연결된 포럼 글이 아직 없습니다.