Scaling Face Interaction Graph Networks to Real World Scenes
원문 초록
Accurately simulating real world object dynamics is essential for various applications such as robotics, engineering, graphics, and design. To better capture complex real dynamics such as contact and friction, learned simulators based on graph networks have recently shown great promise. However, applying these learned simulators to real scenes comes with two major challenges: first, scaling learned simulators to handle the complexity of real world scenes which can involve hundreds of objects each with complicated 3D shapes, and second, handling inputs from perception rather than 3D state information. Here we introduce a method which substantially reduces the memory required to run graph-based learned simulators. Based on this memory-efficient simulation model, we then present a perceptual interface in the form of editable NeRFs which can convert real-world scenes into a structured representation that can be processed by graph network simulator. We show that our method uses substantially less memory than previous graph-based simulators while retaining their accuracy, and that the simulators learned in synthetic environments can be applied to real world scenes captured from multiple camera angles. This paves the way for expanding the application of learned simulators to settings where only perceptual information is available at inference time.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Frictional Agent Alignment Framework: Slow Down and Don't Break Things
Physics-Informed Deep Learning for Nonlinear Friction Model of Bow-string Interaction
PyScrew: A Comprehensive Dataset Collection from Industrial Screw Driving Experiments
Barrier-Free Microhabitats: Self-Organized Seclusion in Microbial Communities
PUGS: Zero-shot Physical Understanding with Gaussian Splatting
Know Your Mistakes: Towards Preventing Overreliance on Task-Oriented Conversational AI Through Accountability Modeling
토론
이 논문과 연결된 포럼 글이 아직 없습니다.