arXiv:2611.25728v1 cs.CV

What's in the box? Revealing Object Layouts Inside Opaque Boxes via Contactless Vibration Excitation and Sensing

Ethan Turok, Matan Kichler, Shai Bagon, Mark Sheinin

제출 2026-11-20

원문 초록

Can we reveal what is inside an opaque box by observing its surface vibrations? Objects inside a box alter its mechanical response, providing cues about their hidden locations. We introduce a method that uses these cues to predict a box's 2D occupancy layout entirely remotely. A nearby speaker excites vibrations, which we measure on one visible wall using a grid of laser points and a camera measuring each point's speckle-pattern shifts. Our model, WhisperBox, learns to encode these vibrations into a latent representation and decode it into an occupancy map of the box's contents. The method requires no physical contact to excite or sense vibrations. We demonstrate layout recovery across various boxes and single- and multiple-object scenes, with generalization to unseen object instances, positions, orientations, and weights, as well as changes in laser placement and excitation source. Our analysis reveals that informative frequency bands need not coincide with the box's resonances and that the learned latent space captures object placement and supports arithmetic operations. These results demonstrate the potential of remote vibration sensing to infer spatial layouts hidden from view.

제출 이력

확인된 버전만 표시합니다. 전체 제출 이력은 arXiv 원문에서 확인하세요.

  1. arXiv:2611.25728v1제출 시각 미확인

함께 살펴볼 논문

공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.

공통 태그로 연결된 공개 논문이 아직 없습니다.

토론

이 논문과 연결된 포럼 글이 아직 없습니다.