Spatial Priming for Detecting Human-Object Interactions
원문 초록
The relative spatial layout of a human and an object is an important cue for determining how they interact. However, until now, spatial layout has been used just as side-information for detecting human-object interactions (HOIs). In this paper, we present a method for exploiting this spatial layout information for detecting HOIs in images. The proposed method consists of a layout module which primes a visual module to predict the type of interaction between a human and an object. The visual and layout modules share information through lateral connections at several stages. The model uses predictions from the layout module as a prior to the visual module and the prediction from the visual module is given as the final output. It also incorporates semantic information about the object using word2vec vectors. The proposed model reaches an mAP of 24.79% for HICO-Det dataset which is about 2.8% absolute points higher than the current state-of-the-art.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
RoHOI: Robustness Benchmark for Human-Object Interaction Detection
Locality-Aware Zero-Shot Human-Object Interaction Detection
HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidance
InteractAnything: Zero-shot Human Object Interaction Synthesis via LLM Feedback and Object Affordance Parsing
MaskedManipulator: Versatile Whole-Body Control for Loco-Manipulation
Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstration
토론
이 논문과 연결된 포럼 글이 아직 없습니다.