PLLay: Efficient Topological Layer based on Persistence Landscapes
원문 초록
We propose PLLay, a novel topological layer for general deep learning models based on persistence landscapes, in which we can efficiently exploit the underlying topological features of the input data structure. In this work, we show differentiability with respect to layer inputs, for a general persistent homology with arbitrary filtration. Thus, our proposed layer can be placed anywhere in the network and feed critical information on the topological features of input data into subsequent layers to improve the learnability of the networks toward a given task. A task-optimal structure of PLLay is learned during training via backpropagation, without requiring any input featurization or data preprocessing. We provide a novel adaptation for the DTM function-based filtration, and show that the proposed layer is robust against noise and outliers through a stability analysis. We demonstrate the effectiveness of our approach by classification experiments on various datasets.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Models
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning
MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens
토론
이 논문과 연결된 포럼 글이 아직 없습니다.