https://github.com/JialianW/GRiT
공식 코드GRiT: A Generative Region-to-text Transformer for Object Understanding
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
GRiT: A Generative Region-to-text Transformer for Object Understanding
MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenes
Joint Event Detection and Description in Continuous Video Streams
Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualization
TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action
X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
ComiCap: A VLMs pipeline for dense captioning of Comic Panels
Spatiality-guided Transformer for 3D Dense Captioning on Point Clouds
3D Vision and Language Pretraining with Large-Scale Synthetic Data
DenseCap: Fully Convolutional Localization Networks for Dense Captioning
Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense Captioner
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning
TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
Dense-Captioning Events in Videos: SYSU Submission to ActivityNet Challenge 2020
Details Make a Difference: Object State-Sensitive Neurorobotic Task Planning
3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment
A Hierarchical Approach for Generating Descriptive Image Paragraphs
A Hierarchical Approach for Generating Descriptive Image Paragraphs
ComiCap: A VLMs pipeline for dense captioning of Comic Panels
TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.