https://github.com/TencentARC/ST-LLM
공식 코드ST-LLM: Large Language Models Are Effective Temporal Learners
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Generating answers in free form to questions posed about images.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
ST-LLM: Large Language Models Are Effective Temporal Learners
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answering
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance
An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM
Towards Flexible Evaluation for Generative Visual Question Answering
PLLay: Efficient Topological Layer based on Persistence Landscapes
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios
Multimodal Prompt Retrieval for Generative Visual Question Answering
PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering
Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.