https://github.com/neuir/m2rag
공식 코드Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.
( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts
Predicting Class Distribution Shift for Reliable Domain Adaptive Object Detection
SCENIR: Visual Semantic Clarity through Unsupervised Scene Graph Retrieval
ADS-Cap: A Framework for Accurate and Diverse Stylized Captioning with Unpaired Stylistic Corpora
Uncurated Image-Text Datasets: Shedding Light on Demographic Bias
Distinctive Image Captioning: Leveraging Ground Truth Captions in CLIP Guided Reinforcement Learning
On Measuring Gender Bias in Translation of Gender-neutral Pronouns
Progressive Tree-Structured Prototype Network for End-to-End Image Captioning
MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object Detection
Pick-Object-Attack: Type-Specific Adversarial Attack for Object Detection
Delving into Inter-Image Invariance for Unsupervised Visual Representations
Delving into Inter-Image Invariance for Unsupervised Visual Representations
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning
RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
Source-Free Domain Adaptation for SSVEP-based Brain-Computer Interfaces
Enhancing Visual Question Answering through Question-Driven Image Captions as Prompts
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.