https://github.com/lyan62/RobustCap
공식 코드Understanding Retrieval Robustness for Retrieval-Augmented Image Captioning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.
( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Understanding Retrieval Robustness for Retrieval-Augmented Image Captioning
CrossRectify: Leveraging Disagreement for Semi-supervised Object Detection
Human-like Controllable Image Captioning with Verb-specific Semantic Roles
Bi-LORA: A Vision-Language Approach for Synthetic Image Detection
A semi-supervised Teacher-Student framework for surgical tool detection and localization
Fooling Contrastive Language-Image Pre-trained Models with CLIPMasterPrints
An Uncertainty-Aware Pseudo-Label Selection Framework using Regularized Conformal Prediction
Learning from Label Proportion with Online Pseudo-Label Decision by Regret Minimization
Revisiting Self-Training for Few-Shot Learning of Language Model
EOL: Transductive Few-Shot Open-Set Recognition by Enhancing Outlier Logits
Understanding Aesthetics with Language: A Photo Critique Dataset for Aesthetic Assessment
Dense Teacher: Dense Pseudo-Labels for Semi-supervised Object Detection
Co-mining: Self-Supervised Learning for Sparsely Annotated Object Detection
Boosting Semi-Supervised Learning by Exploiting All Unlabeled Data
Uncertainty Guided Ensemble Self-Training for Semi-Supervised Global Field Reconstruction
COSMic: A Coherence-Aware Generation Metric for Image Descriptions
DGMIL: Distribution Guided Multiple Instance Learning for Whole Slide Image Classification
Inconsistency Masks: Removing the Uncertainty from Input-Pseudo-Label Pairs
The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioning
GLIPv2: Unifying Localization and Vision-Language Understanding
GIT: A Generative Image-to-text Transformer for Vision and Language
LLM2CLIP: Powerful Language Model Unlocks Richer Visual Representation
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
End-to-End Semi-Supervised Object Detection with Soft Teacher
UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.