Papers with Code 아카이브

Image Captioning

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

하위 태스크: 8
평가표: 34
보존된 평가 기록: 419

Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.

( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)

논문

이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.

Image Captioning

논문

Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning

Language-Guided Contrastive Audio-Visual Masked Autoencoder with Automatically Generated Audio-Visual-Text Triplets from Videos

SAMST: A Transformer framework based on SAM pseudo label filtering for remote sensing semi-supervised semantic segmentation

FedGSCA: Medical Federated Learning with Global Sample Selector and Client Adaptive Adjuster under Label Noise

Leveraging Out-of-Distribution Unlabeled Images: Semi-Supervised Semantic Segmentation with an Open-Vocabulary Model

Mask-aware Text-to-Image Retrieval: Referring Expression Segmentation Meets Cross-modal Retrieval

QUEST: Quality-aware Semi-supervised Table Extraction for Business Documents

HalLoc: Token-level Localization of Hallucinations for Vision Language Models

Flick: Few Labels Text Classification using K-Aware Intermediate Learning in Multi-Task Low-Resource Languages

Robust Unsupervised Adaptation of a Speech Recogniser Using Entropy Minimisation and Speaker Codes

SRPL-SFDA: SAM-Guided Reliable Pseudo-Labels for Source-Free Domain Adaptation in Medical Image Segmentation

A Novel Lightweight Transformer with Edge-Aware Fusion for Remote Sensing Image Captioning

Vision Matters: Simple Visual Perturbations Can Boost Multimodal Math Reasoning

ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMs

Better Reasoning with Less Data: Enhancing VLMs Through Unified Modality Scoring

Dense Retrievers Can Fail on Simple Queries: Revealing The Granularity Dilemma of Embeddings

DiscoVLA: Discrepancy Reduction in Vision, Language, and Alignment for Parameter-Efficient Video-Text Retrieval

Segment Concealed Objects with Incomplete Supervision

Edit Flows: Flow Matching with Edit Operations

An Open-Source Software Toolkit & Benchmark Suite for the Evaluation and Adaptation of Multimodal Action Models

GTR-CoT: Graph Traversal as Visual Chain of Thought for Molecular Structure Recognition

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification

Hallucination at a Glance: Controlled Visual Edits and Fine-Grained Multimodal Learning

Stepwise Decomposition and Dual-stream Focus: A Novel Approach for Training-free Camouflaged Object Segmentation

SRD: Reinforcement-Learned Semantic Perturbation for Backdoor Defense in VLMs

Frame-Level Real-Time Assessment of Stroke Rehabilitation Exercises from Video-Level Labeled Data: Task-Specific vs. Foundation Models

Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation

L3A: Label-Augmented Analytic Adaptation for Multi-Label Class Incremental Learning

Shuffle PatchMix Augmentation with Confidence-Margin Weighted Pseudo-Labels for Enhanced Source-Free Domain Adaptation

Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Models

D2AF: A Dual-Driven Annotation and Filtering Framework for Visual Grounding

Document-Level Text Generation with Minimum Bayes Risk Decoding using Optimal Transport

Beam-Guided Knowledge Replay for Knowledge-Rich Image Captioning using Vision-Language Model

CLDTracker: A Comprehensive Language Description for Visual Tracking

Puzzled by Puzzles: When Vision-Language Models Can't Take a Hint

CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentation