https://github.com/eladhi/clid
공식 코드CLID: Controlled-Length Image Descriptions with Limited Data
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.
( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
CLID: Controlled-Length Image Descriptions with Limited Data
Token-level and sequence-level loss smoothing for RNN language models
QUEST: Quality-aware Semi-supervised Table Extraction for Business Documents
Concadia: Towards Image-Based Text Generation with a Purpose
Pseudolabel guided pixels contrast for domain adaptive semantic segmentation
Zero-shot audio captioning with audio-language model guidance and audio context keywords
Zero-shot Translation of Attention Patterns in VQA Models to Natural Language
Cross-Domain Image Captioning with Discriminative Finetuning
Connecting What to Say With Where to Look by Modeling Human Attention Traces
A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captions
Differentially Private Representation Learning via Image Captioning
Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP
Sieve: Multimodal Dataset Pruning Using Image Captioning Models
BAN-Cap: A Multi-Purpose English-Bangla Image Descriptions Dataset
Transferable Decoding with Visual Entities for Zero-Shot Image Captioning
Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations
MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection
Reliable Student: Addressing Noise in Semi-Supervised 3D Object Detection
Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models
Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models
Full-Stage Pseudo Label Quality Enhancement for Weakly-supervised Temporal Action Localization
Semantic-Aligned Learning with Collaborative Refinement for Unsupervised VI-ReID
Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs
Good News, Everyone! Context driven entity-aware captioning for news images
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.