https://github.com/rajpurkarlab/x-rem
공식 코드Multimodal Image-Text Matching Improves Retrieval-based Chest X-Ray Report Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.
( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Multimodal Image-Text Matching Improves Retrieval-based Chest X-Ray Report Generation
"Wikily" Supervised Neural Translation Tailored to Cross-Lingual Tasks
SimROD: A Simple Adaptation Method for Robust Object Detection
SP$^2$OT: Semantic-Regularized Progressive Partial Optimal Transport for Imbalanced Clustering
P$^2$OT: Progressive Partial Optimal Transport for Deep Imbalanced Clustering
Versatile Teacher: A Class-aware Teacher-student Framework for Cross-domain Adaptation
LMCap: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting
SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
Weakly Supervised Video Scene Graph Generation via Natural Language Supervision
Approaching Outside: Scaling Unsupervised 3D Object Detection from 2D Scene
Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning
Discriminability objective for training descriptive captions
MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training
An Examination of the Robustness of Reference-Free Image Captioning Evaluation Metrics
Class-Conditional self-reward mechanism for improved Text-to-Image models
Dual Invariance Self-training for Reliable Semi-supervised Surgical Phase Recognition
Semi-Supervised Classification and Segmentation on High Resolution Aerial Images
Position-guided Text Prompt for Vision-Language Pre-training
Consistency-aware Fake Videos Detection on Short Video Platforms
Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.