https://github.com/uzi0espil/research-papers-implementation/tree/master/Show%2C%20Attend%20and%20Tell%2C%20Neural%20Image%20Caption%20Generation%20with%20Visual%20Attention
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.
( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge
Chart-to-Text: A Large-Scale Benchmark for Chart Summarization
Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge
RISE: Randomized Input Sampling for Explanation of Black-box Models
RISE: Randomized Input Sampling for Explanation of Black-box Models
OmniNet: A unified architecture for multi-modal multi-task learning
LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
Beyond Greedy Search: Tracking by Multi-Agent Reinforcement Learning-based Beam Search
Brain Captioning: Decoding human brain activity into images and text
RISE: Randomized Input Sampling for Explanation of Black-box Models
Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models
NUBIA: NeUral Based Interchangeability Assessor for Text Generation
Crisscrossed Captions: Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
Exact Adversarial Attack to Image Captioning via Structured Output Learning with Latent Variables
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
Context-Aware Pseudo-Label Refinement for Source-Free Domain Adaptive Fundus Image Segmentation
Fashion Captioning: Towards Generating Accurate Descriptions with Semantic Rewards
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.