Papers with Code · CC BY-SA 4.0
Image Captioning
Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.
( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)
데이터셋
42개VizWiz 2020 test-devCOCO Captionsnocaps in-domainnocaps out-of-domainnocaps entirenocaps near-domainCOCO (Common Objects in Context)VizWiz 2020 testScanRefer Datasetnocaps-XD entireTextCaps 2020nocaps-XD in-domainnocaps-XD near-domainnocaps-XD out-of-domainnocaps-val-in-domainnocaps-val-overallNr3Dnocaps-val-near-domainnocaps-val-out-domainSCICAPFlickr30k Captions testWHOOPS!Object HalBenchnocaps valCOCO Captions testConceptual CaptionsFlickrStyle10KLocalized Narrativesrelational captioning datasetAIC-ICC