https://github.com/pwc-1/Paper-9/tree/main/6/CAJ/src/models
Learn from Downstream and Be Yourself in Multimodal Large Language Model Fine-Tuning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Image Captioning is the task of describing the content of an image in words. This task lies at the intersection of computer vision and natural language processing. Most image captioning systems use an encoder-decoder framework, where an input image is encoded into an intermediate representation of the information in the image, and then decoded into a descriptive text sequence. The most popular benchmarks are nocaps and COCO, and models are typically evaluated according to a BLEU or CIDER metric.
( Image credit: Reflective Decoding Network for Image Captioning, ICCV'19)
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Learn from Downstream and Be Yourself in Multimodal Large Language Model Fine-Tuning
PR Product: A Substitute for Inner Product in Neural Networks
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
Towards Diverse and Accurate Image Captions via Reinforcing Determinantal Point Process
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
VirTex: Learning Visual Representations from Textual Annotations
Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models
Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfer
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfer
Semi-Supervised Classification and Segmentation on High Resolution Aerial Images
Evaluating Multimodal Representations on Visual Semantic Textual Similarity
Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.