Papers with Code 아카이브
Multimodal Machine Translation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 2
- 평가표
- 3
- 보존된 평가 기록
- 17
Multimodal machine translation is the task of doing machine translation with multiple data sources - for example, translating "a bird is flying over water" + an image of a bird over water to German text.
<span style="color:grey; opacity: 0.6">( Image credit: Findings of the Third Shared Task on Multimodal Machine Translation )</span>
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Multimodal Machine Translation with Visual Scene Graph Pruning
TopicVD: A Topic-Based Dataset of Video-Guided Multimodal Machine Translation for Documentaries
Florenz: Scaling Laws for Systematic Generalization in Vision-Language Models
Make Imagination Clearer! Stable Diffusion-based Visual Imagination for Multimodal Machine Translation
EMMeTT: Efficient Multimodal Machine Translation Training
Towards Zero-Shot Multimodal Machine Translation
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset
Exploring the Necessity of Visual Modality in Multimodal Machine Translation using Authentic Datasets
The Case for Evaluating Multimodal Translation Models on Text Datasets
Adding Multimodal Capabilities to a Text-only Translation Model
Detecting Concrete Visual Tokens for Multimodal Machine Translation
Seamless: Multilingual Expressive and Streaming Speech Translation
Video-Helpful Multimodal Machine Translation
Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs
Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation
A Survey of Vision-Language Pre-training from the Lens of Multimodal Machine Translation
HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language
BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation
Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucination
Iterative Adversarial Attack on Image-guided Story Ending Generation
Generalization algorithm of multimodal pre-training model based on graph-text self-supervised training
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation
Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation
ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation
VALHALLA: Visual Hallucination for Machine Translation
Neural Machine Translation with Phrase-Level Universal Visual Representations
On Vision Features in Multimodal Machine Translation
MSCTD: A Multimodal Sentiment Chat Translation Dataset
Supervised Visual Attention for Simultaneous Multimodal Machine Translation
VISA: An Ambiguous Subtitles Dataset for Visual Scene-Aware Machine Translation
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.