https://github.com/DeepLearnXMU/MM-DCCN
공식 코드Dynamic Context-guided Capsule Network for Multimodal Machine Translation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Multimodal machine translation is the task of doing machine translation with multiple data sources - for example, translating "a bird is flying over water" + an image of a bird over water to German text.
<span style="color:grey; opacity: 0.6">( Image credit: Findings of the Third Shared Task on Multimodal Machine Translation )</span>
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Dynamic Context-guided Capsule Network for Multimodal Machine Translation
Triple consistency loss for pairing distributions in GAN-based face synthesis
Pixel-Level Alignment of Facial Images for High Accuracy Recognition Using Ensemble of Patches
BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation
Seamless: Multilingual Expressive and Streaming Speech Translation
Neural Machine Translation with Phrase-Level Universal Visual Representations
Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models
MultiSubs: A Large-scale Multimodal and Multilingual Dataset
VISA: An Ambiguous Subtitles Dataset for Visual Scene-Aware Machine Translation
Self-Knowledge Distillation with Progressive Refinement of Targets
NMTPY: A Flexible Toolkit for Advanced Neural Machine Translation Systems
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation
HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language
Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.