Multimodal Deep Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 1
- 보존된 평가 기록
- 1
Multimodal deep learning is a type of deep learning that combines information from multiple modalities, such as text, image, audio, and video, to make more accurate and comprehensive predictions. It involves training deep neural networks on data that includes multiple types of information and using the network to make predictions based on this combined data.
One of the key challenges in multimodal deep learning is how to effectively combine information from multiple modalities. This can be done using a variety of techniques, such as fusing the features extracted from each modality, or using attention mechanisms to weight the contribution of each modality based on its importance for the task at hand.
Multimodal deep learning has many applications, including image captioning, speech recognition, natural language processing, and autonomous vehicles. By combining information from multiple modalities, multimodal deep learning can improve the accuracy and robustness of models, enabling them to perform better in real-world scenarios where multiple types of information are present.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
A multimodal deep learning framework for scalable content based visual media retrieval
Multimodal Deep Learning Framework for Image Popularity Prediction on Social Media
Where and When: Space-Time Attention for Audio-Visual Explanations
Removing Word-Level Spurious Alignment between Images and Pseudo-Captions in Unsupervised Image Captioning
Supervised Video Summarization via Multiple Feature Sets with Parallel Attention
The Influence of Audio on Video Memorability with an Audio Gestalt Regulated Video Memorability System
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
Robust Sensor Fusion Algorithms Against Voice Command Attacks in Autonomous Vehicles
"Subverting the Jewtocracy": Online Antisemitism Detection Using Multimodal Deep Learning
MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition
Deep Learning for Android Malware Defenses: a Systematic Literature Review
Piano Skills Assessment
Leveraging Audio Gestalt to Predict Media Memorability
Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge
Predicting Online Video Advertising Effects with Multimodal Deep Learning
Image and Text fusion for UPMC Food-101 \\using BERT and CNNs
Multi-Modal Detection of Alzheimer's Disease from Speech and Text
Detecting Video Game Player Burnout with the Use of Sensor Data and Machine Learning
Multimodal Learning for Hateful Memes Detection
Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion
New Ideas and Trends in Deep Multimodal Content Understanding: A Review
Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models
Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Development
Multimodal Deep Learning for Flaw Detection in Software Programs
Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
Data-driven geophysics: from dictionary learning to deep learning
Multimodal price prediction
Analysis of Social Media Data using Multimodal Deep Learning for Disaster Response
Multimodal Deep Unfolding for Guided Image Super-Resolution
A multimodal deep learning approach for named entity recognition from social media
Are These Birds Similar: Learning Branched Networks for Fine-grained Representations
Multimodal Intelligence: Representation Learning, Information Fusion, and Applications
Predicting the Leading Political Ideology of YouTube Channels Using Acoustic, Textual, and Metadata Information
Audio-Conditioned U-Net for Position Estimation in Full Sheet Images
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.