Multimodal Deep Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 1
- 보존된 평가 기록
- 1
Multimodal deep learning is a type of deep learning that combines information from multiple modalities, such as text, image, audio, and video, to make more accurate and comprehensive predictions. It involves training deep neural networks on data that includes multiple types of information and using the network to make predictions based on this combined data.
One of the key challenges in multimodal deep learning is how to effectively combine information from multiple modalities. This can be done using a variety of techniques, such as fusing the features extracted from each modality, or using attention mechanisms to weight the contribution of each modality based on its importance for the task at hand.
Multimodal deep learning has many applications, including image captioning, speech recognition, natural language processing, and autonomous vehicles. By combining information from multiple modalities, multimodal deep learning can improve the accuracy and robustness of models, enabling them to perform better in real-world scenarios where multiple types of information are present.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Multimodal Deep Learning for Mental Disorders Prediction from Audio Speech Samples
Multimodal Age and Gender Classification Using Ear and Profile Face Images
Toxicity Prediction by Multimodal Deep Learning
Multimodal deep networks for text and image-based document classification
Deep Coupled-Representation Learning for Sparse Linear Inverse Problems with Side Information
Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Markets
Multimodal deep learning for short-term stock volatility prediction
Correlation Net: Spatiotemporal multimodal deep learning for action recognition
Learn to Combine Modalities in Multimodal Deep Learning
Fine-grained Video Attractiveness Prediction Using Multimodal Deep Learning on a Large Real-world Dataset
A Hybrid Method for Traffic Flow Forecasting Using Multimodal Deep Learning
AJILE Movement Prediction: Multimodal Deep Learning for Natural Human Neural Recordings and Video
XFlow: Cross-modal Deep Neural Networks for Audiovisual Classification
Scalable multimodal convolutional networks for brain tumour segmentation
Deep learning evaluation using deep linguistic processing
ShapeWorld - A new test methodology for multimodal language understanding
Multimodal deep learning approach for joint EEG-EMG data compression and classification
Progress Estimation and Phase Detection for Sequential Processes
Variational methods for Conditional Multimodal Deep Learning
Multimodal Emotion Recognition Using Multimodal Deep Learning
A C++ library for Multimodal Deep Learning
From Images to Sentences through Scene Description Graphs using Commonsense Reasoning and Knowledge
Multimodal Deep Learning for Robust RGB-D Object Recognition
EmoNets: Multimodal deep learning approaches for emotion recognition in video
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.