Multimodal Association
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 0
- 보존된 평가 기록
- 0
Multimodal association refers to the process of associating multiple modalities or types of data in time series analysis. In time series analysis, multiple modalities or types of data can be collected, such as sensor data, images, audio, and text. Multimodal association aims to integrate these different types of data to improve the understanding and prediction of the time series.
For example, in a smart home application, sensor data from temperature, humidity, and motion sensors can be combined with images from cameras to monitor the activities of residents. By analyzing the multimodal data together, the system can detect anomalies or patterns that may not be visible in individual modalities alone.
Multimodal association can be achieved using various techniques, including deep learning models, statistical models, and graph-based models. These models can be trained on the multimodal data to learn the associations and dependencies between the different types of data.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
WeGen: A Unified Model for Interactive Multimodal Generation as We Chat
From Principles to Applications: A Comprehensive Survey of Discrete Tokenizers in Generation, Comprehension, Recommendation, and Information Retrieval
A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond
Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation
UniCMs: A Unified Consistency Model For Efficient Multimodal Generation and Understanding
MRAMG-Bench: A Comprehensive Benchmark for Advancing Multimodal Retrieval-Augmented Multimodal Generation
MASS: Overcoming Language Bias in Image-Text Matching
Artificial Intelligence in Creative Industries: Advances Prior to 2025
RDPM: Solve Diffusion Probabilistic Models via Recurrent Token Prediction
D-Judge: How Far Are We? Evaluating the Discrepancies Between AI-synthesized Images and Natural Images through Multimodal Guidance
LMFusion: Adapting Pretrained Language Models for Multimodal Generation
Multimodal Latent Language Modeling with Next-Token Diffusion
OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation
Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis
Multi-modal Retrieval Augmented Multi-modal Generation: A Benchmark, Evaluate Metrics and Strong Baselines
Benchmarking Multimodal Models for Ukrainian Language Understanding Across Academic and Cultural Domains
A Survey on Vision Autoregressive Model
Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices
Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
ACDC: Autoregressive Coherent Multimodal Generation using Diffusion Correction
Characterizing and Efficiently Accelerating Multimodal Generation Model Inference
Personalized 2D Binary Patient Codes of Tissue Images and Immunogenomic Data Through Multimodal Self-Supervised Fusion
MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistance
PixelBytes: Catching Unified Representation for Multimodal Generation
PixelBytes: Catching Unified Embedding for Multimodal Generation
Multimodal ELBO with Diffusion Decoders
UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generation
Learning Multimodal Latent Space with EBM Prior and MCMC Inference
Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services
MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls
Diffusion Models For Multi-Modal Generative Modeling
Harmonizing Visual Text Comprehension and Generation
ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generation
Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents
4M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalities
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.