Multimodal Association
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 0
- 보존된 평가 기록
- 0
Multimodal association refers to the process of associating multiple modalities or types of data in time series analysis. In time series analysis, multiple modalities or types of data can be collected, such as sensor data, images, audio, and text. Multimodal association aims to integrate these different types of data to improve the understanding and prediction of the time series.
For example, in a smart home application, sensor data from temperature, humidity, and motion sensors can be combined with images from cameras to monitor the activities of residents. By analyzing the multimodal data together, the system can detect anomalies or patterns that may not be visible in individual modalities alone.
Multimodal association can be achieved using various techniques, including deep learning models, statistical models, and graph-based models. These models can be trained on the multimodal data to learn the associations and dependencies between the different types of data.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
The Evolution of Multimodal Model Architectures
C3LLM: Conditional Multimodal Content Generation Using Large Language Models
Multimodal Pretraining and Generation for Recommendation: A Tutorial
PCQA: A Strong Baseline for AIGC Quality Assessment Based on Prompt Condition
Food Development through Co-creation with AI: bread with a "taste of love"
PMG : Personalized Multimodal Generation with Large Language Models
3D-VLA: A 3D Vision-Language-Action Generative World Model
Retrieval-Augmented Generation for AI-Generated Content: A Survey
CLIP Model for Images to Textual Prompts Based on Top-k Neighbors
CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation
C3Net: Compound Conditioned ControlNet for Multimodal Content Generation
Towards Vision Enhancing LLMs: Empowering Multimodal Knowledge Storage and Sharing in LLMs
EasyGen: Easing Multimodal Generation with BiDiffuser and LLMs
MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens
Making LLaMA SEE and Draw with SEED Tokenizer
LiveChat: Video Comment Generation from Audio-Visual Multimodal Contexts
Finite Scalar Quantization: VQ-VAE Made Simple
DreamLLM: Synergistic Multimodal Comprehension and Creation
Learning to Generate Semantic Layouts for Higher Text-Image Correspondence in Text-to-Image Synthesis
Consistent Multimodal Generation via A Unified GAN Framework
SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs
Multi-modal Latent Diffusion
On Evaluating Adversarial Robustness of Large Vision-Language Models
PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology
DiffBlender: Scalable and Composable Multimodal Text-to-Image Diffusion Models
DiffuSIA: A Spiral Interaction Architecture for Encoder-Decoder Text Diffusion
Accountable Textual-Visual Chat Learns to Reject Human Instructions in Image Re-creation
Grounding Language Models to Images for Multimodal Inputs and Outputs
Text2Poster: Laying out Stylized Texts on Retrieved Images
Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models
Unified Discrete Diffusion for Simultaneous Vision-Language Generation
Multimedia Generative Script Learning for Task Planning
Multimodal Generation of Novel Action Appearances for Synthetic-to-Real Recognition of Activities of Daily Living
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
Vi-Fi: Associating Moving Subjects across Vision and Wireless Sensors
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.