Papers with Code 아카이브

Multimodal Sentiment Analysis

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법 전체 데이터셋

하위 태스크: 0
평가표: 5
보존된 평가 기록: 47

Multimodal sentiment analysis is the task of performing sentiment analysis with multiple data sources - e.g. a camera feed of someone's face and their recorded speech.

<span style="color:grey; opacity: 0.6">( Image credit: ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection )</span>

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/AZYoung233/MSE-Adapter

공식 코드

MSE-Adapter: A Lightweight Plugin Endowing LLMs with the Capability to Perform Multimodal Sentiment Analysis and Emotion Recognition

https://github.com/ControlNet/MARLIN

공식 코드

MARLIN: Masked Autoencoder for facial video Representation LearnINg

https://github.com/HaohanWang/SelectAdditiveLearning

공식 코드

Select-Additive Learning: Improving Generalization in Multimodal Sentiment Analysis

https://github.com/Haoyu-ha/ALMT

공식 코드

Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

https://github.com/Justin1904/Low-rank-Multimodal-Fusion

공식 코드

Efficient Low-rank Multimodal Fusion with Modality-Specific Factors

https://github.com/MKMaS-GUET/KuDA

공식 코드

Knowledge-Guided Dynamic Modality Attention Fusion Framework for Multimodal Sentiment Analysis

https://github.com/MUSE2022-HFUT/MuSe2022

공식 코드

Hybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment Analysis

https://github.com/Teng-Sun/GEAR

공식 코드

General Debiasing for Multimodal Sentiment Analysis

https://github.com/WasifurRahman/BERT_multimodal_transformer

공식 코드

Integrating Multimodal Information in Large Pretrained Transformers

https://github.com/albertwy/SWRM

공식 코드

Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors

https://github.com/alibabaresearch/damo-convai

공식 코드

Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment

https://github.com/amanshenoy/multilogue-net

공식 코드

Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation

https://github.com/amirip/muse-2024

공식 코드

The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor Recognition

https://github.com/anita-hu/MSAF

공식 코드

MSAF: Multimodal Split Attention Fusion

https://github.com/anthonyhu/tumblr-emotions

공식 코드

Multimodal Sentiment Analysis To Explore the Structure of Emotions

https://github.com/belgats/arabic-multimodal-dataset

공식 코드

Towards Arabic Multimodal Dataset for Sentiment Analysis

https://github.com/codezakh/exploiting-BERT-thru-translation

공식 코드

Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation

https://github.com/dawn0815/UniSA

공식 코드

UniSA: Unified Generative Framework for Sentiment Analysis

https://github.com/dawn0815/saeval-benchmark

공식 코드

UniSA: Unified Generative Framework for Sentiment Analysis

https://github.com/declare-lab/MISA

공식 코드

MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis

https://github.com/declare-lab/msa-robustness

공식 코드

Analyzing Modality Robustness in Multimodal Sentiment Analysis

https://github.com/declare-lab/multimodal-deep-learning

공식 코드

Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

https://github.com/declare-lab/multimodal-infomax

공식 코드

Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis

https://github.com/deepsentiment/deepsentiment

공식 코드

Multimodal Sentiment Analysis To Explore the Structure of Emotions

https://github.com/drewjin/GSIFN

공식 코드

GSIFN: A Graph-Structured and Interlaced-Masked Multimodal Transformer-based Fusion Network for Multimodal Sentiment Analysis

https://github.com/eihw/muse-2023

공식 코드

The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation

https://github.com/eihw/muse2022

공식 코드

The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stress

https://github.com/flow-ljh/semi-iin

공식 코드

Semi-IIN: Semi-supervised Intra-inter modal Interaction Learning Network for Multimodal Sentiment Analysis

https://github.com/georgepar/mmlatch

공식 코드

MMLatch: Bottom-up Top-down Fusion for Multimodal Sentiment Analysis

https://github.com/guitld/Transfer-Learning-with-Joint-Fine-Tuning-for-Multimodal-Sentiment-Analysis

공식 코드

Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis

https://github.com/hainow/MCTN

공식 코드

Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalities

https://github.com/haoyu-ha/lnln

공식 코드

Towards Robust Multimodal Sentiment Analysis with Incomplete Data

https://github.com/hoangquy18/multimodal-aspect-category-sentiment-analysis

공식 코드

New Benchmark Dataset and Fine-Grained Cross-Modal Fusion Framework for Vietnamese Multimodal Aspect-Category Sentiment Analysis

https://github.com/jaydenzeng/tate

공식 코드

Tag-assisted Multimodal Sentiment Analysis under Uncertain Missing Modalities

https://github.com/jbdel/modulated_fusion_transformer

공식 코드

Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition

https://github.com/jedyang97/MTAG

공식 코드

MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.