Papers with Code 아카이브

multimodal interaction

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법전체 데이터셋

하위 태스크

0

평가표

0

보존된 평가 기록

0

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/AFeng-x/Draw-and-Understand

공식 코드

Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want

https://github.com/Alena-Xinran/MaTAV

공식 코드

Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in Conversations

https://github.com/Layjins/Spider

공식 코드

Spider: Any-to-Many Multimodal LLM

https://github.com/Mvrjustid/MHN-IJCAI22

공식 코드

Multilevel Hierarchical Network with Multiscale Sampling for Video Question Answering

https://github.com/NUSTM/EMDRC

공식 코드

Towards Explainable Multimodal Depression Recognition for Clinical Interviews

https://github.com/YihanCao123/awesome-aigc

공식 코드

A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT

https://github.com/aialt/awesome-mobile-agents

공식 코드

Foundations and Recent Trends in Multimodal Mobile Agents: A Survey

https://github.com/amr-gomaa/ML-PersRef

공식 코드

ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle

https://github.com/anosorae/irra

공식 코드

Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval

https://github.com/arminarj/empathic-grounding

공식 코드

Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents

https://github.com/arritmic/csi2pointcloud

공식 코드

Spatio-Temporal 3D Point Clouds from WiFi-CSI Data via Transformer Networks

https://github.com/avmb/dialogllmscenic

공식 코드

Dialogue-based generation of self-driving simulation scenarios using Large Language Models

https://github.com/chenxi116/TF-phrasecut-public

공식 코드

Recurrent Multimodal Interaction for Referring Image Segmentation

https://github.com/dandelin/vilt

공식 코드

ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision

https://github.com/declare-lab/mm-bigbench

공식 코드

MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks

https://github.com/guilk/kat

공식 코드

Agent AI: Surveying the Horizons of Multimodal Interaction

https://github.com/hitsz-tmg/gemel

공식 코드

Generative Multimodal Entity Linking

https://github.com/ictnlp/stream-omni

공식 코드

Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech Model

https://github.com/inclusionai/ming

공식 코드

Ming-Lite-Uni: Advancements in Unified Architecture for Natural Multimodal Interaction

https://github.com/javkonline/unimel

공식 코드

UniMEL: A Unified Framework for Multimodal Entity Linking with Large Language Models

https://github.com/jiazuoyu/pathweave

공식 코드

LLMs Can Evolve Continually on Modality for X-Modal Reasoning

https://github.com/jinyanglii/ovtr

공식 코드

OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformer

https://github.com/lijfrank-open/CFN-ESA

공식 코드

CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition

https://github.com/lwaekfjlk/mmoe

공식 코드

MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts

https://github.com/muyehuang/chartsketcher

공식 코드

ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understanding

https://github.com/nguyentthong/adaptive_contrastive_mrhp

공식 코드

Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Predictions

https://github.com/pengfei-luo/mimic

공식 코드

Multi-Grained Multimodal Interaction Network for Entity Linking

https://github.com/raina-xin/i2moe

공식 코드

I2MoE: Interpretable Multimodal Interaction-aware Mixture-of-Experts

https://github.com/shiyegao/Self-Contradictory-Instructions-SCI

공식 코드

Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions

https://github.com/shiyi-zh0408/nae_cvpr2024

공식 코드

Narrative Action Evaluation with Prompt-Guided Multimodal Interaction

https://github.com/siyi-wind/tip

공식 코드

TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Data

https://github.com/smwanghhh/co-sa

공식 코드

Cooperative Sentiment Agents for Multimodal Sentiment Analysis

https://github.com/sustechbruce/look-m

공식 코드

LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference

https://github.com/trunpm/tpt-for-videoqa

공식 코드

Temporal Pyramid Transformer with Multimodal Interaction for Video Question Answering

https://github.com/whongzhong/MMHalSnowball

공식 코드

Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models

https://github.com/yeongjoonju/mire

공식 코드

MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal Retrieval

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.