MMMModal -- Multi-Images Multi-Audio Multi-turn Multi-Modal
원문 초록
Our contribution introduces a groundbreaking multimodal large language model designed to comprehend multi-images, multi-audio, and multi-images-multi-audio within a single multiturn session. Leveraging state-of-the-art models, we utilize the SigLIP encoder for visual inputs and the Whisper Encoder for audio inputs. Notably, this multimodal large language model is bilingual, proficient in understanding both English and Malay simultaneously. We proudly unveil two versions of this model: TinyLlama with 1.1B parameters, and Mistral with 7B parameters. With its ability to navigate diverse modalities and languages, our model represents a significant advancement for the Malaysian context and beyond. All models released at https://huggingface.co/collections/mesolitica/multimodal-malaysian-llm-65c6f893e03f78fa9e5c8859
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generation
KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model
TalkFashion: Intelligent Virtual Try-On Assistant Based on Multimodal Large Language Model
ASCD: Attention-Steerable Contrastive Decoding for Reducing Hallucination in MLLM
CFBenchmark-MM: Chinese Financial Assistant Benchmark for Multimodal Large Language Model
토론
이 논문과 연결된 포럼 글이 아직 없습니다.