https://github.com/bytedance/valley
공식 코드Valley2: Exploring Multimodal Models with Scalable Vision-Language Design
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Valley2: Exploring Multimodal Models with Scalable Vision-Language Design
Remote Sensing Temporal Vision-Language Models: A Comprehensive Survey
AsymLoRA: Harmonizing Data Conflicts and Commonalities in MLLMs
Batch Augmentation with Unimodal Fine-tuning for Multimodal Learning
TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones
LLMGA: Multimodal Large Language Model based Generation Assistant
MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO
CXR-LLAVA: a multimodal large language model for interpreting chest X-ray images
MiniGPT-Pancreas: Multimodal Large Language Model for Pancreas Cancer Classification and Detection
MedTsLLM: Leveraging LLMs for Multimodal Medical Time Series Analysis
Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench
ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
EndoChat: Grounded Multimodal Large Language Model for Endoscopic Surgery
mmE5: Improving Multimodal Multilingual Embeddings via High-quality Synthetic Data
AdaptVision: Dynamic Input Scaling in MLLMs for Versatile Scene Understanding
Multimodal LLM-Guided Semantic Correction in Text-to-Image Diffusion
3UR-LLM: An End-to-End Multimodal Large Language Model for 3D Scene Understanding
LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models
StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identification
Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning
Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perception
MedTVT-R1: A Multimodal LLM Empowering Medical Reasoning and Diagnosis
Period-LLM: Extending the Periodic Capability of Multimodal Large Language Model
BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.