https://github.com/wenkehuang/awesome-mllm-tuning
공식 코드Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model
Plausible May Not Be Faithful: Probing Object Hallucination in Vision-Language Pre-training
SORNet: Spatial Object-Centric Representations for Sequential Manipulation
Light-VQA: A Multi-Dimensional Quality Assessment Model for Low-Light Video Enhancement
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
Knowing-how & Knowing-that: A New Task for Machine Comprehension of User Manuals
Enhancing Vietnamese VQA through Curriculum Learning on Raw and Augmented Text Representations
FVQ: A Large-Scale Dataset and A LMM-based Method for Face Video Quality Assessment
MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language Models
p-Laplacian Adaptation for Generative Pre-trained Vision-Language Models
Unified Triplet-Level Hallucination Evaluation for Large Vision-Language Models
AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models
Doe-1: Closed-Loop Autonomous Driving with Large World Model
TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning
Hallucination Augmented Contrastive Learning for Multimodal Large Language Model
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuning
BadCM: Invisible Backdoor Attack Against Cross-Modal Learning
VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Models
Clinical Reading Comprehension: A Thorough Analysis of the emrQA Dataset
Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model
Towards Ambiguity-Free Spatial Foundation Model: Rethinking and Decoupling Depth Ambiguity
RUArt: A Novel Text-Centered Solution for Text-Based Visual Question Answering
PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.