https://github.com/jshilong/gpt4roi
공식 코드GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
MLLM Leaderboard
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
Effective Approaches to Batch Parallelization for Dynamic Neural Network Architectures
SATORI-R1: Incentivizing Multimodal Reasoning with Spatial Grounding and Verifiable Rewards
BioD2C: A Dual-level Semantic Consistency Constraint Framework for Biomedical VQA
3D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision
DrishtiKon: Multi-Granular Visual Grounding for Text-Rich Document Images
Unsupervised Visual Chain-of-Thought Reasoning via Preference Optimization
DocMIA: Document-Level Membership Inference Attacks against DocVQA Models
Hallucination Benchmark in Medical Visual Question Answering
COLUMBUS: Evaluating COgnitive Lateral Understanding through Multiple-choice reBUSes
SpaceNLI: Evaluating the Consistency of Predicting Inferences in Space
cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation
Distilled Dual-Encoder Model for Vision-Language Understanding
Distilled Dual-Encoder Model for Vision-Language Understanding
DVQA: Understanding Data Visualizations via Question Answering
Answering Questions about Data Visualizations using Efficient Bimodal Fusion
QLIP: A Dynamic Quadtree Vision Prior Enhances MLLM Performance Without Retraining
cilantro: A Lean, Versatile, and Efficient Library for Point Cloud Data Processing
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review
Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformer
SurgicalGPT: End-to-End Language-Vision GPT for Visual Question Answering in Surgery
Probing the limitations of multimodal language models for chemistry and materials research
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.