https://github.com/zhilingyan/gpt4v-medical-report
공식 코드Multimodal ChatGPT for Medical Applications: an Experimental Study of GPT-4V
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.
Image Source: visualqa.org
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Multimodal ChatGPT for Medical Applications: an Experimental Study of GPT-4V
ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rules
Abstract, Rationale, Stance: A Joint Model for Scientific Claim Verification
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts
Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulation
ConTEXTual Net: A Multimodal Vision-Language Model for Segmentation of Pneumothorax
LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Model
Evaluating Attribute Comprehension in Large Vision-Language Models
Adaptively Clustering Neighbor Elements for Image-Text Generation
Frozen Transformers in Language Models Are Effective Visual Encoder Layers
MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems
Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey
Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention
SPHERE: A Hierarchical Evaluation on Spatial Perception and Reasoning for Vision-Language Models
Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks
Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception
Think Before You Act: A Two-Stage Framework for Mitigating Gender Bias Towards Vision-Language Tasks
MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videos
Evaluating Point Cloud from Moving Camera Videos: A No-Reference Metric
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.