https://github.com/zytx121/geoground
공식 코드GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding
Papers with Code 아카이브
Visual Grounding
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 3
- 평가표
- 4
- 보존된 평가 기록
- 20
Visual Grounding (VG) aims to locate the most relevant object or region in an image, based on a natural language query. The query can be a phrase, a sentence, or even a multi-round dialogue. There are three main challenges in VG:
- What is the main focus in a query?
- How to understand an image?
- How to locate an object?
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/zzxslp/som-llava
공식 코드List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
https://huggingface.co/sparks-solutions/ELAM-7B
공식 코드Leveraging Vision-Language Models for Visual Grounding and Analysis of Automotive UI
https://github.com/3d-vista/3D-VisTA
3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment
https://github.com/Adam1679/mutan-article-net
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
https://github.com/AleDella/mdter_eval
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding
https://github.com/Alpha-Innovator/StructEqTable-Deploy
https://github.com/BryanPlummer/cite
Learning Two-Branch Neural Networks for Image-Text Matching Tasks
https://github.com/Cadene/vqa.pytorch
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
https://github.com/Cold-Winter/vqs
https://github.com/Divs1159/STING-BEE
STING-BEE: Towards Vision-Language Model for Real-World X-ray Baggage Security Inspection
https://github.com/EvenJoker/Point-PEFT
ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidance
https://github.com/JHKim-snu/PGA
https://github.com/JoonSeongPark/vqa
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
https://github.com/MarcBS/keras
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
https://github.com/Mehrab-Tanjim/enforce-reasoning
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
https://github.com/Mehrab-Tanjim/vilbert-rationalization
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
https://github.com/MindSpore-scientific-2/code-14/tree/main/lxmert
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
https://github.com/OthersideAI/self-operating-computer
Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V
https://github.com/RuoyuChen10/objectdetection-saliency-maps
Interpreting Object-level Foundation Models via Visual Precision Search
https://github.com/Seth-Park/MultimodalExplanations
https://github.com/ShihHanChou/360grounding
https://github.com/UncleMEDM/Refer-it-in-RGBD
Refer-it-in-RGBD: A Bottom-up Approach for 3D Visual Grounding in RGBD Images
https://github.com/UniModal4Reasoning/StructEqTable-Deploy
https://github.com/X-PLUG/mPLUG-2
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
https://github.com/adacheng/egothink
VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI
https://github.com/aimagelab/LLaVA-MORE
The Revolution of Multimodal Large Language Models: A Survey
https://github.com/allenai/allennlp-models
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
https://github.com/anthonysicilia/leather-aacl2022
Beyond task success: A closer look at jointly learning to see, ask, and GuessWhat
https://github.com/ariaui/aria-ui
https://github.com/arunmallya/simple-vqa
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
https://github.com/b-faye/lightmdetr
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding
https://github.com/brandon3964/multimodal-task-vector
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
https://github.com/chartgalaxy/chartgalaxy
OrionBench: A Benchmark for Chart and Human-Recognizable Object Detection in Infographics
https://github.com/cheoljun95/sdhubert
https://github.com/cooldawnant/infochartqa
OrionBench: A Benchmark for Chart and Human-Recognizable Object Detection in Infographics
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.