https://github.com/linzhiqiu/visual_gpt_score
공식 코드Revisiting the Role of Language Priors in Vision-Language Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Revisiting the Role of Language Priors in Vision-Language Models
Chameleon: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning
FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment
DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining
Dissecting Deep Metric Learning Losses for Image-Text Retrieval
M$^{2}$Chat: Empowering VLM for Multimodal LLM Interleaved Text-Image Generation
MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
RoboUniView: Visual-Language Model with Unified View Representation for Robotic Manipulation
The Referential Reader: A Recurrent Entity Network for Anaphora Resolution
Visual Anchors Are Strong Information Aggregators For Multimodal Large Language Model
Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendation
Large Language Model Distilling Medication Recommendation Model
Think While You Generate: Discrete Diffusion with Planned Denoising
Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Model
When Do Contrastive Learning Signals Help Spatio-Temporal Graph Forecasting?
Fine-Tune Language Models as Multi-Modal Differential Equation Solvers
Asymmetric Visual Semantic Embedding Framework for Efficient Vision-Language Alignment
Learning Dynamic Contextualised Word Embeddings via Template-based Temporal Adaptation
Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution
Pretraining De-Biased Language Model with Large-scale Click Logs for Document Ranking
Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs
Estimating Contamination via Perplexity: Quantifying Memorisation in Language Model Evaluation
Contrastive Vision-Language Alignment Makes Efficient Instruction Learner
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.