https://github.com/AleksandarPetrov/tokenization-fairness
공식 코드Language Model Tokenizers Introduce Unfairness Between Languages
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Language Model Tokenizers Introduce Unfairness Between Languages
MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuning
ColBERT Retrieval and Ensemble Response Scoring for Language Model Question Answering
Vision-Language Pre-Training for Boosting Scene Text Detectors
Neural machine translation system for Lezgian, Russian and Azerbaijani languages
Energy-Based Reward Models for Robust Language Model Alignment
Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations
LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law
Robust Planning with Compound LLM Architectures: An LLM-Modulo Approach
AdaFisher: Adaptive Second Order Optimization via Fisher Information
Mapping and Cleaning Open Commonsense Knowledge Bases with Generative Translation
Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads
AnnoDPO: Protein Functional Annotation Learning with Direct Preference Optimization
SynArtifact: Classifying and Alleviating Artifacts in Synthetic Images via Vision-Language Model
MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map
HoneyBee: Progressive Instruction Finetuning of Large Language Models for Materials Science
LauraTSE: Target Speaker Extraction using Auto-Regressive Decoder-Only Language Models
Sylber: Syllabic Embedding Representation of Speech from Raw Audio
No Preference Left Behind: Group Distributional Preference Optimization
Evaluating Large Language Models with Human Feedback: Establishing a Swedish Benchmark
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.