https://github.com/langtech-bsc/langtech_tokenizers
Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
Self-Consistency Improves Chain of Thought Reasoning in Language Models
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
C$^2$LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matching
LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization
Adversarial Training for Aspect-Based Sentiment Analysis with BERT
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark
Efficiently Modeling Long Sequences with Structured State Spaces
WeNet 2.0: More Productive End-to-End Speech Recognition Toolkit
Unsupervised Word Segmentation with Bi-directional Neural Language Model
On the Cross-lingual Transferability of Monolingual Representations
Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation
Simplifying Paragraph-level Question Generation via Transformer Language Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.