Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/data-prep-kit/data-prep-kit
Data-Prep-Kit: getting your data ready for LLM application development
https://github.com/databrickslabs/dolly
Self-Instruct: Aligning Language Models with Self-Generated Instructions
https://github.com/datcancode/sentence-transformers
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/datphamvn/hsevo
https://github.com/david-li0406/read
https://github.com/davidkim205/komt
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
https://github.com/davidsvaughn/dts-tf
https://github.com/davidsvy/cosformer-pytorch
https://github.com/davisliang/fairseq/tree/main/examples/xlmv
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
https://github.com/davisyoshida/lorax
https://github.com/dayeonki/rewrite_mt
Tower: An Open Multilingual Large Language Model for Translation-Related Tasks
https://github.com/dbmdz/historic-ner
https://github.com/ddpalacios/Evolving-Architecture
https://github.com/debjitpaul/refiner
https://github.com/declare-lab/hyperred
https://github.com/declare-lab/red-instruct
Language Model Unalignment: Parametric Red-Teaming to Expose Hidden Harms and Biases
https://github.com/declare-lab/tango
https://github.com/deep-agent/r1-v
G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Model
https://github.com/deepBear6/StyleTransfer
https://github.com/deepeshdm/Neural-Style-Transfer
https://github.com/deepmind/optax
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
https://github.com/deepmind/pg19
https://github.com/deepmipt/bert/tree/feat/multi_gpu
https://github.com/deepseek-ai/dualpipe
https://github.com/deepset-ai/FARM
https://github.com/deepset-ai/haystack
https://github.com/deepsoftwareanalytics/omnigirl
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
https://github.com/denizyuret/fastsubs-googlecode
https://github.com/derlin/phrasal
https://github.com/deterministic-algorithms-lab/Large-XLM
https://github.com/devAmoghS/Keras-Style-Transfer
https://github.com/devanshbatra04/Named-Entity-Language-Models
https://github.com/devhemza/BERTweet_sentiment_analysis
https://github.com/devraj89/Deep-Learning-Resources
word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method
https://github.com/dfan/single-image-surface-normal-estimation
Improving Generalization Performance by Switching from Adam to SGD
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.