https://github.com/chengzeyi/paraattention
Ring Attention with Blockwise Transformers for Near-Infinite Context
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Ring Attention with Blockwise Transformers for Near-Infinite Context
VisualBERT: A Simple and Performant Baseline for Vision and Language
Spatial-Temporal Large Language Model for Traffic Prediction
XLNet: Generalized Autoregressive Pretraining for Language Understanding
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
AnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding and Generation
Enriching Pre-trained Language Model with Entity Information for Relation Classification
Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models
How to Protect Copyright Data in Optimization of Large Language Models?
Why Attention? Analyze BiLSTM Deficiency and Its Remedies in the Case of NER
Routing Networks and the Challenges of Modular and Compositional Computation
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
Temporal Analysis of Language through Neural Language Models
Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.