https://github.com/jlamprou/Infini-Attention
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Universal Language Model Fine-tuning for Text Classification
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Very Large Language Model as a Unified Methodology of Text Mining
ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network
Improving Neural Machine Translation Models with Monolingual Data
XLNet: Generalized Autoregressive Pretraining for Language Understanding
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Improved training of end-to-end attention models for speech recognition
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control
ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.