https://github.com/ejmichaud/grokking-squared
공식 코드Towards Understanding Grokking: An Effective Theory of Representation Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Towards Understanding Grokking: An Effective Theory of Representation Learning
Memorization vs. Generalization: Quantifying Data Leakage in NLP Performance Evaluation
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon
OWL: Probing Cross-Lingual Recall of Memorized Texts via World Literature
Broccoli: Sprinkling Lightweight Vocabulary Learning into Everyday Information Diets
Towards More Realistic Extraction Attacks: An Adversarial Perspective
How to Engage Your Readers? Generating Guiding Questions to Promote Active Reading
Beyond Memorization: Violating Privacy Via Inference with Large Language Models
MathArena: Evaluating LLMs on Uncontaminated Math Competitions
3D-EX : A Unified Dataset of Definitions and Dictionary Examples
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets
Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning
DP-RDM: Adapting Diffusion Models to Private Domains Without Fine-Tuning
Continual Dialogue State Tracking via Example-Guided Question Answering
Composing Global Optimizers to Reasoning Tasks via Algebraic Objects in Neural Nets
The Pitfalls of Memorization: When Memorization Hurts Generalization
Quantifying Adaptability in Pre-trained Language Models with 500 Tasks
Ancient Chinese Word Segmentation and Part-of-Speech Tagging Using Distant Supervision
FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression
LLMs and Memorization: On Quality and Specificity of Copyright Compliance
DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models
Pre-Training Meta-Rule Selection Policy for Visual Generative Abductive Learning
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning?
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.