https://github.com/qcri/llmebench
공식 코드LLMeBench: A Flexible Framework for Accelerating LLMs Benchmarking
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
LLMeBench: A Flexible Framework for Accelerating LLMs Benchmarking
Can Small Language Models Learn, Unlearn, and Retain Noise Patterns?
A text-to-tabular approach to generate synthetic patient data using LLMs
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
SummQA at MEDIQA-Chat 2023:In-Context Learning with GPT-4 for Medical Summarization
EchoPrompt: Instructing the Model to Rephrase Queries for Improved In-context Learning
Engineering Serendipity through Recommendations of Items with Atypical Aspects
Generating bilingual example sentences with large language models as lexicography assistants
PIG: Privacy Jailbreak Attack on LLMs via Gradient-based Iterative In-Context Optimization
Measuring and Modifying Factual Knowledge in Large Language Models
Evolutionary Prompt Design for LLM-Based Post-ASR Error Correction
Revisiting Demonstration Selection Strategies in In-Context Learning
Evidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMs
Learning to Poison Large Language Models for Downstream Manipulation
Transformers as Unsupervised Learning Algorithms: A study on Gaussian Mixtures
Position: Understanding LLMs Requires More Than Statistical Generalization
Investigating the Pre-Training Dynamics of In-Context Learning: Task Recognition vs. Task Learning
DAWN-ICL: Strategic Planning of Problem-solving Trajectories for Zero-Shot In-Context Learning
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study
ICLEval: Evaluating In-Context Learning Ability of Large Language Models
Are Human-generated Demonstrations Necessary for In-context Learning?
AppBench: Planning of Multiple APIs from Various APPs for Complex User Instruction
Confidence Estimation for Error Detection in Text-to-SQL Systems
One Prompt is not Enough: Automated Construction of a Mixture-of-Expert Prompts
Adversarially Pretrained Transformers may be Universally Robust In-Context Learners
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.