Papers with Code 아카이브
Language Model Evaluation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
The task of using LLMs as evaluators of large language and vision language models.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Towards Personalized Evaluation of Large Language Models with An Anonymous Crowd-Sourcing Platform
Rethinking Generative Large Language Model Evaluation for Semantic Comprehension
Advancing Chinese biomedical text mining with community challenges
ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic
KMMLU: Measuring Massive Multitask Language Understanding in Korean
CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domain
MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation
LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets
Elo Uncovered: Robustness and Best Practices in Language Model Evaluation
Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code
Branch-Solve-Merge Improves Large Language Model Evaluation and Generation
MedEval: A Multi-Level, Multi-Task, and Multi-Domain Medical Benchmark for Language Model Evaluation
Is ChatGPT a Financial Expert? Evaluating Language Models on Financial Natural Language Processing
Pseudointelligence: A Unifying Framework for Language Model Evaluation
Estimating Contamination via Perplexity: Quantifying Memorisation in Language Model Evaluation
SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research
AgentSims: An Open-Source Sandbox for Large Language Model Evaluation
FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
C-STS: Conditional Semantic Textual Similarity
PrOnto: Language Model Evaluations for 859 Languages
Dialectical language model evaluation: An initial appraisal of the commonsense spatial reasoning abilities of LLMs
Controlling for Stereotypes in Multimodal Language Model Evaluation
BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing
Language Model Evaluation in Open-ended Text Generation
Language Model Evaluation Beyond Perplexity
ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning
Mind the Gap: Assessing Temporal Generalization in Neural Language Models
CLiMP: A Benchmark for Chinese Language Model Evaluation
Improving Explainable Recommendations with Synthetic Reviews
Contrastive Entropy: A new evaluation metric for unnormalized language models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.