https://github.com/8188zq/Inference-Time-Decontamination
공식 코드Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation
Papers with Code 아카이브
Language Model Evaluation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
The task of using LLMs as evaluators of large language and vision language models.
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/IBM/helm-enterprise-benchmark
공식 코드https://github.com/Joe-Hall-Lee/Debias
공식 코드https://github.com/allenai/catwalk
공식 코드Catwalk: A Unified Language Model Evaluation Framework for Many Datasets
https://github.com/bigscience-workshop/biomedical
공식 코드BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing
https://github.com/ceeai/elle
공식 코드https://github.com/codefuse-ai/awesome-code-llm
공식 코드Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code
https://github.com/deepmind/deepmind-research
공식 코드Mind the Gap: Assessing Temporal Generalization in Neural Language Models
https://github.com/dropreg/fennec
공식 코드https://github.com/dvlab-research/diaggsm8k
공식 코드MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation
https://github.com/dvlab-research/mr-gsm8k
공식 코드MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation
https://github.com/kaistai/flask
공식 코드FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
https://github.com/kundajelab/dart-eval
공식 코드DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
https://github.com/lgessler/pronto
공식 코드https://github.com/liyucheng09/contamination_detector
공식 코드Estimating Contamination via Perplexity: Quantifying Memorisation in Language Model Evaluation
https://github.com/liyucheng09/latesteval
공식 코드https://github.com/mbzuai-nlp/arabicmmlu
공식 코드ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic
https://github.com/mingyue-cheng/bingjian
공식 코드Towards Personalized Evaluation of Large Language Models with An Anonymous Crowd-Sourcing Platform
https://github.com/mlgroupjlu/matrixnuclearnorm
공식 코드https://github.com/opendfm/bai-scieval
공식 코드SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research
https://github.com/opendfm/scieval
공식 코드SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research
https://github.com/princeton-nlp/c-sts
공식 코드https://github.com/py499372727/AgentSims
공식 코드AgentSims: An Open-Source Sandbox for Large Language Model Evaluation
https://github.com/shijian2001/templatematters
공식 코드https://github.com/slp-rl/salmon
공식 코드https://github.com/swaggy66/M-ABSA
공식 코드M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis
https://github.com/upstageai/evalverse
공식 코드Evalverse: Unified and Accessible Library for Large Language Model Evaluation
https://github.com/vishalpallagani/fable
공식 코드FABLE: A Novel Data-Flow Analysis Benchmark on Procedural Text for Large Language Model Evaluation
https://github.com/yelboudouri/rpeval
공식 코드https://github.com/yue-llm-pit/scop
공식 코드https://github.com/yuhui-zh15/autoconverter
공식 코드Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation
https://github.com/zjunlp/SemEval2021Task4
공식 코드https://github.com/allenai/beacon
BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing
https://github.com/lavi-lab/cleva
C$^2$LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.