Papers with Code 아카이브
nlg evaluation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
Evaluate the generated text by NLG (Natural Language Generation) systems, like large language models
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Beyond One-Size-Fits-All: Inversion Learning for Highly Effective NLG Evaluation Prompts
DeepSeek vs. o3-mini: How Well can Reasoning LLMs Evaluate MT and Summarization?
OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs
Exploring the Multilingual NLG Evaluation Abilities of LLM-Based Evaluators
SAGEval: The frontiers of Satisfactory Agent based NLG Evaluation for reference-free open-ended text
Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checking
Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation
Large Language Models Are Active Critics in NLG Evaluation
DHP Benchmark: Are LLMs Good NLG Evaluators?
ReFeR: Improving Evaluation and Reasoning through Hierarchy of Models
Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation
Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling
Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models
DEBATE: Devil's Advocate-Based Assessment and Text Evaluation
WaterJudge: Quality-Detection Trade-off when Watermarking Large Language Models
Are LLM-based Evaluators Confusing NLG Quality Criteria?
One Prompt To Rule Them All: LLMs for Opinion Summary Evaluation
LLM-based NLG Evaluation: Current Status and Challenges
The Pitfalls of Defining Hallucination
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges
LUNA: A Framework for Language Understanding and Naturalness Assessment
CoAScore: Chain-of-Aspects Prompting for NLG Evaluation
X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects
Towards Multiple References Era -- Addressing Data Leakage and Limited Reference Diversity in NLG Evaluation
LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models
DecompEval: Evaluating Generated Texts as Unsupervised Decomposed Question Answering
Rethinking Model Evaluation as Narrowing the Socio-Technical Gap
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory
Dolphin: A Challenging and Diverse Benchmark for Arabic NLG
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist
G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
Is ChatGPT a Good NLG Evaluator? A Preliminary Study
Describe me an Aucklet: Generating Grounded Perceptual Category Descriptions
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.