CIDRe: A Reference-Free Multi-Aspect Criterion for Code Comment Quality Measurement
원문 초록
Effective generation of structured code comments requires robust quality metrics for dataset curation, yet existing approaches (SIDE, MIDQ, STASIS) suffer from limited code-comment analysis. We propose CIDRe, a language-agnostic reference-free quality criterion combining four synergistic aspects: (1) relevance (code-comment semantic alignment), (2) informativeness (functional coverage), (3) completeness (presence of all structure sections), and (4) description length (detail sufficiency). We validate our criterion on a manually annotated dataset. Experiments demonstrate CIDRe's superiority over existing metrics, achieving improvement in cross-entropy evaluation. When applied to filter comments, the models finetuned on CIDRe-filtered data show statistically significant quality gains in GPT-4o-mini assessments.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Multi-Preference Lambda-weighted Listwise DPO for Dynamic Preference Alignment
CuRe: Cultural Gaps in the Long Tail of Text-to-Image Systems
ERU-KG: Efficient Reference-aligned Unsupervised Keyphrase Generation
Power-Law Decay Loss for Large Language Model Finetuning: Focusing on Information Sparsity to Enhance Generation Quality
ICYM2I: The illusion of multimodal informativeness under missingness
Laplace Sample Information: Data Informativeness Through a Bayesian Lens
토론
이 논문과 연결된 포럼 글이 아직 없습니다.