https://github.com/qunhualilab/llm-ds-reproducibility
공식 코드An Analyst-Inspector Framework for Evaluating Reproducibility of LLMs in Data Science
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Code Generation is an important field to predict explicit code or program structure from multimodal data sources such as incomplete code, programs in another programming language, natural language descriptions or execution examples. Code Generation tools can assist the development of automatic programming tools to improve programming productivity.
Source: Deep Learning for Source Code Modeling and Generation
Image source: Measuring Coding Challenge Competence With APPS
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
An Analyst-Inspector Framework for Evaluating Reproducibility of LLMs in Data Science
RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale
Analyzing the Performance of Large Language Models on Code Summarization
JuICe: A Large Scale Distantly Supervised Dataset for Open Domain Context-based Code Generation
Execution-based Code Generation using Deep Reinforcement Learning
CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Models
StructCoder: Structure-Aware Transformer for Code Generation
BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models
Automatically Testing Functional Properties of Code Translation Models
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation
Program Synthesis and Semantic Parsing with Learned Code Idioms
Are Sparse Autoencoders Useful for Java Function Bug Detection?
Are Human-generated Demonstrations Necessary for In-context Learning?
HyGenar: An LLM-Driven Hybrid Genetic Algorithm for Few-Shot Grammar Generation
Large Language Models in Computer Science Education: A Systematic Literature Review
SteloCoder: a Decoder-Only LLM for Multi-Language to Python Code Translation
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
NatGen: Generative pre-training by "Naturalizing" source code
CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning
CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.