https://github.com/sparksofagi/mhpp
공식 코드MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Code Generation is an important field to predict explicit code or program structure from multimodal data sources such as incomplete code, programs in another programming language, natural language descriptions or execution examples. Code Generation tools can assist the development of automatic programming tools to improve programming productivity.
Source: Deep Learning for Source Code Modeling and Generation
Image source: Measuring Coding Challenge Competence With APPS
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation
Code Generation for Machine Learning using Model-Driven Engineering and SysML
MAGE: A Multi-Agent Engine for Automated RTL Code Generation
PRO-V: An Efficient Program Generation Multi-Agent System for Automatic RTL Verification
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Policy Filtration in RLHF to Fine-Tune LLM for Code Generation
SymForce: Symbolic Computation and Code Generation for Robotics
RustEvo^2: An Evolving Benchmark for API Evolution in LLM-based Rust Code Generation
TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation
GIS Copilot: Towards an Autonomous GIS Agent for Spatial Analysis
IndicEval-XL: Bridging Linguistic Diversity in Code Generation Across Indic Languages
ICE-Score: Instructing Large Language Models to Evaluate Code
ICE-Score: Instructing Large Language Models to Evaluate Code
Text2App: A Framework for Creating Android Apps from Text Descriptions
Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models
A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capability
ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generation
DebugBench: Evaluating Debugging Capability of Large Language Models
MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization
TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language Models
pix2code: Generating Code from a Graphical User Interface Screenshot
CLEVER: A Curated Benchmark for Formally Verified Code Generation
CLEVER: A Curated Benchmark for Formally Verified Code Generation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.