Accuracy (%): 90.5
Papers with Code · CC BY-SA 4.0
Program Synthesis
Program synthesis is the process of automatically generating a program or code snippet that satisfies a given specification or set of requirements. This can include generating code from a formal specification, a natural language description, or example inputs and outputs. The primary goal of program synthesis is to minimize human intervention in the coding process, reduce errors, and improve productivity.
Program synthesis often involves the use of advanced algorithms, artificial intelligence, and machine learning techniques to search the space of possible programs that meet the given constraints. This process can be guided by a variety of techniques, such as constraint solving, symbolic execution, and genetic algorithms.
논문
Success rate @budget 100: 38.5
MRR: 98.7
Average Accuracy: 61.29Average Precision: 58.81Average Recall: 58.91Average F1: 58.86
Success rate @budget 100: 34.2
Average Accuracy: 57.52Average Precision: 54.18Average Recall: 54.02Average F1: 54.10
Average Accuracy: 61.72Average Precision: 59.34Average Recall: 59.80Average F1: 59.57
Accuracy: 90.31
Accuracy@5: 84.60
Average Success Rate: 26.6
Pass@1: 97.6
Average Accuracy: 62.51Average Precision: 60.06Average Recall: 61.08Average F1: 60.57
Average Accuracy: 71.27
Average Accuracy: 63.42
Average Accuracy: 59.84Average Precision: 57.45Average Recall: 57.62Average F1: 57.54
Average Success Rate: 45.3
Exact Match: 49,3Error Removal: 67,8