Algorithmic: 60.78Average: 69.01Control: 71.10API: 75.16
Papers with Code · CC BY-SA 4.0
Code Completion
논문
EM (line-level): 37.90Edit Sim (line-level): 72.25
Accuracy (token-level): 77.13EM (line-level): 26.43Edit Sim (line-level): 63.03
Compilation Rate: 73.03
Correctness, max., %: 42Correctness, avg., %: 34Validness, avg., %: 69.1Validness, max., %: 76
Compilation Rate: 76.47Pass@1: 63.73BLEU: 66.29
Compilation Rate: 74.02Pass@1: 59.8BLEU: 63.52