Code Generation On Taco Code

评估指标

easy pass@1

评测结果

各个模型在此基准测试上的表现结果

模型名称
easy pass@1
Paper TitleRepository
CodeLlama-7B-Python9.32%TACO: Topics in Algorithmic COde generation dataset-
Starcoder-15.5B11.6%TACO: Topics in Algorithmic COde generation dataset-
GPT-431.50%TACO: Topics in Algorithmic COde generation dataset-
0 of 3 row(s) selected.