Code Generation On Taco Code
Metriken
easy pass@1
Ergebnisse
Leistungsergebnisse verschiedener Modelle zu diesem Benchmark
| Paper Title | ||
|---|---|---|
| GPT-4 | 31.50% | TACO: Topics in Algorithmic COde generation dataset |
| Starcoder-15.5B | 11.6% | TACO: Topics in Algorithmic COde generation dataset |
| CodeLlama-7B-Python | 9.32% | TACO: Topics in Algorithmic COde generation dataset |
0 of 3 row(s) selected.