HyperAI

Code Generation On Taco Code

Metrics

easy pass@1

Results

Performance results of various models on this benchmark

Comparison Table
Model Nameeasy pass@1
taco-topics-in-algorithmic-code-generation9.32%
taco-topics-in-algorithmic-code-generation11.6%
taco-topics-in-algorithmic-code-generation31.50%