Code Generation On Bigcodebench Complete

Pass@1

Results

Performance results of various models on this benchmark

Comparison Table

Model Name	Pass@1
bigcodebench-benchmarking-code-generation	59.7
bigcodebench-benchmarking-code-generation	61.1