Logical Reasoning On Big Bench Penguins In A
Metrics
Accuracy
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Accuracy |
|---|---|
| bloomberggpt-a-large-language-model-for | 33.56 |
| scaling-language-models-methods-analysis-1 | 40.6 |
| bloomberggpt-a-large-language-model-for | 28.08 |
| palm-2-technical-report-1 | 84.9 |
| bloomberggpt-a-large-language-model-for | 40.41 |
| palm-2-technical-report-1 | 65.8 |
| bloomberggpt-a-large-language-model-for | 37.67 |
| training-compute-optimal-large-language | 48.7 |
| bloomberggpt-a-large-language-model-for | 44.5 |