Logical Reasoning On Big Bench Formal
Metrics
Accuracy
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Accuracy |
|---|---|
| scaling-language-models-methods-analysis-1 | 50.7 |
| bloomberggpt-a-large-language-model-for | 53.6 |
| bloomberggpt-a-large-language-model-for | 52.8 |
| bloomberggpt-a-large-language-model-for | 54 |
| palm-2-technical-report-1 | 64.8 |
| bloomberggpt-a-large-language-model-for | 52.8 |
| training-compute-optimal-large-language | 52.1 |
| bloomberggpt-a-large-language-model-for | 50.8 |
| palm-2-technical-report-1 | 57.2 |