Apps
평가 지표
llm_model
model_url
organization
parameters
release_date
strict accuracy-average
strict accuracy-competitive
strict accuracy-interview
strict accuracy-introductory
test case average-average
test case average-competitive
test case average-interview
test case average-introductory
updated_time
평가 결과
이 벤치마크에서 각 모델의 성능 결과
비교 표
| 모델 이름 | llm_model | model_url | organization | parameters | release_date | strict accuracy-average | strict accuracy-competitive | strict accuracy-interview | strict accuracy-introductory | test case average-average | test case average-competitive | test case average-interview | test case average-introductory | updated_time |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 모델 1 | GPT-2 0.1B | https://huggingface.co/transformers/v3.0.2/model_doc/gpt2.html | OpenAI | 0.1B | 2019.2.14 | 0.40 | 0.00 | 0.33 | 1.00 | 6.16 | 4.37 | 6.93 | 5.64 | 2021.11.8 |