HyperAIHyperAI초신경
홈뉴스최신 연구 논문튜토리얼데이터셋백과사전SOTALLM 모델GPU 랭킹컨퍼런스
전체 검색
소개
HyperAIHyperAI초신경

Code Generation On Res Q

평가 지표

pass@1

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름
pass@1
Paper TitleRepository
QurrentOS-coder + Gemini 1.5 Pro30.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + Claude 3.5 Sonnet58.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + Llama 3 70b20.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + Qwen-72B-Instruct18.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + GPT-430.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + Claude 3 Opus36.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + GPT-4o46.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + DeepSeek-Coder-V229.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
QurrentOS-coder + GPT-4 Turbo37.0RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale-
0 of 9 row(s) selected.
Code Generation On Res Q | SOTA | HyperAI초신경