CS-Eval is a large-scale network security capability evaluation set jointly established by Alibaba Security, Fudan University, and University of Chinese Academy of Sciences. The dataset covers 11 major network security fields, 42 sub-fields, 4,369 multiple-choice questions, true-or-false questions, and knowledge extraction questions, providing knowledge-based and practical comprehensive evaluation tasks, supporting user self-evaluation, and providing reference and inspiration for the implementation of large-scale network security.

Citation

@inproceedings{Yu2024CSEvalAC,
title={CS-Eval: A Comprehensive Large Language Model Benchmark for CyberSecurity},
author={Zhengmin Yu and Jiutian Zeng and Siyi Chen and Wenhan Xu and Dandan Xu and Xiangyu Liu and Zonghao Ying and Nan Wang and Yuan Zhang and Min Yang},
year={2024},
url={https://api.semanticscholar.org/CorpusID:274234403}
}