Fin-Eva Version 1.0 Chinese Language Professional Data Evaluation Set in the Financial Field

Ant Group and Shanghai University of Finance and Economics jointly launched the financial assessment suite Fin-Eva Version 1.0, covering multiple financial scenarios such as wealth management, insurance, investment research, and launching financial professional thematic subjects. The total number of financial questions reaches more than 13,000.

Ant data sources include data from various business data areas and public Internet data. After data desensitization, text question and answer, corpus screening, data rewriting and other processing processes, they are constructed in combination with the review of experts in the financial field. The requirements for the knowledge outline of various real questions and simulation questions of authoritative examinations in related fields are led by the research team of Associate Professor Zhang Liwen of the School of Statistics and Management of Shanghai University of Finance and Economics, assisted by Associate Professor Min Min of the School of Finance and other teachers from various colleges. All data series are original, which ensures the accuracy and authority of the data source.

The Ant section covers five major capabilities, namely financial cognition, financial knowledge, financial logic, content generation, and security and compliance, with 33 sub-dimensions and a total of 8,445 assessment questions; the Shanghai Finance section covers four major areas, namely finance, economics, accounting, and certificates, including 4,661 questions and covering 34 different disciplines.

Fin-Eva Version 1.0 uses multiple-choice questions with fixed answers, and uses corresponding instructions to let the model output in a standard format. Currently, Fin-Eva Version 1.0 opens its evaluation data to the public, and will continue to iterate and open platform-based evaluation hosting services in the future to provide a one-stop evaluation for the industry.