GeneBench-Pro Public Package is a publicly available benchmark dataset for gene analysis released by OpenAI. Related research papers include... GeneBench-Pro: Evaluating Multistage Statistical Reasoning in Genomics, Quantitative Biology, and Translational BiomedicineIt aims to provide a reproducible research case study evaluation environment for artificial intelligence agents in the fields of genomics and biomedicine. This dataset contains 10 independent problem cases in the fields of genomics and bioinformatics, covering areas such as statistical genetics, clinical genomics, population genetics, single-cell analysis, three-dimensional genomics, and functional genomics. The data includes task descriptions, publicly available ground truth answers, grader contracts, and official technical reports.

Dataset fields:

• problems.csv: Problem summary index table
• manifest.json: Records the file path, SHA-256 checksum, and file size for each issue.
• checksums.sha256: Integrity verification information for the entire data packet.
• reference_grader.py: A reference grading script based on Python 3.10+
• reference_definitions.md: Definitions and semantic descriptions of rating fields
• problems_dir: Each problem has its own independent directory, containing eval_config.json (task text, list of data files, answer format specifications, reference answers and scoring rules), data_files/ (public input data), and report_public.pdf (public scientific case report).
• Answer/reasoning: Based on the ground_truth in eval_config.json and the requirements of grader.config, output the answer in the specified format, along with a brief description of the solution method and thought process.