Daring-Anteater is an instruction-tuning comprehensive dataset released by NVIDIA in 2024. Its associated paper can be found at 「HelpSteer2: Open-source dataset for training top-performing reward models, aimed at promoting reproducibility and training high-performance reward models.

The dataset comprises approximately 95,000 samples, most of which were synthetically generated using NVIDIA's proprietary model and Mixtral-8x7B-Instruct-v0.1. The remainder originate from commercial-friendly subsets of FinQA, WikitableQuestions, and Open-Platypus. It covers a wide range of tasks and scenarios, primarily intended for supervised fine-tuning (SFT) followed by preference alignment. Licensed under CC-BY-4.0, it supports commercial use.

Dataset Composition

This dataset includes four main fields:

• conversations: Turns between user and assistant
• mask: Turns excluded from loss calculation (default is "User")
• system: System prompt
• dataset: Source data origin

The dataset consists of the following subsets:

• synthetic_conv: 82,450 samples
• synthetic_roleplay: 2,996 samples
• synthetic_math: 3,000 samples
• synthetic_precise_instruction_following: 1,500 samples
• synthetic_json_format_following: 1,499 samples
• synthetic_complex_instruction: 1,500 samples
• open_platypus_commercial: 6,000 samples
• FinQA: 300 samples
• WikitableQuestions: 287 samples

Citation

@misc{wang2024helpsteer2,
      title={HelpSteer2: Open-source dataset for training top-performing reward models}, 
      author={Zhilin Wang and Yi Dong and Olivier Delalleau and Jiaqi Zeng and Gerald Shen and Daniel Egert and Jimmy J. Zhang and Makesh Narsimhan Sreedhar and Oleksii Kuchaiev},
      year={2024},
      eprint={2406.08673},
      archivePrefix={arXiv},
      primaryClass={id='cs.CL' full_name='Computation and Language' is_active=True alt_name='cmp-lg' in_archive='cs' is_general=False description='Covers natural language processing. Roughly includes material in ACM Subject Class I.2.7. Note that work on artificial languages (programming languages, logics, formal systems) that does not explicitly address natural-language issues broadly construed (natural-language processing, computational linguistics, speech, text retrieval, etc.) is not appropriate for this area.'}
}