CalMS21 stands for Caltech Mouse Social Interactions, a multi-agent behavioral dataset for behavioral neuroscience. The dataset contains 6 million frames of unlabeled social images of mice and more than 1 million frames of social images of mice with frame-by-frame annotations. These data come from videos of mice in social interaction experiments. The CalMS21 dataset is part of the 2021 Multi-Agent Behavior Challenge.

For the study of behavioral neuroscience, the CalMS21 dataset provides a benchmark for evaluating the performance of automatic behavior classification methods in three situations:

• Classical behavioral classification
• Markup style transfer
• Learning new behaviors