HyperAIHyperAI

Command Palette

Search for a command to run...

Soup of Category Experts

Date

9 hours ago

Organization

Meta

Paper URL

2511.13254

Soup of Category Experts (SoCE) was proposed by a research team from Meta and University College London in November 2025, and the relevant research results were published in the paper "Souper-Model: How Simple Arithmetic Unlocks State-of-the-Art LLM Performance".

SoCE is a benchmark-based model optimization method that identifies optimal model candidates by combining benchmark tasks and uses a non-uniformly weighted average to maximize overall performance. Unlike traditional methods that use uniform weights, SoCE is based on a key observation: different benchmark categories often have low correlation in model performance. Therefore, SoCE first identifies "expert" models for each weakly correlated category cluster, and then integrates them by optimizing the weights rather than uniform weights.

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp