HyperAIHyperAI

Command Palette

Search for a command to run...

Decomposed Forward Pass (DePass)

Date

9 hours ago

Organization

Tsinghua University
Shanghai Artificial Intelligence Laboratory

Paper URL

2510.18462

The Decomposed Forward Pass (DePass) was proposed by Tsinghua University and the Shanghai Artificial Intelligence Laboratory in November 2025, and the relevant research results were published in the paper "DePass: Unified Feature Attributing by Simple Decomposed Forward PassIt was selected for NeurIPS 2025.

DAVSP is a unified feature attribution framework based on a single decomposition forward pass. It decomposes each latent state into additive components, propagates these components to the remaining layers, and then obtains the precise contribution of each component to the target representation. In the post-decomposition forward pass, attention scores and MLP activations are fixed, and weighted contributions are assigned based on the decomposed components. Compared to other methods, DePass achieves more faithful attribution at different granularity levels.

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp