HyperAIHyperAI
2 months ago

MotionPCM: Real-Time Motion Synthesis with Phased Consistency Model

Jiang, Lei ; Wei, Ye ; Ni, Hao
MotionPCM: Real-Time Motion Synthesis with Phased Consistency Model
Abstract

Diffusion models have become a popular choice for human motion synthesis dueto their powerful generative capabilities. However, their high computationalcomplexity and large sampling steps pose challenges for real-time applications.Fortunately, the Consistency Model (CM) provides a solution to greatly reducethe number of sampling steps from hundreds to a few, typically fewer than four,significantly accelerating the synthesis of diffusion models. However, applyingCM to text-conditioned human motion synthesis in latent space yieldsunsatisfactory generation results. In this paper, we introduce\textbf{MotionPCM}, a phased consistency model-based approach designed toimprove the quality and efficiency for real-time motion synthesis in latentspace. Experimental results on the HumanML3D dataset show that our modelachieves real-time inference at over 30 frames per second in a single samplingstep while outperforming the previous state-of-the-art with a 38.9\%improvement in FID. The code will be available for reproduction.

MotionPCM: Real-Time Motion Synthesis with Phased Consistency Model | Latest Papers | HyperAI