HyperAIHyperAI

Command Palette

Search for a command to run...

GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras

Ye Yuan Umar Iqbal Pavlo Molchanov Kris Kitani Jan Kautz

Abstract

We present an approach for 3D global human mesh recovery from monocularvideos recorded with dynamic cameras. Our approach is robust to severe andlong-term occlusions and tracks human bodies even when they go outside thecamera's field of view. To achieve this, we first propose a deep generativemotion infiller, which autoregressively infills the body motions of occludedhumans based on visible motions. Additionally, in contrast to prior work, ourapproach reconstructs human meshes in consistent global coordinates even withdynamic cameras. Since the joint reconstruction of human motions and cameraposes is underconstrained, we propose a global trajectory predictor thatgenerates global human trajectories based on local body movements. Using thepredicted trajectories as anchors, we present a global optimization frameworkthat refines the predicted trajectories and optimizes the camera poses to matchthe video evidence such as 2D keypoints. Experiments on challenging indoor andin-the-wild datasets with dynamic cameras demonstrate that the proposedapproach outperforms prior methods significantly in terms of motion infillingand global mesh recovery.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras | Papers | HyperAI