HyperAIHyperAI

Command Palette

Search for a command to run...

7 days ago

CamCloneMaster: Enabling Reference-based Camera Control for Video Generation

Yawen Luo Jianhong Bai Xiaoyu Shi Menghan Xia Xintao Wang Pengfei Wan Di Zhang Kun Gai Tianfan Xue

CamCloneMaster: Enabling Reference-based Camera Control for Video Generation

Abstract

Camera control is crucial for generating expressive and cinematic videos. Existing methods rely on explicit sequences of camera parameters as control conditions, which can be cumbersome for users to construct, particularly for intricate camera movements. To provide a more intuitive camera control method, we propose CamCloneMaster, a framework that enables users to replicate camera movements from reference videos without requiring camera parameters or test-time fine-tuning. CamCloneMaster seamlessly supports reference-based camera control for both Image-to-Video and Video-to-Video tasks within a unified framework. Furthermore, we present the Camera Clone Dataset, a large-scale synthetic dataset designed for camera clone learning, encompassing diverse scenes, subjects, and camera movements. Extensive experiments and user studies demonstrate that CamCloneMaster outperforms existing methods in terms of both camera controllability and visual quality.

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
CamCloneMaster: Enabling Reference-based Camera Control for Video Generation | Papers | HyperAI