HyperAI
HomeNewsLatest PapersTutorialsDatasetsEventsWikiSOTALLM Models
Search
About
HyperAI

Run Open-Sora-Plan Demo Online

Run this Tutorial Online

Model Introduction

Open-Sora-Plan is an open source project that aims to reproduce OpenAI's Sora (T2V model) and build knowledge about Video-VQVAE (VideoGPT) + DiT. The project was jointly initiated by Peking University and Tuzhan Intelligence Company, and the research significantly enhanced the quality of video generation and the ability to control text. The model is able to generate 10 seconds, 24FPS 1024×1024 HD video, and also supports the generation of high-resolution images, providing users with a richer and more sophisticated visual experience.

2

How to run

1. Open a new terminal page

2. Enter the following command to install the dependent environment

cd Open-Sora-Plan
pip install diffusers==0.27.2 gradio==4.0.0 einops omegaconf==2.1.1 pytorch_lightning==2.2.1 sentencepiece transformers==4.39.1 accelerate==0.28.0

3. Enter the following command to run Gradio demo

python -m opensora.serve.gradio_web_server

4. Open the "API Address" on the right. If you don't have real-name authentication, you need to do it first.