CharacterGen Generates High-quality 3D Characters From a Single Image

Tutorial Introduction

This tutorial is a one-click run demo of CharacterGen. The relevant environment and dependencies have been installed. You can experience it by cloning and starting it with one click.

CharacterGen takes a single input image and generates a 3D posed unified character mesh with high quality and consistent appearance, which can be directly used in downstream rigging and animation workflows. CharacterGen has also been included in SIGGRAPH2024.

Effect display

Running method (it takes about 15 seconds to initialize after starting the container, and then perform the following operations)

1. After cloning and starting the container, open the terminal and enter the command . setup.sh

The effect after successful execution is shown in the figure below

If you encounter the error shown below, it may be because setup.sh If the script does not run successfully, the user only needs to open a new terminal and/openbayes/home Re-enter the command in the directory. setup.sh, wait for the relevant dependencies to be installed successfully and then proceed to the next steps

2. In the current terminal (i.e./openbayes/home/CharacterGen Working directory) Continue to enter commands python webui.py After the model configuration is completed and port 8080 appears, click the link at the API address on the right to enter the model demo interface.

3. After entering the demo page, you can choose to generate 2D or 3D images as needed, and you can also adjust the parameters as needed.

If you need to generate a 3D image, you need to generate 2D front, back, left and right images first and then click "generate 3D mesh" to generate the 3D image, otherwise an error will be reported!

Discussion and Exchange

🖌️ If you see a high-quality project, please leave a message in the background to recommend it! In addition, we have also established a tutorial exchange group. Welcome friends to scan the QR code and remark [Tutorial Exchange] to join the group to discuss various technical issues and share application effects↓