3 days ago

NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale

NextStep Team, Chunrui Han, Guopeng Li, Jingwei Wu, Quan Sun, Yan Cai, Yuang Peng, Zheng Ge, Deyu Zhou, Haomiao Tang, Hongyu Zhou, Kenkun Liu, Ailin Huang, Bin Wang, Changxin Miao, Deshan Sun, En Yu, Fukun Yin, Gang Yu, Hao Nie, Haoran Lv, Hanpeng Hu, Jia Wang, Jian Zhou, Jianjian Sun, Kaijun Tan, Kang An, Kangheng Lin, Liang Zhao, Mei Chen, Peng Xing, Rui Wang, Shiyu Liu, Shutao Xia, Tianhao You, Wei Ji, Xianfang Zeng, Xin Han, Xuelin Zhang, Yana Wei, Yanming Xu, Yimin Jiang, Yingming Wang, Yu Zhou, Yucheng Han, Ziyang Meng, Binxing Jiao, Daxin Jiang, Xiangyu Zhang, Yibo Zhu

View Paper Details

NextStep-1: Toward Autoregressive Image Generation with Continuous
Tokens at Scale

Abstract

Prevailing autoregressive (AR) models for text-to-image generation eitherrely on heavy, computationally-intensive diffusion models to process continuousimage tokens, or employ vector quantization (VQ) to obtain discrete tokens withquantization loss. In this paper, we push the autoregressive paradigm forwardwith NextStep-1, a 14B autoregressive model paired with a 157M flow matchinghead, training on discrete text tokens and continuous image tokens withnext-token prediction objectives. NextStep-1 achieves state-of-the-artperformance for autoregressive models in text-to-image generation tasks,exhibiting strong capabilities in high-fidelity image synthesis. Furthermore,our method shows strong performance in image editing, highlighting the powerand versatility of our unified approach. To facilitate open research, we willrelease our code and models to the community.