NVIDIA, ComfyUI streamline local AI video at GDC
At the Game Developers Conference in San Francisco, NVIDIA announced a suite of updates designed to streamline local AI video generation for game developers and creators. The new tools leverage NVIDIA RTX GPUs and the DGX Spark desktop supercomputer to simplify concept development and storyboarding. A key focus of the announcement is the optimization of ComfyUI, a popular workflow platform. NVIDIA introduced a new App View interface for ComfyUI, which allows artists to generate content without needing to navigate complex node graphs. Users can now create workflows by simply entering a prompt and adjusting basic parameters while retaining the ability to switch to full Node View for advanced customization. This App View is fully compatible with RTX optimizations. Since September, performance for RTX GPUs has improved by 40%. With the introduction of native support for NVFP4 and FP8 data formats, ComfyUI now achieves a 2.5-fold performance increase and a 60% reduction in VRAM usage on NVIDIA GeForce RTX 50 Series GPUs. On FP8 hardware, performance is 1.7 times faster with a 40% VRAM reduction. Several models, including FLUX.2 Klein 4B and 9B, now support these formats directly within ComfyUI. To address the challenges of high-quality video output, NVIDIA integrated RTX Video Super Resolution as a node within ComfyUI. This tool enables users to quickly upscale generated video to 4K resolution. For developers, NVIDIA released a free Python package available via the PyPI repository, providing programmatic access to this upscaling technology. Powered by NVIDIA Tensor Cores, this solution delivers 4K upscaling 30 times faster than alternative local upscalers while significantly lowering VRAM requirements. The updates also highlighted improvements for other tools in the ecosystem. LTX Desktop, an open-source video editor, is now optimized for NVIDIA GPUs. LM Link connects separate devices running LM Studio, allowing models to run on remote machines like the DGX Spark as if they were local. Additionally, Top Labs collaborated with NVIDIA to optimize its NeuroStream technology, enabling complex AI models to run on consumer hardware through proprietary VRAM optimization. Microsoft also expanded support for VoiceMod, a voice quality application that uses Windows ML for GPU inference, outperforming CPU-based solutions. Looking ahead, NVIDIA plans to release overrides for DLSS 4.5 Dynamic Multi Frame Generation and Multi Frame Generation 6x Mode in an upcoming beta of the NVIDIA App for GeForce RTX 50 Series owners. Later in the year, an update to NVIDIA RTX Remix will introduce Advanced Particle VFX, empowering modders to create immersive visual effects. NVIDIA will also host a training session at the GTC conference in March titled Create Generative AI Workflow for Design and Visualization in ComfyUI, further assisting users in building RTX-accelerated workflows. These announcements collectively signal a significant push to make high-end AI video generation more accessible, efficient, and powerful for local creators.
