Generative AI: The Future of game asset creation at GDC 2023

At Game Developers Conference 2023 (3/20-24), Oracle Cloud Infrastructure (OCI) with NVIDIA presents our latest technologies for game developers. OCI is proud to showcase a new product demo of Stable Diffusion for game content creation using popular user interfaces and the 3D modeling tool Blender. NVIDIA will feature Live Portrait, a cutting–edge AI technology that animates a 2D photo or stylized portrait from a person’s live video feed or recorded video clips, accelerating developers’ 3D animation workflows.

OCI’s demo of Stable Diffusion is powered by NVIDIA A10 Tensor Core GPUs in the Oracle cloud. Stable Diffusion, an innovative deep learning model released in 2022, has been primarily used for generating detailed images based on text descriptions. However, its capabilities extend to creating game textures, models, depthmaps, skins, and other game content. Diffusion models can even be utilized for other modalities, enabling tasks as diverse as music generation.

Stable Diffusion is a latent diffusion model. Diffusion models are a type of deep generative neural network developed by the CompVis group at LMU Munich. Diffusion models can learn the distribution of data and generate new samples. Stable Diffusion is a scalable solution that developers use for both small- and large-scale game development and artistic projects.

OCI at GDC 2023

At Game Developers Conference (GDC) 2023, Oracle is showcasing the powerful combination of Stable Diffusion, its ecosystem, and Blender for game content creation on OCI. OCI is the best choice for running Stable Diffusion and other generative AI workloads because it provides the most high-performance, scalable, and secure NVIDIA platform consisting of GPU infrastructure and AI software that can handle the complex requirements of generative AI models.

^{Figure 1: Using Stable Diffusion with Controlnet for logo generation}

Our product demo highlights the ease and efficiency with which game developers can create high-quality game assets using OCI, Stable Diffusion and Blender. Stable Diffusion can be trained on a studio’s existing assets and further customized to generate unique game content quickly and easily, reducing the time required to create concepts and game assets that match existing game art. The combination of Stable Diffusion and Blender allows artists to create high-quality game assets with complete control over the creative process, while benefitting from quicker creative iterations. Artists can further train Stable Diffusion on their individual styles and develop complete workflows that allow for greater creative freedom and flexibility in game development.

^{Figure 2: Using Stable Diffusion for generative AI with Blender and Dream Textures}

The product demo also highlights the scalability of Stable Diffusion and its ability to handle both small- and large-scale game development projects. We showcase the ability to build Stable Diffusion clusters, allowing near-linear scaling in performance as compute increases. Game developers can use Stable Diffusion to generate high-quality game content quickly and efficiently, regardless of the size of their project.

Oracle’s product demo of Stable Diffusion for game content creation using Blender on OCI is a significant development in the gaming industry. The combination of Stable Diffusion and Blender provides game developers with a powerful tool for creating high-quality game assets quickly and efficiently. OCI is the best choice for running Stable Diffusion and other generative AI workloads because it provides a high-performance, scalable, and secure GPU powered infrastructure that can handle the complex requirements of deep learning models. We look forward to seeing the innovative game content that emerges from this exciting technology.

NVIDIA Live Portrait is part of the NVIDIA Omniverse Avatar Cloud Engine (ACE) suite of AI microservices. Omniverse ACE offers the fastest and most versatile solution for bringing interactive avatars to life at scale. Game developers could leverage ACE to seamlessly integrate NVIDIA AI into their applications, including NVIDIA Riva for creating expressive character voices using speech and translation AI, and Live Portrait or Omniverse Audio2Face for AI–powered 2D and 3D character animation.

Generative AI requires massively parallel systems for both training and inference. NVIDIA GPU instances in OCI provide game developers a high performance computing platform to run such applications as Live Portrait, Stable Diffusion and Blender. We look forward to seeing the innovative game content that emerges from generative AI.