GDC 2024 Session Viewer

What’s better than starting a day full of awesome content in the Machine Learning Summit? Chairs of the summit will introduce the day with a short glance at Machine Learning impact and how it's helping us all creating better games. Each day covers themes that will be explained before heading straight to impactful initiatives!

-------------------------------

We present a novel neural material compression technique that is designed to take advantage of hardware accelerated texture compression formats. This approach leans on a multiresolution set of block compressed (BC6H) textures that is subsequently decoded by a small neural network. In practice, our method is integrated into the current pipelines in two stages. At production stage, we use deep learning to jointly learn the texture set and the decoder network. At runtime, we sample the learned textures and then reconstruct the material information by inferring neural network in a shader.

Takeaway

Attendees will be exposed to the emerging field of neural rendering. This talk will present an example on how neural rendering can benefit the storage of PBR materials and offers insights on how to integrate the inference of neural networks in a real-time rendering pipeline.

Intended Audience

3D programmers, engineers and tech artists interested in real-time neural rendering techniques and their integration in game engines