GDC + VRDC 2019 Session Scheduler

View, browse and sort the ever-growing list of sessions by pass type, track, and format. With this Session Scheduler, you can build your schedule in advance and access it during the show via export or with the GDC Mobile App, once live. Sessions do fill up so please arrive early to sessions that you would like to attend. Adding a session to your schedule does not guarantee you a seat.

A New Era of Performance Capture with Machine Learning

Daniel Holden (Animation Researcher, Ubisoft Montreal)

Pass Type: All Access, GDC Conference + Summits, GDC Conference - Get your pass now!

Topic: Programming

Format: Session

Vault Recording: TBD

Audience Level: Intermediate

The field of performance capture is quickly changing, with machine learning and large amounts of data making it possible to build performance capture technology that is more powerful and accessible than ever before. Yet, these advancements have also brought their own new and unique challenges. In this talk, Daniel Holden will dig into the details of several new performance capture technologies developed at Ubisoft La Forge, including a neural network used to automatically clean motion capture data, an end-to-end solution for capture of facial animation from video, and a machine learning solution which can generate facial animation from raw audio.


Attendees will learn about the technical details, potential benefits, and practical challenges of a number of machine learning based performance capture technologies.

Intended Audience

This presentation is appropriate for anyone with an interest in performance capture technology, animation, or machine learning, as well as producers, technical directors, or artists who are curious about how these technological shifts are affecting the industry.