GDC Festival of Gaming is part of the Informa Festivals Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

March 1-4, 2027
Moscone CenterSan Francisco, CA

Agenda

Lipsync for Any Budget: Achieving High-Quality Low-Cost Speech Animation with Small Teams

Mira Mechtley  (Principal Engineer, Dinogod)
Pass Type: Academic Pass, Festival Pass, Game Changer Pass, Indie Pass, Start-Up Pass - Get your pass now!
Track: Programming, Independent Development
Audience Level: Intermediate
Format: Lecture
Vault Recording: TBD
Audience Level: Intermediate
I'll review common methods for syncing mouth / facial animations to voice actor audio and the benefits and disadvantages of each. I will then present a method I developed for Dinogod's 2025 release Bounty Star by pre-baking lipsync data with Meta's wav2vec2-xlsr transcription model and discuss how this method produces high-quality output with minimal labor cost and free software, making it accessible even for small teams like ours.

Takeaway

Attendees will leave with knowledge of a free software, low-labor method for generating and using high-quality lipsync data suitable for projects at all scales, but particularly indie and AA games where using facial motion capture data is unmanageable or cost prohibitive.

Intended Audience

Are you interested in animating voice-acted character speech in a high-quality and realistic way, but worry it's too costly or labor-intensive for your small team? Worry no more! Attendees are expected to be engineers or members of other disciplines who are comfortable with technical details of animation and engineering.