GDC + VRDC 2019 Session Scheduler

View, browse and sort the ever-growing list of sessions by pass type, track, and format. With this Session Scheduler, you can build your schedule in advance and access it during the show via export or with the GDC Mobile App, once live. Sessions do fill up so please arrive early to sessions that you would like to attend. Adding a session to your schedule does not guarantee you a seat.

Enhanced Immersivity: Using Speech Recognition for More Natural Player AI Interactions

Gautier Boeda (AI Engineer, Square Enix Co., Ltd.)

Pass Type: All Access, VRDC Add On - Get your pass now!

Topic: Entertainment VR/AR

Format: Session

Vault Recording: TBD

Audience Level: All

When entering a virtual world, users expect an experience that feels natural. Huge progress has been made with regards to motion, vision, physical interactivity, whereas interactivity with non-playable character stays behind. This session introduces a speech recognition pipeline with the solutions to some obstacles that have been encountered during its development. It will also cover speech related interactions and spatial representation based interactions to bring more immersivity to VR.


Attendees will walk away with a method to promote further interactivity between the user and the agents. They will learn to make a voice recognition system, which supports multiple languages while allowing a large variety of phrasing. At last, they will walk back with some methods to improve interactions based on speech and spatial representation.

Intended Audience

Anyone curious about interactive AIs, especially in virtual reality, and anyone with an interest in voice recognition system, and its related-interactions.