GDC is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

View, browse and sort the ever-growing list of sessions by pass type, topic, format and viewing experience. Use the experience filter to view sessions and roundtables that will be available on the virtual GDC event platform. Virtual sessions will be available to watch on-demand through April 1st, 2022 at 5pm PT. All days/times are displayed in Pacific Time.

Use the Viewing Experience filter to see which sessions will be available on-site, on the virtual platform, or both:

  • In-Person: offered on-site, not available within the virtual platform. Check the session’s listing to see if it will be recorded for GDC Vault after the conference.
  • Virtual: offered in the virtual platform at its scheduled time.
  • In-Person/Virtual: offered onsite and the recording will be available to watch-on-demand within 36 hours of the session start time on the virtual platform until April 1st at 5pm PT
  • In-Person/Virtual Livestream: offered on-site and will be livestreamed to watch on the virtual platform at its scheduled time. The recording of the video will be available to watch-on-demand within 36 hours of the session start time on the virtual platform until April 1st at 5pm PT.

All registered attendees will be able to build their personal schedule in the virtual GDC event platform and mobile app. Download the Informa Tech Events app to gain access to the Game Developers Conference 2022 virtually. Login with the email address you used to register.

Machine Learning Summit: Emotional Neural Style Transfer: Expressing Character AI Emotion through Paintings

Edgar Handy  (Machine Learning Engineer, SQUARE ENIX CO., LTD, AI Division)

Location: Room 2006, West Hall

Date: Tuesday, March 22

Time: 4:40 pm - 5:10 pm

Pass Type: All Access Pass, Summits Pass, All Access Online Only Pass - Get your pass now!

Topic: Programming

Format: Session

Viewing Experience: In-Person/Virtual Livestream

Vault Recording: Video

Audience Level: No

Recently machine learning has been applied mostly for asset creations. We take a new step on applying machine learning in game AI to transform the way a character AI expresses its emotion, which generally has been limited to facial expression, body gesture, and vocal intonation. In particular, we adopted neural style transfer that visualizes the AI’s feeling. The session covers how the emotion controls the style transfer, the in-depth explanation of the style transfer model, and how it is implemented in the game. The character AI documents what it sees along its journey in the form of painting and uses style transfer to visualize its feeling to the player, allowing a new kind of player-AI interaction in the game. The character can also use style blending and region masking to focus on a particular aspect of the paintings according to its interests.

Takeaway

The attendees are presented a technical detail of an experiment to extend emotional expression of character AI. The attendees will gain understanding how the combination of emotional component and style transfer works, the detail of style transfer model, and its implementation.

Intended Audience

The session is intended for AI/Gameplay programmers and Game Designers that are interested in the application and implementation of neural style transfer in game AI and human-AI interaction. Basic understanding of machine learning is useful.