GDC 2025 Session Viewer
F.A.C.U.L.: The First FPS AI Companion Who Understands Human Language
Elvis Liu (Principal Engineer, Tencent Games)
Location: Room 2016, West Hall
Date: Friday, March 21
Time: 1:30 pm - 2:30 pm
Pass Type: All Access Pass, Core Pass - Get your pass now!
Track: Programming
Format: Lecture
Vault Recording: TBD
Audience Level: All
Arena Breakout is the world's first FPS game that allows players to interact with AI companions through natural language. Traditionally, FPS restricts human-AI communication to simple commands like `attack' and `follow' due to the limitations of existing input methods such as hotkeys and command wheels. These commands lack specificity, hindering players from giving complex instructions like `clear the second floor' or `take cover behind that tree'. Arena Breakout enables players to interact with an AI companion called F.A.C.U.L. using natural language. F.A.C.U.L. can understand complex instructions, provide feedback, and perform a series of tasks. Moreover, it can identify thousands of in-game objects, including buildings, vehicles, and collectable items, and accurately distinguish between different colors and materials. This revolutionary feature integrates advanced generative AI technologies, including voice input, large language models, real-time text-to-speech, and image description, creating the most immersive experience for players and allowing them to work with human-like AI.
Takeaway
Attendees learn about the principles and practice of employing generative AI technologies to create an FPS AI companion who understands human language.
Intended Audience
This lecture is for game AI programmers and those who are interested in game AI and generative AI technologies. It would be helpful to have basic knowledge of large language models, text-to-speech, and image descriptions, but they are not required.