Game Developers Conference (GDC) is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

F.A.C.U.L.: The First FPS AI Companion Who Understands Human Language

Elvis Liu  (Principal Engineer, Tencent Games)

Location: Room 2016, West Hall

Date: Friday, March 21

Time: 1:30 pm - 2:30 pm

Pass Type: All Access Pass, Core Pass - Get your pass now!

Track: Programming

Format: Lecture

Vault Recording: TBD

Audience Level: All

Arena Breakout is the world's first FPS game that allows players to interact with AI companions through natural language. Traditionally, FPS restricts human-AI communication to simple commands like `attack' and `follow' due to the limitations of existing input methods such as hotkeys and command wheels. These commands lack specificity, hindering players from giving complex instructions like `clear the second floor' or `take cover behind that tree'. Arena Breakout enables players to interact with an AI companion called F.A.C.U.L. using natural language. F.A.C.U.L. can understand complex instructions, provide feedback, and perform a series of tasks. Moreover, it can identify thousands of in-game objects, including buildings, vehicles, and collectable items, and accurately distinguish between different colors and materials. This revolutionary feature integrates advanced generative AI technologies, including voice input, large language models, real-time text-to-speech, and image description, creating the most immersive experience for players and allowing them to work with human-like AI.

Takeaway

Attendees learn about the principles and practice of employing generative AI technologies to create an FPS AI companion who understands human language.

Intended Audience

This lecture is for game AI programmers and those who are interested in game AI and generative AI technologies. It would be helpful to have basic knowledge of large language models, text-to-speech, and image descriptions, but they are not required.



Connecting the Global Game Development Community