GDC is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

View, browse and sort the ever-growing list of sessions by pass type, topic, and format. All registered attendees will be able to build their personal schedule in the mobile event app, once live early 2022.

GDC Masterclass courses require a paid pass to attend. Class sizes are kept intentionally small and seats are limited to ensure every student receives one-on-one assistance from the instructor. Pass pricing per course varies, please review the passes and pricing page for more details and secure your spot today!

Future Realities Summit: Hands Best: How AR & VR Devs Can Make the Most of Hand Tracking

Brian Schwab  (Director of Interaction & Creative Play Lab, LEGO Group)

John Blau  (Game Designer, Schell Games)

Pass Type: All Access Pass, Summits Pass - Get your pass now!

Topic: VR/AR

Format: Session

Vault Recording: TBD

As the extended reality (XR) industry advances, features and resources that seek to close the gap between real-life interactions and simulations are available for developers to use. One such feature is hand tracking, allowing players to interact with a virtual reality experience without needing controllers.

Unlike controllers that generally use the same schema and button systems, hand tracking is not yet standardized and brings with it a number of interaction opportunities, myths, and challenges for input recognition.

Developers must consider many nuances when utilizing hand tracking technology. Covered in session will be common tracking methods, examples of interaction models (including hybrid interaction models that use hands in combination with other inputs), and a number of notable assumptions that must be cast aside.


This talk will provide an overview of hand-tracking methods, challenge a number of common myths and assumptions about hand tracking, and provide examples of interaction models that range from the realistic to the abstract.

Intended Audience

Game designers, engineers, and extended reality enthusiasts will benefit from this talk. Experience developing AR and VR experiences or experience with hand tracking is beneficial but not required.