GDC is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

View, browse and sort the ever-growing list of sessions by pass type, topic, and format. With this Session Scheduler, you can build your schedule in advance and access it during the show via export or with the GDC Mobile App, once live. Sessions do fill up so please arrive early to sessions that you would like to attend. Adding a session to your schedule does not guarantee you a seat.

Programming Natural Hand Interactions in Spatial Computing

Kathryn Scelina (Software Engineer, Magic Leap)

Pass Type: All Access Pass, Core+Summits Pass, Core Pass - Get your pass now!

Topic: Programming

Format: Session

Vault Recording: TBD

Audience Level: All

The hand tracking and gesture recognition provided by spatial computing devices enable developers to design and program interactions people can experience without the use of controllers. I will discuss how the raw hand tracking data received influences design and the ways in which the data is used to create smooth, intuitive interactions. By utilizing the multiple key points on the hand, users can tailor their experience to fit their comfort and expectations. Hands are one of our primary tools to interact with the tangible objects, now we can use them to connect to digital content displayed in the physical world.


Creating spatial content which heavily utilizes hand tracking is a new area for developers. Attendees will learn about the challenges related to using hand tracking data and gesture recognition. The design and programming decisions made to create intuitive interactions to keep players engaged with the story will be shared.

Intended Audience

This presentation is intended for people who are interested in learning about using hand tracking as the primary method of interaction in a spatial computing experience. A brief explanation of spatial computing will be given, no prerequisite knowledge is necessary.