ISUE

A work in progress, this demo showcases a full-body natural user interface for a game of football. The goal of the project is to develop a realistic interface that fully immerses the player and allows control of every aspect of the game. Shown here is the mechanism for controlling the quarterback, including speech recognition for audible plays, navigation in the pocket, upper-body mapping, and passing to receivers.

This project was created using:

• Microsoft Kinect (retail version)
• Microsoft Kinect SDK for Windows
• Unity 3D game engine
• Blender 3D modeling software
• Kinect SDK - Unity 3D plugin

If you want to create your own games using the Microsoft Kinect and the free Unity 3D game engine, download the dll plugin. Created for the Kinect Football project, this initial version supports joint position data for one player and is compatible with the latest versions of Unity and the Microsoft Kinect SDK. Check back for updates, as we will be adding more to the plugin... including speech recognition, two player mode, and video streaming!

Source code on GitHub
Questions? Email Andrew DeVine.