Kinect + Unity3D Face Tracking

Sign in to queue


Today's inspirational project provides a great example of how the new Face Tracking feature of the Kinect for Windows SDK can be used

Kinect + Unity3D Face Tracking

We’ve been experimenting with the latest SDK’s from Microsoft for their Kinect for Windows device, particularly with the new facial tracking features. It makes for an excellent facial feature animation system, tracking things such as direction and rotation, as well as tracking facial features such as eyebrows, mouth open and closed, smiling, frowning and pouting just to name a few. Check out our early experimentation in the video below

It uses Microsoft’s latest Kinect SDKs, Unity3D with a 3D head model with morph targets. We can see this being used in interesting ways in interactive installations, as well as a cheap (rudimentary) facial animation capture tool for animation pipelines with a bit more work.

Project Information URL:

from Vimeo.

from Vimeo.

The Discussion

Add Your 2 Cents