Entries:
Comments:
Posts:

Loading User Information from Channel 9

Something went wrong getting user information from Channel 9

Latest Achievement:

Loading User Information from MSDN

Something went wrong getting user information from MSDN

Visual Studio Achievements

Latest Achievement:

Loading Visual Studio Achievements

Something went wrong getting the Visual Studio Achievements

Capturing Facial Expressions with the Kinect for Windows v2

Today Tom Kerkhove, Kinect for Windows MVP, shows off one of the coolest things in the new Kinect for Windows v2 Device and SDK, how we now have built in facial expression support...

First look at Expressions – Displaying expressions for a tracked person

One of the biggest feature requests was the ability to track the expressions of the users. Today I’m happy to tell you that this is now available in the alpha [UPDATE (15/07/2014) – The sample is updated based on the public preview SDK.] SDK thanks to the facetracking!

In this post I will walk you through the steps to display the expressions for one user but this is possible for all the tracked persons!

Template

I developed a small template that displays the camera so you can follow along & is available here.

Tutorial

Setting up expression tracking is pretty easy – We just need to set up body tracking, assign a FaceFrameSource to it and start processing the results. This requires us to add two references – Microsoft.Kinect for body tracking & Microsoft.Kinect.Face for the face tracking.

As I mentioned in my basic overview we need to create a BodyFrameReader to start receiving BodyFrameReferences in the FrameArrived event.

...

Testing the application

When you give the application a spin this is how it should look like –

image

Conclusion

In this post I illustrated how easy it is to set up expression tracking for one person and what it allows you to do f.e. user feedback when they see a new product at a conference.

Keep in mind that the sensor is able to track up to six persons and your algorithm should support this as well.

...

[Click through for all the code, the source links and more]

Project Information URL: http://www.kinectingforwindows.com/2014/07/13/first-look-at-expressions-displaying-expressions-for-a-tracked-person/

Project Source URL: https://github.com/KinectingForWindows?tab=repositories

Contact Information:

Other posts from Tom you might also find interesting;




Tags:

Follow the Discussion

  • JeanJean

    Hi,

    Thanks for sharing your project it's really great.

    Did you know how to get information about tracking face's points with Kinect V2 (like this http://blogs.msdn.com/b/kinectforwindows/archive/2014/01/31/clearing-the-confusion-around-kinect-for-windows-face-tracking-output.aspx).

    I can't find any information on internet for doing this with Kinect v2.

    Thanks in advance

  • FotisFotis

    Yes any information on how to track points on user's face would be great! Something like Facial action points! I can see in the library that you have this but I cant use it

Remove this comment

Remove this thread

close

Comments Closed

Comments have been closed since this content was published more than 30 days ago, but if you'd like to continue the conversation, please create a new thread in our Forums,
or Contact Us and let us know.