Servo controlled via Face Tracking and the Kinect SDK v1.5
- Posted: May 29, 2012 at 6:00 AM
- 6,957 Views
- 3 Comments
Loading User Information from Channel 9
Something went wrong getting user information from Channel 9
Loading User Information from MSDN
Something went wrong getting user information from MSDN
Loading Visual Studio Achievements
Something went wrong getting the Visual Studio Achievements
Today's inspirational project, coming via a comment from Bryan on his Kinect & PAC's (Programmable Automation Controller) project, shows off a new feature in the new Kinect for Windows SDK v1.5, Face Tracking.
(I'm not sure what this says about me, but when I saw this, my first thought was, "Hey, that's like the chain gun in the Apache helicopter!")
This is a quick-and-dirty experiment using the Kinect SDK v1.5 (released on Monday 5/21) with face tracking features. The laptop I'm using here is incredibly under powered for the job so the results are poor, but I wanted to capture what I was able to cobble together today and share it. The webcam in the video is mounted to two servos that are powered by some electronics I breadboarded for an earlier experiment. I still have some work to do on the servo responsiveness, but I like where this is going. The baseline project is part of the new SDK Developer Toolbox (Face Tracking Basics in C#).
Project Information URL: http://www.youtube.com/watch?feature=player_detailpage&v=EPWxGrKn-r0
Contact Information:
Comments have been closed since this content was published more than 30 days ago, but if you'd like to continue the conversation,
please create a new thread in our Forums,
or
Contact Us and let us know.
Follow the Discussion
Oops, something didn't work.
What does this mean?
Following an item on Channel 9 allows you to watch for new content and comments that you are interested in. You need to be signed in to Channel 9 to use this feature.What does this mean?
Following an item on Channel 9 allows you to watch for new content and comments that you are interested in and view them all on your notifications page.sign up for email notifications?
This video shows my latest work with the servo-based webcam:
http://youtu.be/xb65iuOj8VE
In this video I'm using the latest SDK v1.5.1, and I also modified the control electronics and software to use a Pololu Micro Maestro servo controller. I wrapped the Maestro DLL in a C# class library, and this time instead of making method calls directly from within the OnAllFramesReady event handler, I spun a worker thread and did some running averaging on the face coordinates to help smooth the the webcam's motion.
Another interesting thing shown in this latest video is Kinect Studio v1.5.1 running with the 3D Viewer and Depth Viewer activated. In a couple of instances I move in and out of the Kinect's field of view to demonstrate how quickly the face tracking picks up. This is a big improvement over my last experiment, where there was some delay experienced before tracking was accomplished.
@bkbrowncom: Nice...
And here is yet some more fun with Kinect-based face tracking, only this time I'm not doing any sort of device control, but rather combining the data stream with a NeuroSky MindWave brainwave monitor: http://bkbrown.com/projects-KinectMindwave.html
Remove this comment
Remove this thread
close