Servo controlled via Face Tracking and the Kinect SDK v1.5

Sign in to queue


Today's inspirational project, coming via a comment from Bryan on his Kinect & PAC's (Programmable Automation Controller) project, shows off a new feature in the new Kinect for Windows SDK v1.5, Face Tracking.

(I'm not sure what this says about me, but when I saw this, my first thought was, "Hey, that's like the chain gun in the Apache helicopter!")

Servo Face Tracking with Kinect SDK v1.5

This is a quick-and-dirty experiment using the Kinect SDK v1.5 (released on Monday 5/21) with face tracking features. The laptop I'm using here is incredibly under powered for the job so the results are poor, but I wanted to capture what I was able to cobble together today and share it. The webcam in the video is mounted to two servos that are powered by some electronics I breadboarded for an earlier experiment. I still have some work to do on the servo responsiveness, but I like where this is going. The baseline project is part of the new SDK Developer Toolbox (Face Tracking Basics in C#).

Project Information URL:

Contact Information:

The Discussion

  • User profile image

    This video shows my latest work with the servo-based webcam:

    In this video I'm using the latest SDK v1.5.1, and I also modified the control electronics and software to use a Pololu Micro Maestro servo controller. I wrapped the Maestro DLL in a C# class library, and this time instead of making method calls directly from within the OnAllFramesReady event handler, I spun a worker thread and did some running averaging on the face coordinates to help smooth the the webcam's motion.

    Another interesting thing shown in this latest video is Kinect Studio v1.5.1 running with the 3D Viewer and Depth Viewer activated. In a couple of instances I move in and out of the Kinect's field of view to demonstrate how quickly the face tracking picks up. This is a big improvement over my last experiment, where there was some delay experienced before tracking was accomplished.

  • User profile image

    @bkbrowncom: Nice... Smiley

  • User profile image

    And here is yet some more fun with Kinect-based face tracking, only this time I'm not doing any sort of device control, but rather combining the data stream with a NeuroSky MindWave brainwave monitor:

Add Your 2 Cents