Custom Gestures End to End with Kinect and Visual Gesture Builder

Sign in to queue


In this video (part 1 of 2) we walk thru end-to-end how to create custom Kinect gestures using Visual Gesture Builder.  We discuss why you would want to use a machine learning approach to custom gesture creation and then walk through in depth all the various components of creating the gesture: recording and tagging clips, previewing the gesture, and how to call the created gesture from code.

Part 2 can be found here.

Detailed timeline:

[00:01:32] - Overview of the video
[00:02:23] - Detection:  Heuristic vs. Machine Learning
[00:05:43] - Kinect Studio (Recordable Data Sources and Recording Clips)
[00:10:20] - How & Why to Record in Raw Format
[00:16:51] - Converting Raw Clips with KSConvert.exe
[00:21:03] - Recordable Data Sources
[00:23:17] - Introduction to Visual Gesture Builder
[00:25:30] - Creating a New Gesture Using the Wizard
[00:35:15] - Adding & Tagging Clips
[00:45:34] - Building the Gesture Database File
[00:46:10] - Explanation of Build Steps & Process
[00:52:50] - Testing the Custom Gesture
[00:56:34] - Live Preview of Custom Gesture
[00:58:40] - Summary of Visual Gesture Builder
[00:59:40] - Visual Gesture Builder Process Flow Chart
[01:01:35] - Developer Sample:  Discrete Gesture Basics
[01:04:03] - Code Walk-thru:  Discrete Gesture Basics
[01:17:54] - Kinect Resources


Resources mentioned:



The Discussion

  • User profile image

    Great video guys. It really helps when the developers explain things. Watching for 1 hour will undoubtedly save me many hours coding.

    NOTE: For anyone interested, I have re-programmed a lot of the DiscreteGestureBasics sample code as VB.NET rather than C#, but I'm not sure where to post the code for others to re-use.

    Update - OK guys, so I've published my code on MSDN for all to benefit [H]  Here's the link:

    Kinect v2 SDK Sample Code re-worked in VB.NET (skeleton & gestures)

  • User profile image

    I'm trying this tutorial but I can not build with the preview version of gesture visual builder. Do I need to purchase this program and where can I buy this? Thank you.

Add Your 2 Cents