Gesture Control with Kinect and Unity made easy

The Discussion

• 

  Hello!

  Thank you, this is great. Keep it coming!

  I am new to Kinect and Unity, and I have challenged myself to create an interactive art piece for my MFA project.

  So I might throw some questions your way, in the near future, if you are open  to that?

  Thanks again!

  Chris

• 

  @somerchr:Hey =) Yes, do feel free to poke me with questions - sorry for the late response. Twitter is a much better channel for me tbh ^^;;

• 

  Hi Kris!
  
  I'm trying to have the user's skeleton (say hand or chest) scale an object in Z (like how you have the object moving but in scale) as well as have an audio cue when the hand or chest contacts that object.
  
  Any help is appreciated!!!
  
  Chris

• 

  @somerchr:

  Hm, instead of changing the transform.position of the object I would go and apply the pos.values to transform.localScale - see

  http://docs.unity3d.com/ScriptReference/Transform-localScale.html

  You might have to play around with the values though.

  As for audio cue:

  You can put a collider around the object that is moved / scaled by the hand as well as the other object. If you don't want them to actually stop each other, it is possible to mark one of them (! never both) as trigger, which changes the methods a little. Also give them a tag that helps you identifying the correct collision before executing any actions.

  Anyway, you need to attach a script to one of the objects. In that you will call either OnTriggerEnter or OnCollisionEnter

  http://docs.unity3d.com/ScriptReference/Collider.OnTriggerEnter.html

  http://docs.unity3d.com/ScriptReference/Collider.OnCollisionEnter.html

   

  And to play Audio, you will need to work with the respective Audio components. if you have no previous experience, this should help out well:

  http://unity3d.com/learn/tutorials/modules/beginner/audio/audio-sources-and-listeners?playlist=17096

   

  :) Have fun coding! (and sorry again for being late - I meant it, poking me on Twitter is a lot faster because of a different notification system)

• 

  Thank you! I will give it a whirl. I will try twitter next time. cheers Chris

   

• 

  this tutorial applies only to Kinect v2? Because I'm auditioning in the old version of the kinect not worked. I tried to run the MainScene, but it is as if the sensor was not connected. I tried using and enjoying one package 1.7 and tested the kinect work, but this package does not have the functions that you used in the tutorial. I wonder if there's anything I can do to solve this problem, in the old version I'm not able to reconnoiter, excuse'm a new developer and is my first contact with the development for the kinect I'm very lost. The one more thing, congratulations for the tutorial.

• 

  @JeffersonRSM: Hi,  thank you! This guide is solely aimed at and compatible with Kinect V2. It is possible to control gestures in Kinect v1, but you need the respective SDK and Plugin. Have a look at the following pages:

  https://channel9.msdn.com/coding4fun/kinect/Unity-and-the-Kinect-SDK

  https://channel9.msdn.com/coding4fun/kinect/Unity-Asset-Kinect-v1-with-MS-SDK

  http://wiki.etc.cmu.edu/unity3d/index.php/Microsoft_Kinect_-_Microsoft_SDK#Integrating_with_Unity

   

   

• 

  I've been looking all over for a way to move the camera forward with input from the microphone. I know it's only loosely connected to this tutorial, but I figure that gesture control has to be harder than this task. Is there a script I can attach to the camera to make it move forward based on (any) input from an internal mic? If not too much harder, I'd love to change the velocity based on volume, as well. Basically just plan to have the camera move in a straight path down a tunnel with this.