Kinecting AR Drone - Part 1

Today Tom Kerkhove is back with his very cool Kinecting AR Drone project. Make sure you click through as he does a great job explaining and detailing each code section...

Kinecting AR Drone Pt. I – Basic UI, Kinect camera & voice recognition

I’m back! Now what I forgot in my introduction post was – What is the point of this series? AR Drone is just a quadricopter, what is the link with Kinect?
The answer is simple – There is none.

So let’s create one! I had an idea why not control my drone with my Kinect and turn my drone into a voice-and-gesture-controlled drone and integrate the camera of the drone in an application and fool around with some tricks and its LEDs.
Because of the big amount of content this tutorial is spread into three parts.

As we’ve seen in my Kinect Television tutorial connecting to our Kinect and displaying the camera is easy!
I recommend reading this tutorial before starting since I won’t go into detail on this.

What you will learn

In part I we will learn the following things -

  • Integrate Kinect sensor in our application
  • Visualize the Kinect-state
  • Visualize the camera
  • Add speech recognition
Prerequisites

In order to follow this tutorial you’ll need a Kinect sensor (I’m using Kinect for Windows v1) and the following things –

  • Basic C# & WPF skills
  • Kinect for Windows SDK v1.8 (link)
  • Microsoft Speech Platform SDK v11 (link)
Chapter overview
  1. Exploring the template
  2. Connecting to our Kinect
  3. Visualizing the Kinect Camera
  4. Adding speech recognition

image

image

...
Conclusion

In this detailed tutorial we’ve seen how we can get an instance of our Kinect sensor and how we should start it. Next to that we’ve enable the colorstream and visualized it along with the connection state of our sensor. We ended with enabling speech recognition based on a small set of commands and visualized if the recognizer has rejected or recognized the commands.

My posts on part II & III will be a more high level post that explain the my pitfalls & thought on several topics.

This is how your application should look like at the end of Part I, you can find my code here if you want to check my code or I left something out by mistake.

Project Information URL: http://www.kinectingforwindows.com/2013/12/01/kinecting-ar-drone-pt-i-basic-ui-kinect-camera-voice-recognition/ 

Project Download URL: https://github.com/KinectingForWindows/KinectingARDrone/tree/Part_I

Project Source URL: https://github.com/KinectingForWindows/KinectingARDrone/tree/Part_I

Contact Information:

Tags:

Follow the Discussion

Comments Closed

Comments have been closed since this content was published more than 30 days ago, but if you'd like to continue the conversation, please create a new thread in our Forums,
or Contact Us and let us know.