Comment Feed for Channel 9 - Open source Kinect gesture recognition project, Kinect DTW http://files.channel9.msdn.com/thumbnail/c6a32147-2d1c-476c-8e52-807883e61aba.png Channel 9 - Open source Kinect gesture recognition project, Kinect DTW Seems like we're on a Gesture recording theme this week so far... Today's project provides another look at recognizing and recording gestures with the Kinect for Windows SDK. In today's we get the source to the main library too, so we can see just how the magic is done... Kinect SDK Dynamic Time Warping (DTW) Gesture RecognitionThis project allows developers to include fast, reliable and highly customizable gesture recognition in Microsoft Kinect SDK C# projects. It uses skeletal tracking and currently supports 2D vectors. Included is a gesture recorder, recognizer and sample gestures. You can save your gestures to file and we'd love it if you shared your gestures with the community - share and share alike! This project is currently in setup mode and only available to project coordinators and developers. Once you have finished setting up your project you can publish it to make it available to all CodePlex visitors. I would really love it if you share the gestures you make, as well as providing feedback on the best parameter settings you have found. I'm also keen for others to improve the project, so please feel free to contribute. You can use this code or any original or modified portion of it in any project that you like. We only ask that you keep the authors' names in the copyright notice because a lot of thought and effort went into this. For additional information, please check out KinectDTW - open source Kinect gesture recognition project released This evening I published to Codeplex the gesture recording and recognition project I’ve been working on. Massive shout out to Rhemyst for doing most of the thinking on this. Grab it here: http://kinectdtw.codeplex.com/ Key features: Gesture recording Gesture recognition Save gestures to file Tweakable parameters for fine control of how the recognizer works Works out of the box - just run the sample app Source code available too if you want to make your own gestures Please try this out and if you find it useful I'd love you to contribute to the project. There are a hundred things I can think of that could be done better but this is a great starting point for anyone who is interested in vector-based recognition with the Kinect. Project Information URL: http://kinectdtw.codeplex.com/ Project Download URL: http://kinectdtw.codeplex.com/releases/view/70946 Project Source URL: http://kinectdtw.codeplex.com/SourceControl/list/changesets /// <summary> /// Recognize gesture in the given sequence. /// It will always assume that the gesture ends on the last observation of that sequence. /// If the distance between the last observations of each sequence is too great, or if the overall DTW distance between the two sequence is too great, no gesture will be recognized. /// </summary> /// <param name="seq">The sequence to recognise</param> /// <returns>The recognised gesture name</returns> public string Recognize(ArrayList seq) { double minDist = double.PositiveInfinity; string classification = "__UNKNOWN"; for (int i = 0; i < _sequences.Count; i++) { var example = (ArrayList) _sequences[i]; ////Debug.WriteLine(Dist2((double[]) seq[seq.Count - 1], (double[]) example[example.Count - 1])); if (Dist2((double[]) seq[seq.Count - 1], (double[]) example[example.Count - 1]) < _firstThreshold) { double d = Dtw(seq, example) / example.Count; if (d < minDist) { minDist = d; classification = (string)_labels[i]; } } } return (minDist < _globalThreshold ? classification : "__UNKNOWN") + " " /*+minDist.ToString()*/; }   Contact Information: Blog: http://rymixxx.wordpress.com Twitter: @rymix en Thu, 23 May 2013 20:17:20 GMT Thu, 23 May 2013 20:17:20 GMT Rev9 Re: Open source Kinect gesture recognition project, Kinect DTW
Then, in the code, simply set a switch case statement based on the string (so right hand left and right hand left 1 would be the same statement).

posted by Alex

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634516017639805360 Wed, 14 Sep 2011 12:56:03 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634516017639805360 Alex Re: Open source Kinect gesture recognition project, Kinect DTW posted by Alex

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634516018246789990 Wed, 14 Sep 2011 12:57:04 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634516018246789990 Alex Re: Open source Kinect gesture recognition project, Kinect DTW

posted by Faith

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634518501251556072 Sat, 17 Sep 2011 09:55:25 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634518501251556072 Faith Re: Open source Kinect gesture recognition project, Kinect DTW
I am a new comer in the world of kinect. I've already installed WinSDK and WisStudio C++, namely I have got everything for some dummy project with kinect and all works OK. My purpose is to create an application which can sense the human hand raised upward and at the same time it can sense a sound coming from slapping your raised hand fingers. The point is here, just this idea is part of my lab project (turning on/off the lamp with hand gestures and I want to use kinect sensor). Could you give me some basic suggestions/directions to implement it and one more thing I need some source codes related to my project.

Thanks in advance for everybody who will be helping me, I'll appreciate all comments.

posted by Bek

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634536607430947909 Sat, 08 Oct 2011 08:52:23 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634536607430947909 Bek Re: Open source Kinect gesture recognition project, Kinect DTW i'm korean
i'm korea university student major in Computer Science.
this semaster, my team project is making kinect application.
plz help me and give me useful source plz plz plz plz
for example. easy game or easy program or easy advice or tip.
i love you.
myfaith@korea.ac.kr give me e-mail

posted by help me

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634557465358554522 Tue, 01 Nov 2011 12:15:35 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634557465358554522 help me Re: Open source Kinect gesture recognition project, Kinect DTW posted by cgm

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634576967658288327 Thu, 24 Nov 2011 01:59:25 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634576967658288327 cgm Re: Open source Kinect gesture recognition project, Kinect DTW @cgm: All the code can be found on the CodePlex Project, http://kinectdtw.codeplex.com/.

posted by gduncan411

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634576987542584064 Thu, 24 Nov 2011 02:32:34 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634576987542584064 gduncan411 Re: Open source Kinect gesture recognition project, Kinect DTW Thanks

posted by Colm

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634636287306995766 Tue, 31 Jan 2012 17:45:30 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634636287306995766 Colm Re: Open source Kinect gesture recognition project, Kinect DTW @Left hand wave
-1.1795086526498
1.47458695754472
-1.20663928612497
1.25547454087678
-1.0885620648087
0.588190567429521
0.566445231196249
-0.944087331128943
0.536893271464392
-1.65887393452418
0.530908905617062
-1.91468449569127

posted by Priyank

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634646847004934174 Sun, 12 Feb 2012 23:05:00 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634646847004934174 Priyank Re: Open source Kinect gesture recognition project, Kinect DTW First Kinect Demonstration Competition at CVPR 2012, June 2012

http://gesture.chalearn.org/dissemination/cvpr2012
$10,000 in prizes and up to $100,000 in licensing (see rules)

We invite the submission of demonstration proposals for a demonstration competition of applications of gesture recognition with KinectTM. At the site of the CVPR workshop on gesture recognition, the participants will demonstrate their system and be judged by a panel of experts, who will grade them according to pre-defined criteria:
- relevance (an application of gesture recognition using KinectTM NOT limited to one-shot-learning like the gesture challenge),
- usefulness (or, if it is a game, playfulness),
- technical or scientific contribution,
- novelty/originality, and
- quality of implementation.

First prize: USD 5000,
Second prize: USD 3000,
Third prize: USD 2000.

The prizes are donated by Microsoft (see the rules for the "qualitative evaluation" of the gesture challenge http://gesture.chalearn.org). To earn prizes, the participants must use a KinectTM device and the Microsoft SDK. Microsoft may also offer to license the technology of the winners for up to USD 100,000.

> Register: The demonstrators should subscribe to our Google group gesturechallenge.
> Guidelines: The demonstrators should send a 2-page demonstration proposal in the CVPR format (see author's guidelines). They should take into account the evaluation criteria. Alternatively, the demonstrators may send a full length paper (see the call for paper), but the deadline is sooner.
> Submission: The proposals should be emailed to gesture@clopinet.com.
> Deadline: Tuesday May 1, 2012.

This project in sponsored in part by NSF, Pascal2, Microsoft, and Texas Instrument.

posted by Isabelle Guyon

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634648556790031540 Tue, 14 Feb 2012 22:34:39 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634648556790031540 Isabelle Guyon Re: Open source Kinect gesture recognition project, Kinect DTW posted by Celine

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634685130866880506 Wed, 28 Mar 2012 06:31:26 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634685130866880506 Celine Re: Open source Kinect gesture recognition project, Kinect DTW has this app been updated to v1 sdk?

posted by lantonis

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634696473673504268 Tue, 10 Apr 2012 09:36:07 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634696473673504268 lantonis Re: Open source Kinect gesture recognition project, Kinect DTW @lantonis:In checking the project site, http://kinectdtw.codeplex.com/, no it doesn't look like it has been. But the source is there for an enterprising updater...

posted by gduncan411

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634696618304908759 Tue, 10 Apr 2012 13:37:10 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634696618304908759 gduncan411 Re: Open source Kinect gesture recognition project, Kinect DTW @lantonis: Yes, now it has, by the community. Check out Updates for Kinect DTW Gesture Recognition framework using new SDK 1.0 

Also of note is that a patch was uploaded to the project by someone else in the community that updates it to v1, http://kinectdtw.codeplex.com/SourceControl/list/patches

posted by gduncan411

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634705392456763264 Fri, 20 Apr 2012 17:20:45 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634705392456763264 gduncan411 Re: Open source Kinect gesture recognition project, Kinect DTW Where can i find it?
Thanks!

posted by Leandro

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634769143815109586 Tue, 03 Jul 2012 12:13:01 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634769143815109586 Leandro Re: Open source Kinect gesture recognition project, Kinect DTW http://grecogntionkinect.blogspot.com/

posted by Sheldon

]]> http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634775801988667952 Wed, 11 Jul 2012 05:09:58 GMT http://channel9.msdn.com/coding4fun/kinect/Open-source-Kinect-gesture-recognition-project-Kinect-DTW#c634775801988667952 Sheldon