Video: MADExpo Kinect-enabled Session Finder

Play Video: MADExpo Kinect-enabled Session Finder
Sign in to queue


Here's a video of a fun and cool project I worked on for the Mid Atlantic Developer Expo, namely a Kinect-enabled Session Finder.

The project uses the recently-released Kinect SDK for Windows beta, a custom version of the Session Sorter code from the MADExpo website, hosted in a WebBrowser control within a WPF application (the page uses the isotope.js library for sorting, filtering, and animated transitions, which would be a lot of work to replicate in WPF, so hosting in a WebBrowser control saved time). The WPF application is useful since I can use it to capture audio from Kinect and enable speech recognition, as well as to run the app in kiosk mode. Meanwhile, in the background, I'm running the Coding4Fun Mouse Cursor sample, which captures my gestures and turns them into mouse moves and clicks.

One tricky bit was getting the speech recognition commands passed through to the web page hosted inside the WPF app. Turns out that the WebBrowser control exposes a method called InvokeScript, which you can use to call a named function within the target page. So I coded up a series of javascript functions on the underlying page to do things like scroll up or down, simulate a click on the sort and filter elements (using jQuery's .click() api), etc. While the code isn't pretty, it was easy to do overall, and the result is pretty nifty. Here's the video...





Download this episode

The Discussion

Add Your 2 Cents