Entries:
Comments:
Posts:

Loading User Information from Channel 9

Something went wrong getting user information from Channel 9

Latest Achievement:

Loading User Information from MSDN

Something went wrong getting user information from MSDN

Visual Studio Achievements

Latest Achievement:

Loading Visual Studio Achievements

Something went wrong getting the Visual Studio Achievements

Kin-Educate

Today's inspirational project (with download coming soon) is a great example of how the Kinect continues to help drive innovation in learning.

Kin-Educate: An educational game for the Kinect

Kin-educate is part of a research project exploring innovative ways to interact with computers, and what better tool to use than the Kinect? But, what kind of Kinect application to interact with? Well, since its release the Kinect very quickly became synonymous with education. Developers could see the potential, as could educators. So this seemed like the perfect place to start experimenting with the Kinect – by developing a fun, innovative educational game. The result is Kin-educate.

clip_image002

Kin-educate features two mini games. One, a spelling game, randomly chooses a word, shuffles the letters and then gives the player 30 seconds to grab, drag, and drop the letters, in order, to complete the word.

The maths game focuses on mental arithmetic. Randomized sums are generated and the player has to shout out the answer. A high score gets you your photo taken using the kinectColorViewer to capture an image of the player and display it.

clip_image004

The game is being tested at the moment and once any creases are ironed out I will make the project and source files available to all.

In the meantime you can see watch some videos on YouTube:

Kin-educate Spelling:

Kin-educate Maths:

FEATURES:

· Two handed control:

o Instead of using the coding4Fun hoverButton control on the buttons and having the timer ring appear on them, I wanted the timer ring to appear on the hand. I did this by using the hoverButton function on the hand symbol to trigger the events on the selected button.

o So when you hover over a letter in the spelling game (which is a button) the hoverButton triggers the letter buttons methods – in this case using the Kinect colorImagePoint to map the letter to the active hands location then I quickly switch the hand image to a closed fist to make it look like it is holding something.

clip_image006

o At any one time only one hand is actually active. This is controlled by gestures – as simple as; if the right hand is higher than the left then apply the hoverButton control to this hand. This helped get around any left or right handed problems, and also makes it much easier to play the spelling game.

· Speech recognition:

o Speech recognition is embedded within the entire application. It is all part of making it an engaging and interactive way of learning. So why put your arms at a weird angles or press a button on a keyboard to stop a game when you could simply say “Stop”? When you’re ready just say “Continue” or if you’ve had enough just say “Quit”.

clip_image008

o The speech recognition for the maths game was one of the most challenging aspects of developing Kin-Educate. Accounting for accents, poor annunciation, background noise, and then the number of variables involved in randomized sums (the number of potential answers) was pretty tricky. I managed to get around this by limiting the potential answers of the randomized sums to between 0 and 10, and then, once the word is recognized I compared this to the actual answer with a few checks. It still has some trouble with accents but within a couple of tries most people get the hang of it.

Kin-educate is still under development and will be an ever-evolving project. Different games can be added over time utilizing even more of the great Kinect capabilities and any suggestions are welcome. The next development is already in design. Any feedback is always appreciated, and keep an eye out for when the project will be available to download - soon!

Project Information URL: http://kin-educate.blogspot.co.uk/

Contact Information:

Tags:

Follow the Discussion

  • LavernLavern

    While the thing looks cute at the surface, I also see the next iteration of the "Kinect?! Damn, how can I write an app for it?"-philosophy. Until now I can only see VERY FEW apps that will actually profit by using "innovative" input devices. For the rest it may just look cute at the surface but is actually inefficient, and to me also annoying. Same goes for these Wii-controls. I have yet to see a game where they are actually useful. In games like tennis & stuff, where you could at least imagine them being useful, they lack a lot of precision, even Wii Plus, to be of any benefit to the game itself.

  • nice app

  • thats a nice app needs some customization work but nice start. I work as IT in education sector and can see this becoming a nice idea.

Remove this comment

Remove this thread

close

Comments Closed

Comments have been closed since this content was published more than 30 days ago, but if you'd like to continue the conversation, please create a new thread in our Forums,
or Contact Us and let us know.