Using the Kinect to build a NUI E-Book

Sign in to queue


In the second of our Ray double shot, today we check out a cool project where he's created an "e-book" with the Kinect for Windows SDK. It's not an e-book about the Kinect but with the Kinect!

Kinect E-Book

So… have you ever wanted to make Reading more interesting for Key Stage 3? Or Anyone in fact? Well now you can!

I got speaking to Stuart Ball the other day and he had this amazing idea about creating a Kinect E-Book. The E-Book would allow you to use gestures to change pages etc… After a few nights hard work, I have come up with something that may be useful to someone. You can read out the book and you can also hover over pictures related to the story line. This will then play a sound effect based on the story.

You can simply go into the application folder and add 4 lines of text to each page. The great benefits are that you could get your whole class to come up with a story together. At the moment, you can have 7 pages but I am working on expanding this. You can edit a text file in each folder, edit the “.wav” files and edit the pictures. Once you have done this, run the code and you’re away Smile. I’m going to try this as a form activity soon but I also hope to try and get some good Kodu stories written for games based learning.

This would also be just as useful in other contexts. If you were a music teacher, you could use the lines to describe an instrument and all you would need to do is change the image and the appropriate wav file of your instrument. You could get all of the students collaborating to come up with a music e-book together.

To run the application, you will need to have the Kinect SDK installed and you will probably need visual studio express installed. Once you have these installed, you will only need to edit each text file in the folder. You hover your hand over the left edge in order to go back a page and you hover your hand over the right edge to go forward a page.


Project Information URL:

Project Download URL:

Project Source URL:


Contact Information:

The Discussion

Add Your 2 Cents