RoomAlive Toolkit & Hacking Augmented Reality with Kinect

Description

We've mentioned IllumiRoom and RoomAlive before, but at Build 2015 there was a dedicated session AND the release of the RoomAlive Toolkit too!

Hacking Augmented Reality with Kinect

IllumiRoom (http://research.microsoft.com/en-us/projects/illumiroom/) demonstrated how projection mapping can enhance entertainment. RoomAlive (http://research.microsoft.com/en-us/projects/roomalive/) prototyped turning any room into an interactive, augmented experience. In this session, Andy Wilson (Microsoft Research) teaches the key concepts behind these projects including:

  • Kinect and projector calibration
  • Networking multiple Kinect sensors together
  • Displaying dynamic AR objects in real-time.

Additionally, all tools and source code used in the session will be released on GitHub to enable you to make use of these techniques in your own projects.

Project Information URL: https://channel9.msdn.com/Events/Build/2015/3-87

Kinect/RoomAliveToolkit

RoomAlive Toolkit README

The RoomAlive Toolkit calibrates multiple projectors and cameras to enable immersive, dynamic projection mapping experiences such as RoomAlive. It also includes a simple projection mapping sample.

This document has a few things you should know about using the toolkit's projector/camera calibration, and gives a tutorial on how to calibrate one projector and Kinect sensor (AKA 'camera').

Prerequisites

  • Visual Studio 2013
  • Kinect for Windows v2 SDK

The project uses SharpDX and Math.NET Numerics packages. These should be downloaded and installed automatically via NuGet when RoomAlive Toolkit is built.

Tutorial: Calibrating One Camera and One Projector

...

ProjectionMapping Sample

...

Calibrating Mutiple Cameras and Multiple Projectors

...

More Online Resources

Source Code URL: https://github.com/Kinect/RoomAliveToolkit




The Discussion

  • User profile image
    shorties

    As someone who has spent months on maintaining alignment in projection mapping projects, this is the most amazing thing I have ever seen. 

Comments closed

Comments have been closed since this content was published more than 30 days ago, but if you'd like to send us feedback you can Contact Us.