Mercedes-Benz, Chengdu, China and the Kinect
- Posted: Oct 29, 2012 at 6:00 AM
- 5,244 Views
- 2 Comments
Loading User Information from Channel 9
Something went wrong getting user information from Channel 9
Loading User Information from MSDN
Something went wrong getting user information from MSDN
Loading Visual Studio Achievements
Something went wrong getting the Visual Studio Achievements
Today's inspirational project provides a glimpse into how the Kinect is being used around the world to provide one of a kind customer experiences...
Check out my latest Kinect based project with 3D mapping and projection specialists NuFormer.
Kinect head tracking was used to change the viewpoint of a 3D rendered scene so that it would appear to be playing out behind the windscreen of the newest Mercedes. Stepping to the left/right would allow you to look around the corner into the car.
Furthermore gesture tracking was used to enhance the interactivity to engage the public to wipe things off the windscreen.
Project Information URL: http://www.brekel.com/?p=1037
Chengdu – On August 30, 2012, the day before the Chengdu Motor Show (CDMS) in China, NuFormer performed another impressive interactive 3D video mapping projection. The interactive projection installation surprised guests as they were attending the introductory event of the new Mercedes-Benz B-Class. NuFormer proved again to continue the upward trend of innovations.
A regular 3D video mapping projection on a car creates the illusion of the projected images being displayed onto the car’s body. Using a new technique developed especially for this project, NuFormer went against this trend and created the illusion as if the video mapping took place inside of the car.
By projecting onto the front window from the inside out, the spectators could see several scenes being displayed in the interior of the car. A happy family watching butterflies flying through the car, a couple of teenagers having a water gun fight or a rock band performing a show.
Projecting onto the front window from the inside of a car is quite a challenging feat in itself, but NuFormer added even another layer to this experience. Specially designed programming allowed the spectator to change the perspective of the content inside the new Mercedes-Benz B-Class by using their body motions.
The custom created software changed the perspective of the displayed content by motion tracking every movement of the spectator by using Kinect. The perspective of the projected content was determined by the position of the viewer’s eyes so that it corresponded exactly with what the viewer expected to see. When the viewer moved, the perspective of the content adjusted itself. From the spectator’s point of view, it looked as if the virtual front window was an extension of the real world!
A lot of challenges had to be tackled to create such an innovative project. The difficulty did not only lie in the projecting from the inside of the car and finding the right material to project on, but also the tracking of the viewer’s eyes and adapting the perspective of the content in real-time took many hours of research and development. An earlier experiment called “The virtual living room” was executed in the NuFormer studio to investigate the feasibility of changing a perspective in real-time. This experiment formed the basis of this project.
The technique of adapting the perspective of the content to that of the spectator is very versatile and does not just lend itself for a car projection. Imagine a virtual window projected onto a wall that will give passersby a beautiful view over an imaginary landscape or a store window that displays endless shelves of the latest fashion in designer footwear. The possibilities are endless!