Fitz and the Tantrums (and the Kinect)
Today's inspirational project again shows the magic of the Kinect and music...
My friend Jordan directed this music video for the band Fitz and the Tantrums (released on 4/22 on VH-1 and on the band’s web page and on vimeo in better quality), and I got to help plan and execute a technically unorthodox portion of the shoot. It’s a little odd for me to be involved on the production end of a project and to not work all the way through post-production (on films, post often lasts for more than a year) –but it was fun to shoot a bunch of stuff, hand it to the producer, and then see the final result weeks later. Now I know a little better how production folk must feel. Kudos to Jordan and producer Taylor for seeing the project through to the end.
At around 30 seconds in, you’ll start to see the lo-fi 3D imagery I helped capture and visualize –point clouds and wire-mesh renditions of members of the band, rendered from various virtual camera positions.
The data was shot head-on from a fixed camera position1, using a Canon 5DmkIII DSLR to capture video and a Microsoft Kinect sensor connected to a laptop to capture a video depth map. The DSLR and the Kinect were locked to one another with a 3D-printed mount. Jay Trautman2 (thanks!) operated the laptop while I manned the DSLR.
The depth information for each pixel (or ‘D’) captured on the Kinect was recorded and later paired with the video info for that pixel (RGB) using a piece of free software3 called RGBDToolkit. It’s fun to play with. If you’ve got a Kinect and a video camera, you might give it a try