Demo of using the Kinect to control a delta robot

Description

Today's post is another demo of using the Kinect and Kinect SDK in a somewhat different way, this time using it to control a delta robot...

Steel balls with Kinect

...I built a delta robot and tried to control it with the Microsoft Kinect sensor. My aim was to make the delta robot grasp or pick objects only by gestures and body movements. The robot is actuated by three servo motors which are controlled by an AVR microcontroller. The AVR receives the desired x-, y-, and z-coordinates for the platform via RS-232 from a PC and calculates the inverse kinematics for the robot, accordingly. The robot’s firmware was implemented in BASCOM (a BASIC dialect for AVR microcontrollers). A solenoid is attached to the platform of the robot to pick steel balls. I used the Kinect for Windows SDK to get the skeleton tracking data from the Kinect sensor. I implemented a simple C# application that tracks my left and right hand and sends this data to robot via RS-232. With my right hand I move the delta robot’s platform in x-, y-, and z-direction, by raising or lowering my left hand I turn the solenoid on and off, respectively.

...In the following video the robot is controlled by the Kinect as described above: http://youtu.be/-Ub8LKPkhos On my webpage (http://www.mtahlers.de/index.php/robotik/delta-roboter-qdeltarq) you can find some pictures of the robot. There’s also some further information – but to date just in German (sorry…)....

Project Information URL: http://kinecthacks.net/steel-balls-with-kinect/ & http://www.mtahlers.de/index.php/robotik/delta-roboter-qdeltarq

image

image

image

Contact Information:

The Discussion

Comments closed

Comments have been closed since this content was published more than 30 days ago, but if you'd like to send us feedback you can Contact Us.