Natural User Interfaces with Physiological Sensing

Download this episode

Download Video


Microsoft has innovated continually in developing novel interaction modalities, or natural user interfaces. Surface and Project Natal are two examples. While these modalities rely on sensors and devices situated in the environment, we believe there is a need for new modalities that enhance the mobile experience. We take advantage of sensing technologies that enable us to decode the signals generated by the body. We will demo muscle-computer interfaces, electromyography-based armbands that sense muscular activation directly to infer finger gestures on surfaces and in free space, and bio-acoustic interfaces, mechanical sensors on the body that enable us to turn the entire body into a tap-based input device.



Available formats for this video:

Actual format may change based on video formats available and browser capability.

    The Discussion

    • User profile image

      that is hot Smiley

      looks like there is quite a bit of input lag though, i wonder if they use pattern recognition similar to natal because in that case, lag could be reduced with further traning of the recognition..

      it'd also be fun to know how much of natal software tech has gone into these two things Smiley


      seeing natal at techfest would also be super awsome, but im not holding my breath :/

    • User profile image

      dude you are everywhere ??? time to close your mouth...   Smiley  it is just too weird man... Tongue Out

    • User profile image

      hey, what can i say Wink i like c9

    Comments closed

    Comments have been closed since this content was published more than 30 days ago, but if you'd like to send us feedback you can Contact Us.