Using Your Voice to Paint

Download this episode

Download Video


Susumu Harada is a Ph.D grad in the Computer Science and Engineering department at University of Washington. He invited me over to see a system he built, which allows someone to paint pictures using a voice-controlled mouse. Though the practical applications of this include other uses, drawing is the most intricate application because it involves lots of curves and mouse movements, which don't lend themselves to other methods of accessibility.

The system uses a method of vowel sounds to move the mouse, and discrete constant sounds to click the mouse buttons. You can see more about the technology behind this at the Vocal Joystick Project.



Available formats for this video:

Actual format may change based on video formats available and browser capability.

    The Discussion

    Comments closed

    Comments have been closed since this content was published more than 30 days ago, but if you'd like to send us feedback you can Contact Us.