In the VoicePen project, we seek to explore ways in which a digital stylus input can be augmented with voice input to provide added expressivity and control in various pen-based tasks, such as drawing and manipulation of animation objects.

We built a prototype that demonstrates some of the ways in which continuous, non-speech vocalizations may be combined with stylus input to enable simultaneous manipulation of parameters, such as stroke thickness, opacity, and position. The prototype uses the SketchWizard interface to provide the interaction workspace and the VocalJoystick engine to process non-speech vocalization input from the microphone.