VoicePen
In the VoicePen project, we seek to explore ways in which a digital stylus input can be augmented with voice input to provide added expressivity and control in various pen-based tasks such as drawing and manipulation of animation objects.
We have built a prototype that demonstrates some of the ways in which continuous, non-speech vocalizations may be combined with stylus input to enable simultaneous manipulation of parameters such as stroke thickness, opacity, and position. The prototype uses the SketchWizard interface for providing the interaction workspace, and the VocalJoystick engine to process non-speech vocalization input from the microphone.
We have built a prototype that demonstrates some of the ways in which continuous, non-speech vocalizations may be combined with stylus input to enable simultaneous manipulation of parameters such as stroke thickness, opacity, and position. The prototype uses the SketchWizard interface for providing the interaction workspace, and the VocalJoystick engine to process non-speech vocalization input from the microphone.
Example of a drawing created using VoicePen, where the digital stylus was used to specify the stroke thickness and non-speech vocalization was used to specify the opacity.
Publications
|
VoicePen: Augmenting Pen Input with Simultaneous Non-Linguistic Vocalization Susumu (丞) Harada (原田) , T. Scott Saponas and James A. Landay International Conference on Multimodal Interfaces, 2007. Full Paper (PDF) |