Browse > Article

Handwriting and Voice Input using Transparent Input Overlay  

Kim, Dae-Hyun (이화여자대학교 디지털미디어학부)
Kim, Myoung-Jun (이화여자대학교 디지털미디어학부)
Lee, Zin-O ((주)알티캐스트 델타프로젝트팀)
Publication Information
Journal of KIISE:Software and Applications / v.35, no.4, 2008 , pp. 245-254 More about this Journal
Abstract
This paper proposes a unified multi-modal input framework to interface the recognition engines such as IBM ViaVoice and Microsoft handwriting-recognition system with general window applications, particularly, for pen-input displays. As soon as user pushes a hardware button attached to the pin-input display with one hand, the current window of focus such as a internet search window and a word processor is overlaid with a transparent window covering the whole desktop; upon which user inputs handwriting with the other hand, without losing the focus of attention on working context. As well as freeform handwriting on this transparent input overlay as a sketch pad, the user can dictate some words and draw diagrams to communicate with the system.
Keywords
User Interface; Input framework; Transparent Window; Handwriting Recognition; Voice Recognition; Sketch Pad; User Test;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Jeff Van West. Using Tablet PC: Handwriting Recognition. Microsoft, 2007
2 L.M. Encarnacao, O. Bimber, D. Schmalstieg, and S.D. Chandler. A transluccent sketchpad for the virtual table exploring motion-based gesture recognition. Graphics Forum, 18(3):C277-C285, 1999   DOI
3 William Buxton. Chunking and phrasing and the design of human-computer dialogues. Information processing, pages 1285-1291, 1986
4 Richard C. Davis, James A. Landay, Victor Chen, Jonathan Huang, Rebecca B. Lee, Francis C. Li, James Lin, Charles B. Morrey III, Ben Schleimer, Morgan N. Price, and Bill N. Schilit. Notepals: lightweight note sharing by the group, for the group. In Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, pages 338-345, 1999
5 Clive Frankish, Richard Hull, and Pam Morgan. Recognition accuracy and user acceptance of pen interfaces. In CHI 1995 Proceedings, pages 12-18, 1995
6 Dae Hyun Kim and Myoung-Jun Kim. A new modeling interface for the peninput displays. Journal of Computer-Aided Design, 38(3):210-223, 2006   DOI   ScienceOn
7 Thomas P. Moran, Patric Chiu, William van Melle, and Gordon Kurtenbach. Implicit structures for pen-based systems within a freeform interaction paradigm. In Proceedings of ACM CHI'95 Conference on Human Factors in Computing Systems, pages 487-494, 1995
8 Gordon Kurtenbach, George Fitzmaurice, Thomas Baudel, and Bill Buxton. The design of a gui paradigm based on tablets, two-hands, and transparency. In Proceedings of the 1997 ACM Conference on Human Factors in Computing Systems, pages 35-42, 1997
9 M. Trinder. The computer's role in sketch design: A transparent sketching medium. In Computers and Building, Proc CAADfutures99, pages 227-244, Atlanta, 1999
10 Baumgarten. IBMrViaVoice QuickTutorial. South- Western Educational Publishing
11 Jitsuro Mase. Moderato: 3d sketch cad with quick positioned working plane and texture modeling. In T.-M. Rhyne A. Chalmers, editor, eCAADe2000, Bauhaus-Universitat Weimar, pages 300-307, June 2000
12 Jennifer Mankoff, Scott E. Hudson, and Gregory D. Abowd. Interaction techniques for ambiguity resolution in recognition-based interfaces. In Proceedings of the 13th annual ACM symposium or User Interface software and technology, pages 11-20. ACM, November 2000