Graphical keyboard

• US 6,094,197 A
• Filed: 05/17/1995
• Issued: 07/25/2000
• Est. Priority Date: 12/21/1993
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Buxton, William A. S., Kurtenbach, Gordon P.
• Primary Examiner(s): AWAD, AMR A
• Application Number:
  US08/443,259
• Time in Patent Office: 1,896 Days
• Field of Search: 345/156, 345/157, 345/168, 345/169, 345/170, 345/172, 345/173, 345/174, 345/175, 345/176, 345/179, 345/180, 345/181, 345/182, 345/183, 341/22, 341/23, 170/18, 170/19, 395/326, 395/335, 395/347, 395/350, 395/351, 395/352, 382/188, 382/189
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A system and method for a graphical keyboard that benefits from the expressive power and intuitive ease of use associated with pen strokes and gestures, yet does not require complex character-recognition software. The graphical keyboard responds differently to different kinds of pen strokes. For example, lowercase "a" is entered by tapping a stylus on the "a" key of the graphical keyboard. Uppercase "A" is entered by an upward stroke initiated over the "a" key. Likewise, by stroking in other directions, a user can express other modifiers to the basic character, such as "control", "alt", "command," etc. Also, strokes in distinct directions can be used to express space, backspace, delete, and return characters, for example. Multiple strokes can be applied in sequence to a single key to express multiple modifiers. Visual feedback of pen strokes can be provided in the form of marks made by the pen. Pop-up menus can be used to provide help with and to facilitate memorization of command strokes and stroke sequences. The graphical keyboard thus lets the expert user proceed by "feel," and prompts the novice user when and as necessary.

Claims

1. A user interface apparatus for a computing system, said apparatus comprising:

a display device displaying a graphical keyboard image;

an input source comprising a designating device, said input source providing an input comprising key information and path information, said key information representing a key of said graphical keyboard image, said path information representing a series of points designated by said designating device, wherein said path information comprises a direction of displacement of said designating device;

an output generator, responsive to said key information and said path information provided by said input source, for producing a keycode data defing an output character by applying a modifier corresponding to said path information to an input character corresponding to said key information, with said modifier being determined according to said direction of displacement; and

a buffer, wherein said keycode data produced by said output generator is stored in said buffer.

2. The apparatus of claim 1 wherein:

said graphical keyboard image comprises a representation of a plurality of characters; and

said key information provided by said input source comprises a character to which said key corresponds.

3. The apparatus of claim 1 wherein said input source further comprises a sensor responsive to a plurality of positions of said designating device, said sensor providing said input source with position information about said designating device during a manipulation of said designating device, said position information determining said points of said series.

4. The apparatus of claim 3 wherein said sensor is integrated with said display device and said positions of said plurality include positions in a vicinity of said displayed graphical keyboard image throughout a substantial portion of said manipulation of said designating device.

5. The apparatus of claim 1 wherein said designating device comprises a pointing device selected from the group consisting of a pen, a light pen, a stylus, a pencil, a pointer, a mouse, a trackball, a joystick, or a finger.

6. The apparatus of claim 1 wherein said designating device comprises a cursor displayed by said display device, said cursor providing a representation of a position of a plurality of positions, a displacement of said cursor determining said points of said series.

7. The apparatus of claim 1 wherein said modifier is selected from the group consisting of shift, uppercase, control, alt, option, and command.

8. The apparatus of claim 1 wherein said keycode data corresponds to said path information and is independent of said key information.

9. The apparatus of claim 8 wherein said keycode data is a special character selected from the group consisting of return, space, backspace, and delete.

10. The apparatus of claim 1 wherein said input source provides said key information according to a position of said designating device relative to said graphical keyboard image.

11. The apparatus of claim 1 wherein said input source provides said key information according to one point of said series.

12. The apparatus of claim 11 wherein said one point is a starting point of said series.

13. The apparatus of claim 1 wherein said display device further displays a representation of said path information.

14. The apparatus of claim 13 wherein said representation of said path information comprises a mark corresponding to said path information, said mark being displayed in conjunction with said graphical keyboard image.

15. The apparatus of claim 13 wherein said representation of said path information comprises an ink trail corresponding to said series of points displayed in the vicinity of said graphical keyboard image.

16. The apparatus of claim 13 wherein said representation of said path information comprises a menu displayed in conjunction with said graphical keyboard image.

17. In a computing system comprising a processor, a sensor, a display, and a buffer, a method for using a graphical keyboard to produce and store a keycode data, said method comprising the steps of:

displaying on said display a graphical keyboard image;

sensing with said sensor a motion of a pen device relative to said sensor, said pen device being maintained proximate to said sensor throughout a substantial portion of said motion;

using said processor to generate said keycode data responsively to said motion by determinant an unmodified character according to an initial position of said pen device at a starting point of said motion, determining a modifier according to a path taken by said pen device during said motion, and applying said modifier to said unmodified character; and

receiving and storing in said buffer said keycode data thus generated.

18. The method of claim 17 wherein said step of using said processor to generate said keycode data comprises the step of:

determining a special character according to a path taken by said pen device during said motion and independently of an initial position of said pen device at a starting point of said motion.