Automatically scrolling handwritten input user interface for personal digital assistants and the like

• US 6,661,409 B2
• Filed: 08/22/2001
• Issued: 12/09/2003
• Est. Priority Date: 08/22/2001
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Seni, Giovanni, Demartines, Pierre
• Primary Examiner(s): CHOW, DOON Y
• Application Number:
  US09/938,319
• Publication Number:
  US 20030038788A1
• Time in Patent Office: 839 Days
• Field of Search: 345/156, 345/157, 345/173, 345/174, 345/155, 345/179, 345/785, 178/18-1-, 178/19-1-, 382/186, 382/187, 382/189, 382/312, 382/313
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06V 10/987 with the intervention of an operator
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A handheld device 100 such as a personal digital assistant (PDA) or the like, a handwritten input user interface (HIUI), a method of interfacing handwritten text and a program product therefor. A lower portion of a touch enabled display is designated as a handwriting input area 104. Action icons 106, 108, 110, 112 and 114 are disposed at a right side of the handwriting user interface 102. Recognized text is displayed on the screen in a text display area located between a file management tool bar 116 and the handwritten input area 104. A scroll bar 118 is disposed at the right side of the display 112. As text is continuously entered each individual word may be recognized, and inserted into the end of the text stream. A word separator 120 may demarcate or bracket individual words in a continuous input stream. A secondary list of potential recognition candidates may be available for display in a box 128 and offered for substitution for or in lieu of the recognized word. Handwritten text may be continuously entered and displayed in the handwriting input area 104 as digital ink, the input point staying approximately fixed with the ink display automatically scrolling. The input area behaves as a “treadmill” or “ticker tape” that is moving from right to left, thereby giving the illusion of a continuous writing space. The speed of the “treadmill” automatically adapts to writing speed. The device 100 may include a communications function and, in particular the device may include an antenna 122 for wireless communication. Individual function switches, buttons and other controls are disposed about the device.

Claims

1. An electronic device for handwritten input and contemporaneous display of said handwritten input, the device comprising:

a housing having a touch input screen thereon for handwritten input by engagement therewith;

a recognition engine that recognizes the handwritten input and converts the recognized input to text for display on the screen; and

scrolling software that causes at least a portion of the screen to appear to continuously move as handwritten entries are input thereon so as to continuously present screen space on the screen to the user for input thereby maximizing character input rates.

2. The electronic device of claim 1 wherein the screen is of a predetermined size and the screen portion is smaller than the predetermined screen size so that only the screen portion appears to move during handwritten input.

3. The electronic device of claim 1 wherein the screen has an input area including the screen portion on which handwritten text is input and corresponding digital ink is displayed, and an output area separate from the input area on which recognized text is displayed.

4. The electronic device of claim 3 wherein the housing includes electronic circuitry coupled to the screen with the recognition engine operable by engagement with the screen in the input area and inoperable by engagement with the screen in the output area.

5. The electronic device of claim 3 wherein the housing includes electronic circuitry coupled to the screen, and

an input device that when engaged with the screen input area cooperates with the circuitry to act as a digital pen for inputting text and when engaged with the screen output area cooperates with the circuitry to act as a pointer for clicking functions.

6. A handwritten input user interface (HIUI) for a portable device having a touch-enabled input screen with a predetermined area thereof, said HIUI comprising:

a handwriting input area residing in a predetermined portion of a touch-enabled input screen, handwritten text being entered using a stylus; and

an input/display auto scrolling window in said handwriting input area, written entries being scrolled such that the stylus entry point remains at an initial input position within said handwriting input area.

7. A HIUI as in claim 6, wherein said screen portion for the handwritten input area comprises a lower portion of said touch enabled screen.

8. A HIUI as in claim 7, wherein said handwritten input area includes a word separation line and spans said touch-enabled screen'"'"'s width.

9. A HIUI as in claim 7 including a recognition engine for recognizing individual words made in a continuous handwritten stream of cursive writing in the input area.

10. A HIUI as in claim 7 including a recognition engine for recognizing individual printed words made in a continuous stream of printed text in the input area.

11. A HIUI as in claim 7 wherein said auto scrolling window has a predetermined scrolling rate based on the entry input rate.

12. A HIUI as in claim 7 further comprising:

an output display area displaying a plurality of lines of text, recognition results being displayed in said output display area;

a recognition engine capable of recognizing individual words entered in a continuous stream of handwritten text;

a main dictionary, said recognition engine comparing each individual word against words in said main dictionary and providing a probability score indicative of the likelihood that each dictionary word is a correct interpretation of the individual word; and

a user dictionary supplementing said main dictionary, words in said user dictionary being matched against each said individual word and assigned a probability score.

13. A HIUI as in claim 7 wherein stylus entries made in said handwritten input area are text entries and stylus entries made outside of said handwritten input area are pointer function entries.

14. A HIUI as in claim 7 further comprising one or more action icons on said touch-enabled screen displayed together on a side of said touch-enabled screen.

15. A HIUI as in claim 7 wherein a word separator is displayed in said handwritten input area to the right of words being entered, entries to the right of said word separator indicating start of a next word.

16. A personal digital assistant (PDA) capable of recognizing words in a continuous handwritten text stream, said PDA comprising:

a touch-enabled input screen;

a recognition engine capable of recognizing individual words entered in a continuous stream of handwritten text;

a main dictionary containing a plurality of words;

a communications port for communicating with a remotely connected computer, data being transferred between said remotely connected computer and said PDA;

a local storage storing applications to be run on said PDA, said main dictionary and application data;

a plurality of switches providing manual input to said PDA; and

a handwritten input user interface (HIUI) comprising;

a designated handwriting input area residing in a lower portion of said touch-enabled input screen, handwritten words entered using a stylus,

an automatically scrollable output area, said handwriting input area being super-imposed on said scrollable output area, said scrollable output area displaying digital ink strokes corresponding to stylus entries made in said designated handwriting input area, said scrollable output area scrolling at a rate set by stroke rate,

a text output area, stylus entries made in said text output area being pointer function entries, and

one or more action icons displayed together on a side of said touch-enabled screen and providing access to editing functions for editing previously recognized displayed words.

17. A PDA as in claim 16, wherein said input area spans said touch-enabled screen'"'"'s width and said automatically scrollable output area includes a word separator.

18. A PDA as in claim 17 further comprising a user dictionary stored in said storage and supplementing said main dictionary, words in said user dictionary being matched against each said handwritten input word and assigned a probability score.

19. A PDA as in claim 18 wherein said communications port is a wireless communications port, e-mail messages being communicated over said wireless communications port.

20. A method of providing handwritten input to a computer, said method comprising the steps of:

a) receiving an entry from a designated handwritten-entry screen area;

b) displaying a corresponding digitial ink stroke;

c) determining ink stroke rate;

d) shifting each displayed digital ink stroke horizontally at a rate corresponding to said ink stroke rate, whereby handwritten entries appears to be scrolling off one side of a display as on a ticker tape.

21. A method as in claim 20 further comprising:

e) passing said received entry to a handwriting recognition engine, said handwriting recognition engine converting said received entry to text; and

f) displaying said text in a textual display area.

22. A method as in claim 21 wherein said handwriting recognition engine matches said entry against words in one or more dictionaries, each word in said one or more dictionaries being assigned a probability score indicative of a level of likelihood that said scored word is said entry.

23. A method as in claim 21 wherein the step (d) of shifting displayed digital ink strokes includes displaying a word separator indicating a point on the handwritten entry screen area designating demarcation between continuation of a current word and initiation of a next word.

24. A method as in claim 23, wherein said word separator scrolls with a handwritten entry when handwritten input is determined to have paused.

25. A method as in claim 23, wherein step (e) of passing said received entry is initiated when an entry is designated as initiating a next word.

26. A computer program product for inputting handwritten entries into a computer, said computer program product comprising a computer usable medium having computer readable program code thereon, said computer readable program code comprising:

computer readable program code means for continuously receiving handwritten entries;

computer readable program code means for converting said handwritten entry into digital ink;

computer readable program code means for setting a scrolling speed responsive to an entry input rate; and

computer readable program code means for displaying newly entered said digital ink and removing previously displayed digital ink from a display at a rate set by said scrolling speed, displayed said digital ink appearing as if on a ticker tape.

27. A computer program product for inputting handwritten entries into a computer as in claim 26 further comprising computer readable program code means for displaying a word separator.

28. A computer program product for inputting handwritten entries into a computer as in claim 26 further comprising:

computer readable program code means for identifying individual words and calling handwriting recognition; and

computer readable program code means for recognizing handwritten words and providing recognized said words to a display.

29. A computer program product for inputting handwritten entries into a computer as in clam 28 wherein the computer readable program code means for receiving handwritten entries further comprises:

computer readable program code means for determining whether said handwritten entries are being made in an input area of a touch sensitive screen or in an other area of said touch sensitive screen than said input area; and

computer readable program code means for providing commands responsive to entries in said other area, entries in said input area being received as handwritten entries.