Method and system for message and note composition on small screen devices

• US 7,567,239 B2
• Filed: 06/26/2003
• Issued: 07/28/2009
• Est. Priority Date: 06/26/2003
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Seni, Giovanni
• Primary Examiner(s): Lefkowitz; Sumati
• Assistant Examiner(s): BODDIE, WILLIAM
• Application Number:
  US10/606,423
• Publication Number:
  US 20040263486A1
• Time in Patent Office: 2,224 Days
• Field of Search: 345/173, 345/179, 382/189, 715/539
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method and system for written input and subsequent display of said written input of an electronic device (100). The electronic device (100) has a touch input screen (104), said touch input screen operable to accept written input, a display element (105), said display element (105) operable to display one or more of recognized text and digital ink. The recognized text is determined from the written input using a recognition feature coupled to the touch input screen (104) while the digital ink corresponds to the written input. The digital ink may be edited by the user. A scrolling mechanism is coupled to the touch input screen (104) that enables at least a portion of the touch input screen (104) to appear to move as written entries are input thereon so as to continuously present screen space on the touch input screen (104) to the user for written input.

Claims

1. A handwritten input user interface (HIUI) for a portable device having a touch-enabled input screen, the HIUI comprising:

a handwriting input area residing in a predetermined portion of the touch-enabled input screen, handwritten text being entered using a stylus;

an input/display scrolling window in the handwriting input area, written entries being scrolled such that writing space is continuously available within the handwriting input area; and

a display area operable to display recognized text in a text recognition mode and handwritten input as digital ink, corresponding to the handwritten input entered in the handwriting input area without the requirement of converting the handwritten input to text using a recognition element, in an ink-only mode;

wherein a word separator is displayed in the handwritten input area to the right of words being entered, entries to the right of the word separator indicating start of a next word.

2. A method of providing written input to an electronic device, the method comprising:

receiving an entry from a written-entry screen area;

displaying a corresponding digital ink stroke in the written-entry screen area;

shifting each displayed digital ink stroke horizontally at a rate corresponding to an ink stroke rate of the digital ink, whereby written entries appear to be scrolling off one side of a display as on a ticker tape; and

displaying the written entries in a display area, wherein displaying the written entries in the display area comprises;

passing the received entry to a handwriting recognition engine, the handwriting recognition engine converting the received entry to text, and displaying text in a textual display area in a text-recognition mode; and

converting the written entries to digital ink and displaying the digital ink in the textual display area in an ink-only mode;

wherein shifting displayed digital ink strokes includes displaying a word separator indicating a point on the written-entry screen area designating demarcation between continuation of a current word and initiation of a next word.

3. A method as in claim 2, wherein the word separator scrolls with a written entry when written input is determined to have paused.

4. A method of providing written input to an electronic device, the method comprising:

receiving an entry from a written-entry screen area;

displaying a corresponding digital ink stroke in the written-entry screen area;

shifting each displayed digital ink stroke horizontally at a rate corresponding to an ink stroke rate of the digital ink, whereby written entries appear to be scrolling off one side of a display as on a ticker tape; and

displaying the written entries in a display area, wherein displaying the written entries in the display area comprises;

passing the received entry to a handwriting recognition engine, the handwriting recognition engine converting the received entry to text, and displaying text in a textual display area in a text-recognition mode; and

converting the written entries to digital ink and displaying the digital ink in the textual display area in an ink-only mode;

wherein a user can draw without having the input area scroll by;

entering a pause mode by pressing a user interface button, the pause mode operable to prevent an input screen from scrolling;

drawing within the input screen; and

exiting pause mode whereby what was drawn is placed in the display area.

5. An electronic device for handwritten input and subsequent display of the handwritten input, the electronic device functionally comprising:

a user interface having an ink-text canvas and a conveyor canvas;

one or more ink-text areas coupled to the ink-text canvas;

a conveyor area coupled to the one or more ink-text areas and coupled to the user interface, the conveyor area comprising one or more ink traces;

an event loop of the user interface, the event loop operable to respond to pen-down events, pen-up events, pen-move events, and pen-timeout events,

wherein upon an occurrence of a pen-timeout event in an ink-only mode, one or more ink traces are sent to an ink processor for display without converting the one or more ink traces to text using a recognition element;

wherein upon an occurrence of a pen-down event;

if a trace is already present and the trace has substantially fallen off an edge of the conveyor area, then sending the trace to the ink-text canvas for display, deleting the trace from the conveyor area, ensuring scrolling, cancelling any pending timeout events, and adding an ink point to the conveyor area;

if a trace is already present and the trace is not falling off an edge of the conveyor area, then ensuring scrolling, cancelling any pending timeout events, and adding an ink point to the conveyor area; and

if a trace is not present, then ensuring scrolling, cancelling any pending timeout events, and adding an ink point to the conveyor area.

6. An electronic device for handwritten input and subsequent display of the handwritten input, the electronic device functionally comprising:

a user interface having an ink-text canvas and a conveyor canvas;

one or more ink-text areas coupled to the ink-text canvas;

a conveyor area coupled to the one or more ink-text areas and coupled to the user interface, the conveyor area comprising one or more ink traces;

an event loop of the user interface, the event loop operable to respond to pen-down events, pen-up events, pen-move events, and pen-timeout events,

wherein upon an occurrence of a pen-timeout event in an ink-only mode, one or more ink traces are sent to an ink processor for display without converting the one or more ink traces to text using a recognition element;

wherein upon an occurrence of a pen-timeout event, any pending timeouts are canceled, one or more ink traces are sent to the ink processor for display, the one or more ink traces are deleted from the conveyor area, and scrolling of the conveyor area is stopped.

7. The electronic device of claim 6 wherein the ink processor displays the one or more ink traces in the ink-text canvas.

8. The electronic device of claim 6 wherein display of the one or more ink traces further comprises scaling and segmenting the handwritten input into lines so that it can be displayed vertically in the ink-text canvas.