Non-textual user input

• US 8,935,638 B2
• Filed: 10/11/2012
• Issued: 01/13/2015
• Est. Priority Date: 10/11/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Steiner, Thomas, Brousseau, Arnaud
• Primary Examiner(s): ALVESTEFFER, STEPHEN D
• Application Number:
  US13/649,956
• Publication Number:
  US 20140108976A1
• Time in Patent Office: 824 Days
• Field of Search: None
• US Class Current: 715/866
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/387 using human interaction, e.g. selection of the best displayed recognition candidate

Abstract

A computing device receives a first user input at presence-sensitive display of the computing device, wherein the first user input corresponds to a portion of a desired non-textual object. The device displays a first graphical representation indicating the first user input at the touchscreen display, and determines a first non-textual object suggestion based upon at least the first user input. The device displays a second graphical representation indicating the first non-textual object suggestion, wherein the second graphical representation of the first non-textual object suggestion is displayed differently than the first graphical representation of the first user input, and detects an indication whether the first non-textual object suggestion corresponds to the desired non-textual object.

Claims

1. A method, comprising:

receiving, by a computing device, an indication of a user input received at a presence-sensitive input device, wherein the user input corresponds to a portion of a desired non-textual object;

determining, by the computing device, based at least in part on the user input, a non-textual object suggestion;

outputting, by the computing device, for display, a graphical representation of the user input and the non-textual object suggestion, the non-textual object suggestion having a property that visibly indicates that the non-textual object suggestion is not a completed object;

receiving, by the computing device, an indication of whether the non-textual object suggestion corresponds to the desired non-textual object; and

in response to determining that the indication indicates that the non-textual object suggestion corresponds to the desired non-textual object;

outputting, by the computing device, for display, the non-textual object suggestion as the completed object; and

removing, by the computing device, from display, the graphical representation of the user input.

2. The method of claim 1, wherein determining the non-textual object suggestion further comprises:

comparing, by the computing device, the graphical representation of the user input to a plurality of non-textual objects;

ranking, by the computing device, the plurality of non-textual objects based at least on the comparison of the graphical representation of the user input to the plurality of non-textual objects; and

selecting, by the computing device, based at least in part on the ranking of the plurality of non-textual objects, a particular non-textual object from the plurality of non-textual objects as the non-textual object suggestion.

3. The method of claim 2, wherein for each respective non-textual object from the plurality of non-textual objects, a rank of the respective non-textual object is based at least in part on how closely the graphical representation of the user input matches a portion of the respective non-textual object.

4. The method of claim 2, wherein for each respective non-textual object from the plurality of non-textual objects, a rank of the respective non-textual object is based on at least one of:

congruency between the graphical representation of the user input and a portion of the respective non-textual object, a percentage of the respective non-textual object that matches the graphical representation of the user input, a frequency of the respective non-textual object being selected when indications of user input are received, and an order associated with the user input.

5. The method of claim 1, wherein receiving the indication of whether the non-textual object suggestion corresponds to the desired non-textual object comprises:

further includes;

receiving, by the computing device, an indication that the non-textual object suggestion corresponds to the desired non-textual object.

6. The method of claim 5, wherein receiving the indication that the non-textual object suggestion corresponds to the desired non-textual object comprises:

receiving, by the computing device, an indication of an acceptance gesture at a defined area of the presence-sensitive input device.

7. The method of claim 5, wherein further comprising:

determining, by the computing device, that the indication indicates that the non-textual object suggestion corresponds to the desired non-textual object when a user has stopped drawing.

8. The method of claim 1, wherein outputting the non-textual object suggestion as the completed object comprises:

outputting, by the computing device, for display, an altered version of the non-textual object suggestion.

9. The method of claim 8, wherein the altered version of the non-textual object suggestion emphasizes the non-textual object suggestion.

10. The method of claim 9, wherein the method further comprises:

in response to receiving an indication that the non-textual object suggestion corresponds to the desired non-textual object, outputting, by the computing device, for display, options for a user to alter characteristics of the completed object, wherein the characteristics include at least one of color, shading, size, and visual effects.

11. The method of claim 1, further comprising determining, by the computing device, that the indication indicates that the non-textual object suggestion does not correspond to the desired non-textual object when the indication comprises a swipe gesture across the presence-sensitive input device.

12. The method of claim 1, further comprising determining, by the computing device, that the indication indicates that the non-textual object suggestion does not correspond to the desired non-textual object when the indication comprises an indication of a shaking of the computing device.

13. The method of claim 1, wherein:

the user input is a first user input; and

the method further comprising determining, by the computing device, that the indication indicates that the non-textual object suggestion does not correspond to the desired non-textual object when the computing device receives an indication of a second user input that deviates from the non-textual object suggestion.

14. The method of claim 1, wherein receiving the indication of whether the non-textual object suggestion corresponds to the desired non-textual object comprises:

determining, by the computing device, whether an acceptance event has been detected within a time period; and

responsive to determining that the acceptance event has not occurred within the time period, determining, by the computing device, that the non-textual object suggestion does not correspond to the desired non-textual object.

15. The method of claim 1, wherein:

the non-textual object suggestion is a first non-textual object suggestion, and

the method further comprises;

determining, by the computing device, a second non-textual object suggestion based on the user input; and

outputting, by the computing device, for display, a graphical representation of the second non-textual object suggestion, wherein the graphical representation of the second non-textual object suggestion is deemphasized compared to the graphical representation of the user input.

16. A non-transitory machine-readable medium with instructions stored thereon, the instructions, when executed, are operable to cause a computerized system to:

determine, based at least in part on user input received at a presence-sensitive input device, a non-textual object suggestion, wherein the user input corresponds to a portion of a desired non-textual object;

output, for display, a graphical representation of the user input and the non-textual object suggestion, the non-textual object suggestion having a property that visibly indicates that the non-textual object suggestion is not a completed object;

in response to receiving an indication that the non-textual object suggestion corresponds to the desired non-textual object;

output, for display, the non-textual object suggestion as the completed object; and

remove, from display, the graphical representation of the user input.

17. A computing device comprising one or more processors and one or more computer-readable storage media encoded with instructions that, when executed by the one or more processors, cause to computing device to:

determine, based at least in part on user input received at a presence-sensitive input device, a non-textual object suggestion, wherein the user input corresponds to a portion of a desired non-textual object;

output, for display, a graphical representation of the user input and the non-textual object suggestion, the non-textual object suggestion having a property that visibly indicates that the non-textual object suggestion is not a completed object;

in response to receiving an indication that the non-textual object suggestion corresponds to the desired non-textual object;

output, for display, the non-textual object as the completed object; and

remove, from display, the graphical representation of the user input.