GRAPHICAL KEYBOARD WITH INTEGRATED SEARCH FEATURES

• US 20170308586A1
• Filed: 04/20/2016
• Published: 10/26/2017
• Est. Priority Date: 04/20/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Mohsin, Muhammad, Gupta, Pranay, Burks, Michael
• Granted Patent: US 9,965,530 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/90328 using search space presentation or visualization, e.g. category or range presentation and selection
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

A computing device may include a presence-sensitive display, at least one processor, and a memory storing instructions that, when executed by the at least one processor, cause the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard including a plurality of keys and a suggestion region; determine, based on a selection of the suggestion region or one or more keys from the plurality of keys, a search query; retrieve one or more search results determined based on the search query; and output, in place of at least a portion of the graphical keyboard, a visual representation of a particular search result of the one or more search results.

Claims

1. A method comprising:

outputting, by a computing device, for display, a graphical keyboard comprising a plurality of keys and a suggestion region;

determining, by the computing device, based on a selection of the suggestion region or one or more keys from the plurality of keys, a search query;

retrieving, by the computing device, one or more search results determined based on the search query; and

outputting, by the computing device, in place of at least a portion of the graphical keyboard, a visual representation of a particular search result of the one or more search results.

2. The method of claim 1, wherein retrieving one or more search results determined based on the search query comprises:

transmitting, by the computing device and to a data service, the search query; and

receiving, by the computing device, from the data service, one or more search results determined based on the search query.

3. The method of claim 1, wherein retrieving one or more search results determined based on the search query comprises performing, by the computing device, a search based on the search query to determine the one or more search results.

4. The method of claim 1, further comprising:

determining, by the computing device, based on user input, selection of a predetermined portion of the visual representation of the particular search result; and

automatically, without further user input, inserting, by the computing device, in a text edit region displayed adjacent to the graphical keyboard, information related to the particular search result.

5. The method of claim 4, wherein the predetermined portion comprises a first predetermined portion and the user input comprises a first user input, further comprising:

determining, by the computing device, based on a second user input, selection of a second predetermined portion of the visual representation of the particular search result; and

automatically, without further user input, performing, by the computing device, a predetermined action associated with the second predetermined portion.

6. The method of claim 1, wherein:

the particular search result comprises a first particular search result;

the visual representation comprises a first visual representation; and

the first visual representation comprises a first card-based user interface elements;

the method further comprising;

receiving, by the computing device, an indication of a swipe user input gesture; and

responsive to receiving the indication of the swipe user input gesture, outputting, by the computing device, for display, an animation switching from the first card-based user interface element to a second card-based user interface element that is a second visual representation of a second particular search result of the one or more search results, wherein each of the first card-based user interface element and the second card-based user interface element are displayed in place of at least a portion of the graphical keyboard.

7. The method of claim 1, wherein outputting the visual representation of the particular search result in place of at least a portion of the graphical keyboard comprising outputting a visual representation of the particular search result that replaces at least some keys of the plurality of keys.

8. The method of claim 4, wherein inserting, in the text edit region displayed adjacent to the graphical keyboard, the information related to the particular search result of the at least a portion of the one or more search results comprises inserting, in the text edit region displayed adjacent to the graphical keyboard, a natural language response to the search query.

9. A computing device comprising:

a presence-sensitive display;

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the at least one processor to;

output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and a suggestion region;

determine, based on a selection of the suggestion region or one or more keys from the plurality of keys, a search query;

retrieve one or more search results determined based on the search query; and

output, in place of at least a portion of the graphical keyboard, a visual representation of a particular search result of the one or more search results.

10. The computing device of claim 9, wherein the instructions that, when executed by the at least one processor, cause the at least one processor to retrieve the one or more search results determined based on the search query cause the at least one processor to:

transmit, to a data service, the search query; and

receive, from the data service, one or more search results determined based on the search query.

11. The computing device of claim 9, wherein the instructions that, when executed by the at least one processor, cause the at least one processor to retrieve the one or more search results determined based on the search query cause the at least one processor to perform a search based on the search query to determine the one or more search results.

12. The computing device of claim 9, wherein the memory further comprises instructions that, when executed by the at least one processor, cause the at least one processor to:

determine, based on user input, selection of a predetermined portion of the visual representation of the particular search result; and

automatically, without further user input, insert, in a text edit region displayed adjacent to the graphical keyboard, information related to the particular search result.

13. The computing device of claim 12, wherein:

the predetermined portion comprises a first predetermined portion and the user input comprises a first user input; and

the memory further comprises instructions that, when executed by the at least one processor, cause the at least one processor to;

determine, based on a second user input, selection of a second predetermined portion of the visual representation of the particular search result; and

automatically, without further user input, perform a predetermined action associated with the second predetermined portion.

14. The computing device of claim 9, wherein:

the particular search result comprises a first particular search result;

the visual representation comprises a first visual representation;

the first visual representation comprises a first card-based user interface elements; and

the memory further comprises instructions that, when executed by the at least one processor, cause the at least one processor to;

receive, from the presence-sensitive display, an indication of a swipe user input gesture; and

responsive to receiving the indication of the swipe user input gesture, output, for display at the presence-sensitive display, an animation switching from the first card-based user interface element to a second card-based user interface element that is a second visual representation of a second particular search result of the one or more search results, wherein each of the first card-based user interface element and the second card-based user interface element are displayed in place of at least a portion of the graphical keyboard.

15. The computing device of claim 9, wherein the visual representation of the particular search result replaces at least some keys of the plurality of keys.

16. The computing device of claim 12, wherein the information related to the particular search result comprises a natural language response to the search query.

20. The computer-readable storage medium of claim 16, wherein:

the particular search result comprises a first particular search result;

the visual representation comprises a first visual representation;

the first visual representation comprises a first card-based user interface elements; and

further comprising instructions that, when executed by the at least one processor, cause the at least one processor to;

receive, from the presence-sensitive display, an indication of a swipe user input gesture; and

responsive to receiving the indication of the swipe user input gesture, output, for display at the presence-sensitive display, an animation switching from the first card-based user interface element to a second card-based user interface element that is a second visual representation of a second particular search result of the one or more search results, wherein each of the first card-based user interface element and the second card-based user interface element are displayed in place of at least a portion of the graphical keyboard.

17. A computer-readable storage medium encoded with instructions that, when executed by at least one processor of a computing device, cause the at least one processor to:

output, for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys and a suggestion region;

determine, based on a selection of the suggestion region or one or more keys from the plurality of keys, a search query;

retrieve one or more search results determined based on the search query; and

output, in place of at least a portion of the graphical keyboard, a visual representation of a particular search result of the one or more search results.

18. The computer-readable storage medium of claim 17, further comprising instructions that, when executed by the at least one processor, cause the at least one processor to:

determine, based on user input, selection of a predetermined portion of the visual representation of the particular search result; and

automatically, without further user input, insert, in a text edit region displayed adjacent to the graphical keyboard, information related to the particular search result.

19. The computer-readable storage medium of claim 17, wherein:

the predetermined portion comprises a first predetermined portion and the user input comprises a first user input; and

the memory further comprises instructions that, when executed by the at least one processor, cause the at least one processor to;

determine, based on a second user input, selection of a second predetermined portion of the visual representation of the particular search result; and

automatically, without further user input, perform a predetermined action associated with the second predetermined portion.

21. The computer-readable storage medium of claim 17, wherein the visual representation of the particular search result replaces at least some keys of the plurality of keys.

22. The computer-readable storage medium of claim 18, wherein the information related to the particular search result comprises a natural language response to the search query.