Gesture-based search

• US 8,478,777 B2
• Filed: 10/25/2011
• Issued: 07/02/2013
• Est. Priority Date: 10/25/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Li, Yang, Ting, Leo Chiow-Fuan, Ueyama, Rui, Chang, Lawrence, An, Younghun
• Primary Examiner(s): VU, BAI DUC
• Application Number:
  US13/280,582
• Publication Number:
  US 20130103712A1
• Time in Patent Office: 616 Days
• Field of Search: None
• US Class Current: 707/769
• CPC Class Codes: G06F 16/332 Query formulation
• CPC Class Codes: G06F 16/9032 Query formulation
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

In general, the subject matter described in this specification can be embodied in methods, systems, and program products for performing searches with gesture-based input. A search system receives gesture data corresponding to one or more characters that have been drawn on a display of a client device. The search system recognizes the one or more characters that correspond to the gesture data. The search system formulates a search that includes the one or more characters as a query term. The search system communicates to the client device one or more search results for the search, and data identifying the one or more characters.

Claims

1. A computer-implemented method comprising:

receiving, by a search system, (i) a pixel map corresponding to one or more characters that have been drawn on a display of a client device and (ii) data identifying one or more other characters that were previously recognized by the search system using one or more other pixel maps;

recognizing, by the search system, the one or more characters that correspond to the pixel map based on the received pixel map and the one or more other characters;

formulating, by the search system, a search that includes the one or more characters and the one or more other characters as a query term; and

communicating, by the search system, (i) one or more search results for the search, (ii) data identifying the one or more characters that correspond to the received pixel map, and (iii) data identifying the one or more other characters to the client device that were previously recognized by the search system using the one or more other pixel maps.

2. The method of claim 1, wherein the pixel map is received before a user of the client device initiates the search.

3. The method of claim 1, wherein the pixel map (i) identifies points on the display on which the one or more characters were drawn, and (ii) specifies a sequence in which the points on the display were drawn.

4. The method of claim 1, wherein the search comprises an instant search.

5. The method of claim 1, wherein the search comprises an image search.

6. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

receiving, by a search system, (i) a pixel map corresponding to one or more characters that have been drawn on a display of a client device and (ii) data identifying one or more other characters that were previously recognized by the search system using one or more other pixel maps;

recognizing, by the search system, the one or more characters that correspond to the pixel map based on the received pixel map and the one or more other characters;

formulating, by the search system, a search that includes the one or more characters and the one or more other characters as a query term; and

communicating, by the search system, (i) one or more search results for the search, (ii) data identifying the one or more characters that correspond to the received pixel map, and (iii) data identifying the one or more other characters to the client device that were previously recognized by the search system using the one or more other pixel maps.

7. The system of claim 6, wherein the pixel map is received before a user of the client device initiates the search.

8. The system of claim 6, wherein the pixel map (i) identifies points on the display on which the one or more characters were drawn, and (ii) specifies a sequence in which the points on the display were drawn.

9. The system of claim 6, wherein the search comprises an instant search.

10. The system of claim 6, wherein the search comprises an image search.

11. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers, which, upon such execution, cause the one or more computers to perform operations comprising:

receiving, by a search system, (i) a pixel map corresponding to one or more characters that have been drawn on a display of a client device and (ii) data identifying one or more other characters that were previously recognized by the search system using one or more other pixel maps;

recognizing, by the search system, the one or more characters that correspond to the pixel map based on the received pixel map and the one or more other characters;

formulating, by the search system, a search that includes the one or more characters and the one or more other characters as a query term; and

communicating, by the search system, (i) one or more search results for the search, (ii) data identifying the one or more characters that correspond to the received pixel map, and (iii) data identifying the one or more other characters to the client device that were previously recognized by the search system using the one or more other pixel maps.

12. The computer-readable medium of claim 11, wherein the pixel map is received before a user of the client device initiates the search.

13. The computer-readable medium of claim 11, wherein the pixel map (i) identifies points on the display on which the one or more characters were drawn, and (ii) specifies a sequence in which the points on the display were drawn.

14. The computer-readable medium of claim 11, wherein the search comprises an instant search.

15. The computer-readable medium of claim 11, wherein the search comprises an image search.