Architecture for responding to a visual query
First Claim
1. A computer-implemented method of processing a visual query comprising:
- at a server system having one or more processors and memory storing one or more programs for execution by the one or more processors;
receiving a visual query from a client system;
processing the visual query by sending the visual query to a plurality of parallel search systems for simultaneous processing, wherein ones of the plurality of search systems implement a respective visual query search process of a plurality of visual query search processes, wherein the plurality of visual query search processes includes at least;
optical character recognition (OCR), facial recognition, and a first query-by-image process other than OCR and facial recognition;
receiving a plurality of search results from one or more of the plurality of parallel search systems; and
sending at least one of the plurality of search results to the client system.
2 Assignments
0 Petitions
Accused Products
Abstract
A visual query such as a photograph, a screen shot, a scanned image, a video frame, or an image created by a content authoring application is submitted to a visual query search system. The search system processes the visual query by sending it to a plurality of parallel search systems, each implementing a distinct visual query search process. These parallel search systems may include but are not limited to optical character recognition (OCR), facial recognition, product recognition, bar code recognition, object-or-object-category recognition, named entity recognition, and color recognition. Then at least one search result is sent to the client system. In some embodiments, when the visual query is an image containing a text element and a non-text element, at least one search result includes an optical character recognition result for the text element and at least one image-match result for the non-text element.
-
Citations
24 Claims
-
1. A computer-implemented method of processing a visual query comprising:
-
at a server system having one or more processors and memory storing one or more programs for execution by the one or more processors; receiving a visual query from a client system; processing the visual query by sending the visual query to a plurality of parallel search systems for simultaneous processing, wherein ones of the plurality of search systems implement a respective visual query search process of a plurality of visual query search processes, wherein the plurality of visual query search processes includes at least;
optical character recognition (OCR), facial recognition, and a first query-by-image process other than OCR and facial recognition;receiving a plurality of search results from one or more of the plurality of parallel search systems; and sending at least one of the plurality of search results to the client system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A search engine system, for processing a visual query, comprising:
-
one or more central processing units for executing programs; memory storing one or more programs to be executed by the one or more central processing units; the one or more programs comprising instructions for; receiving a visual query from a client system; processing the visual query by sending the visual query to a plurality of parallel search systems for simultaneous processing, wherein ones of the plurality of search systems implement a respective visual query search process of a plurality of visual query search processes, wherein the plurality of visual query search processes includes at least;
optical character recognition (OCR), facial recognition, and a first query-by-image process other than OCR and facial recognition;receiving a plurality of search results from one or more of the plurality of parallel search systems; and sending at least one of the plurality of search results to the client system. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A non-transitory computer readable storage medium for processing a visual query storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:
-
receiving a visual query from a client system; processing the visual query by sending the visual query to a plurality of parallel search systems for simultaneous processing, wherein ones of the plurality of search systems implement a respective visual query search process of a plurality of visual query search processes, wherein the plurality of visual query search processes includes at least;
optical character recognition (OCR), facial recognition, and a first query-by-image process other than OCR and facial recognition;receiving a plurality of search results from one or more of the plurality of parallel search systems; and sending at least one of the plurality of search results to the client system. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
Specification