ADAPTABLE IMAGE SEARCH WITH COMPUTER VISION ASSISTANCE
First Claim
1. A computing device having adaptable image search, the computing device comprising:
- non-volatile memory configured to store a plurality of image recognition models;
an image recognition program executed by a processor of the computing device and configured to;
receive a query from a user, the query comprising text that is typed or converted from speech;
receive a target image within which a search based on the query is to be performed;
rank the image recognition models by confidence level for performing the search based on the query within the target image;
determine whether any of the image recognition models is above a confidence threshold for performing the search locally on the processor of the computing device; and
upon determining that at least one of the image recognition models is above the confidence threshold,select at least one highly ranked image recognition model;
perform the search within the target image for a target region of the target image using at least one selected image recognition model; and
return a search result to the user.
3 Assignments
0 Petitions
Accused Products
Abstract
A computing device having adaptable image search and methods for operating an image recognition program on the computing device are disclosed herein. An image recognition program may receive a query from a user and a target image within which a search based on the query is to be performed using one or more of a plurality of locally stored image recognition models, which are determined to be able to perform the search with sufficiently high confidence. The query may comprise text that is typed or converted from speech. The image recognition program performs the search within the target image for a target region of the target image using at least one selected image recognition model stored locally, and returns a search result to the user.
-
Citations
20 Claims
-
1. A computing device having adaptable image search, the computing device comprising:
-
non-volatile memory configured to store a plurality of image recognition models; an image recognition program executed by a processor of the computing device and configured to; receive a query from a user, the query comprising text that is typed or converted from speech; receive a target image within which a search based on the query is to be performed; rank the image recognition models by confidence level for performing the search based on the query within the target image; determine whether any of the image recognition models is above a confidence threshold for performing the search locally on the processor of the computing device; and upon determining that at least one of the image recognition models is above the confidence threshold, select at least one highly ranked image recognition model; perform the search within the target image for a target region of the target image using at least one selected image recognition model; and return a search result to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for operating an image recognition program on a computing device having adaptable image search, the method comprising:
-
receiving a query from a user, the query comprising text that is typed or converted from speech; receiving a target image within which a search based on the query is to be performed; ranking a plurality of image recognition models by confidence level for performing the search based on the query within the target image, wherein the image recognition models are stored in non-volatile memory of the computing device; determining whether any of the image recognition models is above a confidence threshold for performing the search locally on a processor of the computing device; and upon determining that at least one of the image recognition models is above the confidence threshold, selecting at least one highly ranked image recognition model; performing the search within the target image for a target region of the target image using at least one selected image recognition model; and returning a search result to the user. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A computing device having adaptable image search, the computing device comprising:
-
non-volatile memory configured to store a plurality of image recognition models; a camera, wherein a target image is captured by the camera and wherein the target image is a single image or one or a plurality of image frames that constitute a portion of video; a head-up display; and an image recognition program executed by a processor of the computing device and configured to; receive a query from a user, the query comprising text that is typed or converted from speech; receive the target image within which a search based on the query is to be performed; rank the image recognition models by confidence level for performing the search based on the query within the target image; determine whether any of the image recognition models is above a confidence threshold for performing the search locally on the processor of the computing device; and upon determining that at least one of the image recognition models is above the confidence threshold, select at least one highly ranked image recognition model; perform the search within the target image for a target region of the target image using at least one selected image recognition model; return a search result to the user; and display the search result on the head-up display.
-
Specification