Context-awareness through biased on-device image classifiers
First Claim
1. A computer-implemented method for classifying one or more images, the method comprising executing on one or more computing devices the operations of:
- configuring an image classifier executable on a computing device based in part on at least one of a power requirement of a specific application, a performance requirement of the application, power available to the computing device, and computational resources available at the computing device;
receiving a plurality of different images generated by the application for processing at the image classifier;
extracting one or more features from each of the plurality of different images;
based on the extracted features, classifying the plurality of different images into a first set including a plurality of first images and a second set including a plurality of second images, one or more images of the plurality of first images being false positives, the number of false positive images being based in part on the configuration of the image classifier; and
transmitting the plurality of first images and none of the plurality of second images from the computing device to a remote device, wherein the remote device is configured to process the one or more images of the plurality of first images including;
recognizing the one or more extracted features including arbitrary objects, understanding the one or more images by applying an image-understanding algorithm to the one or more images based on the recognition of the arbitrary objects, and generating one or more actionable items based on the understanding, wherein the one or more actionable items comprise a navigational aid to enable a user to detect and avoid obstacles.
1 Assignment
0 Petitions
Accused Products
Abstract
Examples of the disclosure enable efficient processing of images. One or more features are extracted from a plurality of images. Based on the extracted features, the plurality of images are classified into a first set including a plurality of first images and a second set including a plurality of second images. One or more images of the plurality of first images are false positives. The plurality of first images and none of the plurality of second images are transmitted to a remote device. The remote device is configured to process one or more images including recognizing the extracted features, understanding the images, and/or generating one or more actionable items. Aspects of the disclosure facilitate conserving memory at a local device, reducing processor load or an amount of energy consumed at the local device, and/or reducing network bandwidth usage between the local device and the remote device.
73 Citations
20 Claims
-
1. A computer-implemented method for classifying one or more images, the method comprising executing on one or more computing devices the operations of:
-
configuring an image classifier executable on a computing device based in part on at least one of a power requirement of a specific application, a performance requirement of the application, power available to the computing device, and computational resources available at the computing device; receiving a plurality of different images generated by the application for processing at the image classifier; extracting one or more features from each of the plurality of different images; based on the extracted features, classifying the plurality of different images into a first set including a plurality of first images and a second set including a plurality of second images, one or more images of the plurality of first images being false positives, the number of false positive images being based in part on the configuration of the image classifier; and transmitting the plurality of first images and none of the plurality of second images from the computing device to a remote device, wherein the remote device is configured to process the one or more images of the plurality of first images including;
recognizing the one or more extracted features including arbitrary objects, understanding the one or more images by applying an image-understanding algorithm to the one or more images based on the recognition of the arbitrary objects, and generating one or more actionable items based on the understanding, wherein the one or more actionable items comprise a navigational aid to enable a user to detect and avoid obstacles. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A mobile device comprising:
-
a sensor module configured to capture data corresponding to a plurality of different images, one or more images of the plurality of different images associated with an object; a memory area storing computer-executable instructions for classifying the plurality of different images; and a processor configured to execute the computer-executable instructions to; configure an image classifier based in part on at least one of a power requirement of a specific application, a performance requirement of the application, power available to the mobile device, and computational resources available at the mobile device; determine, at the image classifier, whether a first image of the plurality of different images associated with the application is associated with the object, the image classifier being biased towards determining that the first image is associated with the object, wherein the extent of the biasing is based on the configuration of the image classifier; and transmit the first image from the computing device to a remote device configured to process the first image including recognizing extracted features including arbitrary objects, understanding the images by applying an image-understanding algorithm to the first image based on the recognition of the arbitrary objects, and generating one or more actionable items, the one or more actionable items comprise a navigational aid to enable a user to detect and avoid obstacles. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computing device comprising:
-
an image sensor configured to capture data corresponding to a plurality of different images, one or more images of the plurality of different images associated with an object; an image classifier configured based in part on at least one of a power requirement of a specific application, a performance requirement of the application, power available to the computing device, and computational resources available at the computing device to; classify the plurality of different images associated with the application into a first set including a plurality of first images and a second set including a plurality of second images, one or more images of the plurality of first images being false positives, the number of false positives being based in part on the configuration of the image classifier, and transmit the plurality of first images and none of the plurality of second images from the computing device to a remote device, the remote device configured to process one or more images including recognizing one or more features including arbitrary objects, understanding the images by applying an image-understanding algorithm to the one or more images based on the recognition of the arbitrary objects, and generating one or more actionable items, the one or more actionable items comprise a navigational aid to enable a user to detect and avoid obstacles. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification