Sensor-Based Mobile Search, Related Methods and Systems
0 Assignments
0 Petitions
Accused Products
Abstract
A smart phone senses audio, imagery, and/or other stimulus from a user'"'"'s environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone'"'"'s camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user'"'"'s apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
84 Citations
49 Claims
-
1-28. -28. (canceled)
-
29. A method comprising:
-
receiving image data corresponding to imagery captured by a camera in a portable device, the imagery including regions of different luminance; processing the received image data with at least first, second and third different baseline image processing operations, to thereby produce at least first, second and third different sets of processed data derived from the image data, said processing being performed by one or more processors in said portable device configured to perform such acts; opportunistically identifying, from a set of plural additional image processing operations, a smaller subset of one or more further image processing operations that should be automatically invoked, based at least in part on said processed data, at least one of the identified further processing operations having a computational cost greater than each of the first, second and third baseline image processing operations; and taking an action based on performance of said further image processing; wherein a first further image processing operation is invoked if said baseline processing operations yield first results, and a second, different, further image processing operation is invoked if said baseline processing operations yield second, different, results; and processing resources are not consumed attempting a further image processing operation that is not merited by the availability of appropriate input data. - View Dependent Claims (30, 31, 32, 33, 34, 35, 36, 37, 38)
-
-
39. An article of manufacture including a computer-readable medium having instructions stored thereon that, if executed by a computing device, cause the computing device to perform operations comprising:
-
receiving image data corresponding to imagery, the imagery including regions of different luminance; processing the received image data with at least first, second and third different baseline image processing operations, to thereby produce at least first, second and third different sets of processed data derived from the image data; opportunistically identifying, from a set of plural additional image processing operations, a smaller subset of one or more further image processing operations that should be automatically invoked, based at least in part on said processed data, at least one of the identified further processing operations having a computational cost greater than each of the first, second and third baseline image processing operations; and taking an action based on performance of said further image processing; wherein a first further image processing operation is invoked if said baseline processing operations yield first results, and a second, different, further image processing operation is invoked if said baseline processing operations yield second, different, results; and processing resources are not consumed attempting a further image processing operation that is not merited by the availability of appropriate input data.
-
-
40. A method comprising:
-
receiving a set of image data corresponding to imagery captured by a camera in a portable device, the imagery including regions of different luminance; processing the received image data with at least first, second and third different initial image processing operations, to thereby produce at least first, second and third different sets of processed data derived from the image data, said processing being performed by one or more processors in said portable device configured to perform such acts; based at least in part on said processed data, launching a further process; making an assessment concerning an output of the further process; and allocating resources to said further process in an amount based, at least in part, on said assessment. - View Dependent Claims (41, 42, 43, 44, 45, 46, 47, 48)
-
-
49. An article of manufacture including a computer-readable medium having instructions stored thereon that, if executed by a computing device, cause the computing device to perform operations comprising:
-
receiving image data corresponding to imagery, the imagery including regions of different luminance; processing the received image data with at least first, second and third different initial image processing operations, to thereby produce at least first, second and third different sets of processed data derived from the image data; based at least in part on said processed data, launching a further process; making an assessment concerning an output of the further process; and allocating resources to said further process in an amount based, at least in part, on said assessment.
-
Specification