Intuitive Computing Methods and Systems
First Claim
1. A method employing a portable user device having a processor configured to perform one or more acts of the method, the device also including at least one microphone that receives audio, the method comprising the acts:
- applying, to a speech recognition module, audio data corresponding to user speech received by the microphone(s), and receiving recognized user speech data corresponding thereto; and
by reference to said recognized user speech data, inferring one or more signal processing operation(s), or a parameter for a signal processing operation, to be applied in connection with audio received by the microphone(s).
1 Assignment
0 Petitions
Accused Products
Abstract
A smart phone senses audio, imagery, and/or other stimulus from a user'"'"'s environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone'"'"'s camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user'"'"'s apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
987 Citations
37 Claims
-
1. A method employing a portable user device having a processor configured to perform one or more acts of the method, the device also including at least one microphone that receives audio, the method comprising the acts:
-
applying, to a speech recognition module, audio data corresponding to user speech received by the microphone(s), and receiving recognized user speech data corresponding thereto; and by reference to said recognized user speech data, inferring one or more signal processing operation(s), or a parameter for a signal processing operation, to be applied in connection with audio received by the microphone(s). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A method employing a portable user device having a processor configured to perform one or more acts of the method, the device also including at least first and second sensors for receiving, respectively, first and second different types of stimuli from the user'"'"'s environment, the first sensor comprising a microphone for sensing audio stimulus, the method comprising the acts:
-
applying, to a speech recognition module, audio data corresponding to user speech received by the microphone; receiving, from the speech recognition module, recognized verb data corresponding to a verb; by reference to the recognized verb data, determining which of the first or second stimulus types is of interest to the user; receiving, from the speech recognition module, recognized noun data corresponding to a subject in the user'"'"'s environment; and by reference to the recognized noun data, determining one or more signal processing operation(s), or a parameter for a signal processing operation, to be applied in connection with stimulus of the determined type. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A method employing a portable user device having a processor configured to perform one or more acts of the method, the device also including at least first and second sensors for receiving, respectively, first and second different types of stimuli, the method comprising the acts:
-
receiving, at the device, non-tactile user input helping identify a subject in the user'"'"'s environment that is of interest to the user; and by reference to said input indicating a subject of interest, configuring an associated sensor data processing system to extract information associated with that subject. - View Dependent Claims (28, 29)
-
-
30. A method employing a portable user device having a processor configured to perform one or more acts of the method, the device also including at least first and second sensors for receiving, respectively, first and second different types of stimuli from the user'"'"'s environment, the first sensor comprising a microphone for sensing audio stimulus, the method comprising the acts:
-
applying, to a speech recognition module, audio data corresponding to user speech received by the microphone(s), and receiving recognized user speech data corresponding thereto; and by reference to said recognized user speech data, establishing a parameter that defines, at least in part, processing to be applied in connection with the second type of stimulus.
-
-
31. A computer readable physical storage medium containing non-transitory software instructions operative to cause a user device processor programmed by such software instructions to:
-
apply, to a speech recognition module, audio data corresponding to user speech received by the microphone(s), and receive recognized user speech data corresponding thereto; and by reference to said recognized user speech data, establish a parameter that defines, at least in part, processing to be applied in connection with the second type of stimulus. - View Dependent Claims (32)
-
-
33. A smart phone device having at least one microphone that receives audio, and having a processor configured to perform the following acts:
-
apply, to a speech recognition module, audio data corresponding to user speech received by the microphone(s), and receive recognized user speech data corresponding thereto; by reference to said recognized user speech data, establish a parameter that defines, at least in part, processing to be applied in connection with the second type of stimulus; and process the second type of stimulus in accordance with said established parameter.
-
-
34. A method employing a portable device with plural sensors, a processor, and a memory, the processor being involved in the execution of plural recognition agent services, said services taking sensor data as input and producing outputs, the memory comprising a blackboard data structure, the method including:
- granting, to a service, privileges to post, edit or delete data in the blackboard data structure, depending on (a) whether the service is commercial in nature, and/or (b) whether a trust indicia provided from an external provider relating to said service meets a criteria.
- View Dependent Claims (35)
-
36. A portable device with image and audio sensors, a processor and a memory, the memory storing instructions causing the device to perform the following acts:
-
process image data to produce object recognition data; process audio data to produce recognized speech data; and use the object recognition data in connection with resolving an ambiguity in producing the recognized speech data.
-
-
37. A portable device with location and audio sensors, a processor and a memory, the memory storing instructions causing the device to perform the following acts:
-
by reference to data from the location sensor, obtain a location descriptor about the device location; process audio data to produce recognized speech data; and use the location descriptor in connection with resolving an ambiguity in producing the recognized speech data.
-
Specification