Answering questions using environmental context
First Claim
Patent Images
1. A computer-implemented method comprising:
- generating, by a mobile device, an audio recording of (i) a question about an unidentified item of media content that a different device is playing in a vicinity of the mobile device, and (ii) environmental audio;
in response to forwarding the audio recording to a front end server of a natural language processing system, receiving an answer to the question that is based on processing different portions of the audio recording by a speech recognition engine server associated with the natural language processing system and a content identification engine server associated with the natural language processing system; and
in response to the question, providing, by the mobile device, the answer to the question about the unidentified item of media content.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving audio data encoding an utterance and environmental data, obtaining a transcription of the utterance, identifying an entity using the environmental data, submitting a query to a natural language query processing engine, wherein the query includes at least a portion of the transcription and data that identifies the entity, and obtaining one or more results of the query.
101 Citations
20 Claims
-
1. A computer-implemented method comprising:
-
generating, by a mobile device, an audio recording of (i) a question about an unidentified item of media content that a different device is playing in a vicinity of the mobile device, and (ii) environmental audio; in response to forwarding the audio recording to a front end server of a natural language processing system, receiving an answer to the question that is based on processing different portions of the audio recording by a speech recognition engine server associated with the natural language processing system and a content identification engine server associated with the natural language processing system; and in response to the question, providing, by the mobile device, the answer to the question about the unidentified item of media content. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising; generating, by a mobile device, an audio recording of (i) a question about an unidentified item of media content that a different device is playing in a vicinity of the mobile device, and (ii) environmental audio; in response to forwarding the audio recording to a front end server of a natural language processing system, receiving an answer to the question that is based on processing different portions of the audio recording by a speech recognition engine server associated with the natural language processing system and a content identification engine server associated with the natural language processing system; and in response to the question, providing, by the mobile device, the answer to the question about the unidentified item of media content. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
17. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
-
generating an audio recording of (i) a question about an unidentified item of media content that a different device is playing in a vicinity of a mobile device, and (ii) environmental audio; in response to forwarding the audio to a front end server of a natural language processing system, receiving an answer to the question that is based on processing different portions of the audio recording by a speech recognition engine server associated with the natural language processing system and a content identification engine server associated with the natural language processing system; and in response to the question, providing the answer to the question about the unidentified item of media content. - View Dependent Claims (18, 19, 20)
-
Specification