VOICE DIRECTED CONTEXT SENSITIVE VISUAL SEARCH
First Claim
1. A method of searching, comprising:
- receiving a voice directed query related to visual content rendered on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image;
identifying contextual information pertaining to the visual content rendered on the display;
causing a processor to detect an object from the visual content based on at least one of a search word from the voice directed query or the contextual information, wherein the object is a part of the visual content;
performing a search using the object detected from the visual content; and
rendering a result of the search on the display.
2 Assignments
0 Petitions
Accused Products
Abstract
Various technologies described herein pertain to voice directed context sensitive visual searching. Visual content can be rendered on a display, and a voice directed query related to the visual content can be received. Contextual information related to the visual content can also be identified. Moreover, a search word recognized from the voice directed query and/or the contextual information can be used to detect an object from the visual content, where the object can be a part of the visual content. Further, a search can be performed using the object detected from the visual content, and a result of the search can be rendered on the display.
-
Citations
22 Claims
-
1. A method of searching, comprising:
-
receiving a voice directed query related to visual content rendered on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image; identifying contextual information pertaining to the visual content rendered on the display; causing a processor to detect an object from the visual content based on at least one of a search word from the voice directed query or the contextual information, wherein the object is a part of the visual content; performing a search using the object detected from the visual content; and rendering a result of the search on the display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13)
-
-
12. (canceled)
-
14. A system that performs a visual search, comprising:
-
a processor; and a memory that comprises a plurality of components that are executed by the processor, the plurality of components comprising; a context identification component that recognizes contextual information related to at least one of visual content rendered on a display or a voice directed query related to the visual content, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image; an object detection component that detects an object from the visual content based on one or more of a search word recognized from the voice directed query or the contextual information, wherein the object is part of the visual content; and a search component that performs a search using the object detected from the visual content to generate a result. - View Dependent Claims (15, 16, 17, 18, 19)
-
-
20. (canceled)
-
21. A computer-readable storage medium including computer-executable instructions that, when executed by a processor, cause the processor to perform acts including:
-
rendering visual content on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image; receiving a voice directed query related to the visual content rendered on the display, wherein the voice directed query comprises at least a search word; recognizing contextual information related to the visual content rendered on the display; performing a first search using at least one of the search word from the voice directed query or the contextual information; detecting an object from the visual content as a function of a first result of the first search, wherein the object is a part of the visual content; performing a second search using the object detected from the visual content; and rendering a second result of the second search on the display. - View Dependent Claims (22)
-
Specification