Voice directed context sensitive visual search
First Claim
Patent Images
1. A method of searching, comprising:
- receiving a voice directed query related to visual content rendered on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image;
causing a processor to detect an object from the visual content based on a search word from the voice directed query;
selecting an edge detection algorithm from a set of edge detection algorithms based on at least one of the visual content, the search word from the voice directed query, or contextual information;
extracting an image of the object from the visual content based on the search word from the voice directed query, the image of the object being extracted from the visual content using the edge detection algorithm selected from the set of edge detection algorithms, wherein the image of the object is a portion of the visual content and is extracted from a remainder of the visual content;
using the image of the object extracted from the visual content as an input for a reverse visual search, wherein the reverse visual search is executed based upon the image of the object extracted from the visual content, and wherein the reverse visual search returns a result; and
rendering the result of the reverse visual search on the display.
2 Assignments
0 Petitions
Accused Products
Abstract
Various technologies described herein pertain to voice directed context sensitive visual searching. Visual content can be rendered on a display, and a voice directed query related to the visual content can be received. Contextual information related to the visual content can also be identified. Moreover, a search word recognized from the voice directed query and/or the contextual information can be used to detect an object from the visual content, where the object can be a part of the visual content. Further, a search can be performed using the object detected from the visual content, and a result of the search can be rendered on the display.
-
Citations
19 Claims
-
1. A method of searching, comprising:
-
receiving a voice directed query related to visual content rendered on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image; causing a processor to detect an object from the visual content based on a search word from the voice directed query; selecting an edge detection algorithm from a set of edge detection algorithms based on at least one of the visual content, the search word from the voice directed query, or contextual information; extracting an image of the object from the visual content based on the search word from the voice directed query, the image of the object being extracted from the visual content using the edge detection algorithm selected from the set of edge detection algorithms, wherein the image of the object is a portion of the visual content and is extracted from a remainder of the visual content; using the image of the object extracted from the visual content as an input for a reverse visual search, wherein the reverse visual search is executed based upon the image of the object extracted from the visual content, and wherein the reverse visual search returns a result; and rendering the result of the reverse visual search on the display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system that performs a visual search, comprising:
-
a processor; and a memory that comprises a plurality of components that are executed by the processor, the plurality of components comprising; an object detection component that detects an object from visual content rendered on a display based on a search word recognized from a voice directed query related to the visual content, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image; an algorithm selection component that selects an edge detection algorithm from a set of edge detection algorithms based on at least one of the visual content, the search word from the voice directed query, or contextual information; an extraction component that extracts an image of the object from the visual content using the edge detection algorithm selected from the set of edge detection algorithms, wherein the image of the object is a portion of the visual content and is extracted from a remainder of the visual content; and a search component that uses the image of the object extracted from the visual content as an input for a reverse visual search, wherein the reverse visual search is performed based upon the image of the object extracted from the visual content, and wherein the reverse visual search returns a result. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A computer-readable memory including computer-executable instructions that, when executed by a processor, cause the processor to perform acts including:
-
rendering visual content on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image; receiving a voice directed query related to the visual content rendered on the display, wherein the voice directed query comprises at least a search word; using the search word from the voice directed query as an input for a first search; detecting an object from the visual content as a function of a first result of the first search; selecting an edge detection algorithm from a set of edge detection algorithms; extracting an image of the object from the visual content using the edge detection algorithm selected from the set of edge detection algorithms, wherein the image of the object is a portion of the visual content and is extracted from a remainder of the visual content; using the image of the object extracted from the visual content as an input for a reverse visual search, wherein the reverse visual search is executed based upon the image of the object extracted from the visual content; and rendering a second result of the reverse visual search on the display. - View Dependent Claims (18, 19)
-
Specification