Queryless search based on context

• US 9,483,518 B2
• Filed: 12/18/2012
• Issued: 11/01/2016
• Est. Priority Date: 12/18/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Malhotra, Nipoon, Schechter, Michael Austin
• Primary Examiner(s): Ly, Anh
• Application Number:
  US13/718,202
• Publication Number:
  US 20140172892A1
• Time in Patent Office: 1,414 Days
• Field of Search: 707/758, 707/829, 707/722, 707/748, 707/803, 707/E17.014, 707/E17.044, 707/E17.005, 707/736, 707/733, 707/728, 707/731, 707/734, 707/706, 707/754, 707/732, 707/E17.108, 707/765, 707/705, 707/759, 707/769, 707/770, 707/723, 707/E17.109, 707/E17.083, 715/773, 715/249, 715/256, 715/863, 715/810, 715/823
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9536 Search customisation based on social or collaborative filtering
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

Computer-readable media, computer systems, and computing devices for initiating a queryless search is provided. In this regard, a search can be initiated without a user inputting a query. In one embodiment, the method includes recognizing a search indication provided by a user to indicate a desire to view one or more search results related to content being presented. Such a search indication can be performed without accessing a web page associated with a search engine. In accordance with the search indication, contextual information related to the content being presented can be automatically captured. Thereafter, the captured contextual information is provided to initiate a search for information corresponding with the contextual information. Search results corresponding with the contextual information are received and presented.

Claims

1. A computer-implemented method of facilitating a queryless search by generating a combined display of presented content and contextually-related search results, the method comprising:

under control of one or more processors configured with computer-executable instructions;

recognizing a single search indication received on a user device and provided by a user to;

A) on the user device, capture content being presented on the user device, wherein the content comprises one or more of a webpage or a television program,

B) define a search scope corresponding to only a portion of the captured content being presented, wherein the single search indication comprises

1) a touch input on a touch screen, touch pad, or remote control,

2) a body motion detected by an image capture device,

3) a motion of a user input device,

4) a motion of a cursor controlled by the user input device,

5) a selection controlled by the user input device, or

6) a combination thereof, and

wherein the portion of the captured content being presented comprises a region of content defined by the single search indication, and

C) initiate a search related to the portion of the captured content being presented, wherein the single search indication is provided without accessing a web page associated with a search engine;

in accordance with the single search indication, automatically capturing on the user device contextual information related to the portion of the captured content being presented on the user device;

automatically providing the contextual information for the search for information corresponding with the contextual information;

receiving one or more search results corresponding with the contextual information; and

modifying a display of the presented content on the user device, such that the one or more search results are presented on the user device with the presented content.

2. The method of claim 1 further comprising causing the one or more search results corresponding with the contextual information to be displayed.

3. The method of claim 2, wherein the one or more search results are overlaid on the content being presented.

4. The method of claim 1, wherein the single search indication provided by a user to define the search scope corresponding to only a portion of the content being presented includes a specific item of interest within the content being presented.

5. The method of claim 1, wherein the contextual information comprises information related to the presented content, the user, a user device being used by the user, a behavior of a third-party deemed similar to the user, or a combination thereof.

6. The method of claim 1, wherein the one or more search results comprise one or more of text, images, video content, or audio content.

7. One or more computer-readable hardware storage devices storing instructions that, when executed by a processor, configure the processor to perform acts that generate a combined display of presented content and contextually-related search results, comprising:

detecting a single search indication comprising an action performed by a user on a user device while media content is being presented via one or more of a webpage or a television program on the user device, wherein the single search indication

A) captures, on the user device, media content being presented on the user device,

B) defines a search scope corresponding to only a portion of the media content being presented, wherein the portion of the media content being presented comprises a region of content defined by the single search indication,

C) includes a specific item of interest within the content being presented, and

D) initiates a search related to the media content being presented;

in response to detecting the single search indication, automatically obtaining contextual information related to the media content at or near detection of the single search indication;

automatically communicating the contextual information at least to a remote search service that formulates a query based on the contextual information; and

receiving one or more search results related to the obtained contextual information related to the media content; and

modifying a display of the presented content on the user device, such that the one or more search results are presented on the user device with the content.

8. The devices of claim 7, wherein the acts further comprise presenting the one or more search results of the search by overlaying the one or more search results on a display screen displaying the media content.

9. The devices of claim 7, wherein the action is performed via a motion of the user.

10. The devices of claim 7, wherein the action is performed via a remote control operated by the user.

11. The devices of claim 7, wherein the contextual information comprises one or more of:

text associated with the media content;

an identifier of the media content;

a time associated with the single search indication;

metadata associated with the media content;

a time associated with presentation of the media content;

or

a channel presenting the media content.

12. The devices of claim 7, wherein the contextual information comprises at least user activity associated with a remote user device.

13. The devices of claim 7, wherein the one or more search results comprise text information describing the media content, a representation of a similar or related media object, a social network post associated with the media content, or a combination thereof.

14. A user device that generates a combined display of presented content and contextually-related search results, the user device comprising:

a processor;

memory communicatively coupled to the processor;

a display screen configured to display content;

a search detector component to detect a single search indication that captures, on the user device, content comprising one or more of a webpage or a television program presented on the user device, defines a search scope corresponding to only a portion of the content, includes a specific item of interest within the content being presented, and initiates a search related to the content, wherein the single search indication does not specify any text for use in performing the search, and wherein the single search indication comprises

A) a touch input on a touch screen, touch pad, or remote control,

B) a body motion detected by an image capture device,

C) a motion of a user input device,

D) a motion of a cursor controlled by the user input device,

E) a selection controlled by the user input device, or

F) a combination thereof;

a context capturer component to automatically capture contextual information related to the content displayed on the user device in accordance with detecting the single search indication, wherein at least a portion of the contextual information corresponds with a time at or near detection of the single search indication; and

a search presenting component to cause presentation of one or more search results that correspond with the contextual information related to the content, wherein the display of the content on the user device is modified such that the one or more search results are presented in association with the displayed content.

15. The user device of claim 14, wherein a search is automatically initiated by providing the contextual information to a search service.

16. The user device of claim 14, wherein the one or more search results are identified based on only the contextual information automatically captured in response to the single search indication.

17. The user device of claim 14, wherein a placement of the one or more search results is determined based on a predetermined location or an optimal location in accordance with the displayed content.

18. The user device of claim 14, wherein the single search indication is provided by a user motion.