Gesture-based tagging to view related content

• US 9,646,313 B2
• Filed: 12/13/2011
• Issued: 05/09/2017
• Est. Priority Date: 12/13/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Osotio, Neal, Wyss, John C., Kim, Eun Hyung
• Primary Examiner(s): CHOY, PAN G
• Application Number:
  US13/324,435
• Publication Number:
  US 20130151339A1
• Time in Patent Office: 1,974 Days
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

Computer-readable media, computer systems, and computing devices for enabling a user to view content related to an item within media content is provided. In one embodiment, a tagging gesture that indicates a user interest in an item presented within media content displayed to the user is detected. Such a tagging gesture can define a region of displayed content having the item. In response to detecting the tagging gesture, an advertisement provided by a third party that is related to the item is presented.

Claims

1. A computer-implemented method comprising:

detecting, by a motion detection system coupled to a user device, a body motion of a user to determine a tagging gesture indicating a region within a media content displayed at the user device, the region including an item;

based on determining the tagging gesture, providing for display at the user device a representation of the media content indicated by the body motion;

based on the tagging gesture, at a processor of a computing device, identifying the item and determining the item is a tagged item;

identifying tag-item data associated with the tagged item;

in response to the tagging gesture, automatically initiating a search for content related to the tagged item, wherein the search is initiated based on a search query, wherein the search query is based on the identified tag-item data and user data, the user data comprising a history of previously tagged items that were tagged by the user associated with the tagging gesture;

receiving the content related to the tagged item in response to the search query, wherein the received content related to the tagged item is based on the identified tag-item data and the user data; and

causing a presentation of the content related to the tagged item, wherein the content related to the tagged item is presented in association with the tagged item.

2. The method of claim 1, further comprising causing an item action to be presented in association with the content related to the tagged item, wherein the item action comprises an indication of an action to be taken in connection with the tagged item.

3. The method of claim 2, wherein the item action is caused to be presented in response to a user selection of the content related to the tagged item.

4. The method of claim 2, wherein the content related to the tagged item comprises purchasing information associated with the tagged item and the content related to the tagged item is presented concurrently with the tagged item within the media content.

5. The method of claim 1, wherein the content related to the tagged item overlays the media content, and is presented adjacent to the tagged item.

6. The method of claim 1, wherein identifying the item comprises determining that metadata for a taggable item included in the media content corresponds to at least one of a time or a position within the media content that is associated with the tagged item.

7. The method of claim 1, wherein the item is identified based on an image recognition analysis for the item.

8. The method of claim 1, wherein identifying the item comprises:

submitting an image of the item to an image search service; and

receiving identifying information for the item from the image search service.

9. One or more computer-readable storage media storing instructions that, when executed by a processor, implement a method comprising:

detecting, by a motion detection system coupled to a user device, a body motion of a user to determine a tagging gesture indicating a region within a media content displayed at the user device, the region including an item;

based on determining the tagging gesture, providing for display at the user device a representation of the media content indicated by the body motion;

based on the tagging gesture, identifying the item and determining the item is a tagged item;

identifying tag-item data associated with the tagged item;

in response to the tagging gesture, automatically initiating a search for content related to the tagged item, wherein the search is initiated based on a search query, wherein the search query is based on the identified tag-item data and user data, the user data comprising a history of previously tagged items that were tagged by the user associated with the tagging gesture;

receiving the content related to the tagged item in response to the search query, wherein the received content related to the tagged item is based on the identified tag-item data and the user data; and

causing a presentation of the content related to the tagged item, wherein the content related to the tagged item is presented in association with the tagged item.

10. The media of claim 9, wherein the search query is further based on context-item data, the context-item data comprising data associated with additional items included within the displayed media content.

11. The media of claim 9, wherein the displayed media content includes visual indications of taggable items, the taggable items comprising items for which related content is available based on tagging the taggable items.

12. The media of claim 9, wherein the tagging gesture comprises a motion corresponding to a shape that substantially bounds the item presented within the displayed media content.

13. The media of claim 9, wherein the content related to the tagged item further comprises an advertisement associated with the tagged item, a recommendation relevant to the tagged item, or information relevant to the tagged item.

14. The media of claim 9, wherein the user data further comprises:

an identification of the user performing the tagging gesture;

a location of the user device used by the user;

an activity history of the user; and

a user preference associated with the user.

15. The media of claim 9, wherein the content related to the tagged item includes a rotatable image of the item.

16. The media of claim 9, wherein the method further comprises causing a presentation of an item action in association with the content related to the tagged item, wherein the item action comprises an indication of an action to be taken in connection with the tagged item.

17. A computing system comprising:

one or more processors; and

computer storage memory having computer-executable instructions stored thereon that, when executed by the one or more processors, implement a method, the method comprising;

detecting, by a motion detection system coupled to a user device, a body motion of a user to determine a tagging gesture indicating a region within a media content displayed at the user device, the region including an item;

based on detecting the tagging gesture, providing for display at the user device a representation of the media content indicated by the body motion;

based on the tagging gesture, identifying the item and determining the item is a tagged item;

identifying tag-item data associated with the tagged item;

in response to the tagging gesture, automatically initiating a search for content related to the tagged item, wherein the search is initiated based on a search query, wherein the search query is based on the identified tag-item data and user data, the user data comprising a history of previously tagged items that were tagged by the user associated with the tagging gesture;

receiving the content related to the tagged item in response to the search query, wherein the received content related to the tagged item is based on the identified tag-item data and the user data; and

causing a presentation of the content related to the tagged item, wherein the content related to the tagged item is presented in association with the tagged item.

18. The system of claim 17, wherein the method further comprises causing a presentation of an indication that a third party has indicated interest in an additional item presented within the displayed media content.

19. The system of claim 18, wherein the indication that the third party has indicated interest in the additional item comprises an identification of the third party and an indication that the third party previously tagged the additional item, wherein the indication is presented as the additional item is presented within the displayed media content.

20. The system of claim 18, wherein the indication that the third party has indicated interest in the additional item comprises an indication that the third party purchased the additional item.