Content reaction annotations

• US 10,678,852 B2
• Filed: 06/20/2017
• Issued: 06/09/2020
• Est. Priority Date: 12/13/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Koukoumidis, Emmanouil, Beckman, Brian, Lane, Nicholas Donald Atkins, Samuel, Arjmand Micheal
• Primary Examiner(s): Aspinwall, Evan
• Application Number:
  US15/628,250
• Publication Number:
  US 20170286538A1
• Time in Patent Office: 1,085 Days
• Field of Search: 707736
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/787 using geographical or spatial information, e.g. location

Abstract

Among other things, one or more techniques and/or systems are provided for annotating content based upon user reaction data and/or for maintaining a searchable content repository. That is, a user may request and/or opt-in for user reaction data to be detected while a user is experiencing content (e.g., watching a movie, walking through a park, interacting with a website, participating on a phone conversation, etc.). Metadata associated with the content may be used to determine when and/or what sensors to use to detect the user reaction data (e.g., metadata specifying an emotional part of a movie). The content may be annotated with a reaction annotation corresponding to the user reaction data, which may be used to organize, search, and/or interact with the content. A search interface may allow users to search for content based upon annotation data and/or aggregated annotation data of one or more users who experienced the content.

Claims

1. A content annotation method, comprising:

identifying a portion of content that for which there is a signal of a high probability that a user will experience a reaction to the portion of the content, the signal being derived from data associated with the content;

determining one or more inputs, from an available set of inputs associated with the content, to activate based on data associated with the portion of the content;

receiving an input from the available set of inputs based on data associated with the portion of the content;

receiving, utilizing the received input, data of a user'"'"'s reaction while experiencing the portion of the content, after the identifying;

formulating a reaction annotation corresponding to the received data; and

annotating the portion of the content with a reaction annotation.

2. The method of claim 1, wherein the receiving is performed only after receipt of an indication to permit detection of data of the user'"'"'s reaction while experiencing the portion of the content.

3. The method of claim 1, wherein the receiving comprises detecting data in real-time and during consumption of the portion of the content by the user.

4. The method of claim 1, further comprising:

detecting data of another user'"'"'s reaction while experiencing the portion of content, after the identifying;

aggregating the another user'"'"'s detected data;

formulating another reaction annotation corresponding to the detected data for the another user'"'"'s detected data; and

annotating the portion of the content with the another reaction annotation.

5. The method of claim 1, further comprising generating, based at least on the received data, a user interface that by which user reaction data is conveyable.

6. The method of claim 1, wherein the receiving comprises detecting data using one or more sensors of a device presenting the content, based upon a resource availability associated with the device.

7. The method of claim 1, wherein the annotation is a visual element of one of a heatmap and a graph, each depicting one or more reaction annotations associated with the content and in which different types of reaction annotations, when present, are presented in different visual manners.

8. The method of claim 1, wherein the receiving comprises selecting a sensor from an available set of sensors to detect at least some of the data of a user'"'"'s reaction, the selecting being based upon at least one of a current time, a location context of a device presenting the content, a context of the content, or metadata specifying a type of sensor for the content.

9. The method of claim 8, further comprising selectively activating or deactivating the sensor based upon metadata associated with the portion of the content.

10. The method of claim 1, further comprising generating a graph representing reaction annotations associated with the portion of the content in which different types of the reaction annotations are visually differentiated.

11. The method of claim 10, further comprising:

identifying a first type of reaction annotation with a first visual cue within the graph; and

identifying a second type of reaction annotation with a second visual cue within the graph, wherein the first and second visual cues differ.

12. The method of claim 1, further comprising:

utilizing a sensor to obtain supplemental content associated with an experience of the user with the portion of the content; and

associating the supplemental content with the portion of the content.

13. A content annotation method, comprising:

evaluating data about a media content to yield a determination of whether a portion of the media content has a requisite probability that a user experiencing the portion will have a reaction to it;

receiving, utilizing an activated sensor from a set of available sensors, user reaction data which is associated with a specified portion of the media content when the determination is affirmative, the activated sensor having been activated based on metadata associated with the specified portion of content; and

annotating the specified portion of the media content with a reaction annotation that corresponds to the received user reaction data.

14. The method of claim 13, wherein the reaction annotation also reflects an aggregation of more than one user'"'"'s detected user reaction data.

15. The method of claim 13, further comprising generating, based at least on the received user reaction data, a user interface that is adapted and configured to convey user reaction data.

16. The method of claim 13, wherein the receiving includes using one or more sensors of a device presenting the media content.

17. The method of claim 16, further comprising selecting the one or more sensors from an available set, based upon a resource availability associated with a device presenting the media content.

18. A content annotation method, comprising:

identifying a portion of content that for which there is an indication of a high probability that a user will experience a reaction to the portion of the content, the indication being in data about the content;

selectively activating a sensor based upon metadata associated with the portion of the content;

detecting, utilizing the activated sensor, data of a user'"'"'s reaction while experiencing the portion of the content, after the identifying;

formulating a reaction annotation corresponding to the detected data;

receiving an indication limiting use of one or both of the detected data or the reaction annotation; and

annotating the portion of the content with a reaction annotation in a manner consistent with the indication.

19. The method of claim 18, wherein the annotating comprises generating one of a heatmap and a graph, each depicting one or more reaction annotations associated with the portion of the content.

20. The method of claim 19, wherein, in at least one of the heatmap and the graph, different types of the reaction annotations, when present, are visually differentiated.