SIMULATED GROUP INTERACTION WITH MULTIMEDIA CONTENT

• US 20120159527A1
• Filed: 12/16/2010
• Published: 06/21/2012
• Est. Priority Date: 12/16/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Perez, Kathryn Stone, Bar-Zeev, Avi
• Application Number:
  US12/970,855
• Publication Number:
  US 20120159527A1
• Time in Patent Office: Days
• US Class Current: 725/10
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

A method and system for generating time synchronized data streams based on a viewer'"'"'s interaction with a multimedia content stream is provided. A viewer'"'"'s interactions with a multimedia content stream being viewed by the viewer are recorded. The viewer'"'"'s interactions include comments provided by the viewer, while viewing the multimedia content stream. Comments include text messages, audio messages, video feeds, gestures or facial expressions provided by the viewer. A time synchronized commented data stream is generated based on the viewer'"'"'s interactions. The time synchronized commented data stream includes the viewer'"'"'s interactions time stamped relative to a virtual start time at which the multimedia content stream is rendered to the viewer. One or more time synchronized data streams are rendered to the viewer, via an audiovisual device, while the viewer views a multimedia content stream.

Claims

1. A computer-implemented method for generating a time synchronized commented data stream based on a viewer'"'"'s interaction with a multimedia content stream, comprising the computer-implemented steps of:

identifying a viewer in a field of view of a capture device connected to a computing device;

receiving a selection from the viewer of a multimedia content stream to view, via the computing device;

recording the viewer'"'"'s interactions with the multimedia content stream being viewed by the viewer;

generating a time synchronized commented data stream based on the viewer'"'"'s interactions; and

responsive to a request from the viewer, displaying one or more time synchronized commented data streams related to the multimedia content stream being viewed by the viewer, via an audiovisual device connected to the computing device.

2. The computer-implemented method of claim 1, wherein the viewer'"'"'s interactions comprise text messages, audio messages and video feeds provided by the viewer, while the viewer views the multimedia content stream.

3. The computer-implemented method of claim 1, wherein the viewer'"'"'s interactions comprise gestures, postures and facial expressions performed by the viewer, while the viewer views the multimedia content stream.

4. The computer-implemented method of claim 1, further comprising obtaining the preference information related to the multimedia content stream, wherein the preference information includes one or more groups of users in a social graph of the viewer that are eligible to view the viewer'"'"'s interactions with the multimedia content stream.

5. The computer-implemented method of claim 1, wherein generating the time synchronized commented data stream further comprises:

determining a virtual start time at which the multimedia content stream is rendered to the viewer;

determining a time stamp of viewer interactions relative to the virtual start time; and

generating a time synchronized commented data stream, the time synchronized commented data stream includes the viewer'"'"'s interactions time stamped relative to the virtual start time at which the multimedia content stream is rendered to the viewer.

6. The computer-implemented method of claim 1, wherein displaying the one or more time synchronized commented data streams further comprise:

obtaining viewer comment viewing eligibility related to the multimedia content stream being viewed by the viewer;

presenting one or more options to view the one or more time synchronized commented data streams, via a user interface, based on viewer comment viewing eligibility;

obtaining a selection of the one or more options, from the viewer, via the user interface; and

displaying the one or more time synchronized commented data streams to the viewer, based on a viewer'"'"'s selection.

7. The computer-implemented method of claim 6, wherein presenting the one or more options and obtaining a selection of the one or more options further comprises:

displaying one or more time synchronized commented data streams from one or more specific users, to the viewer, based on a viewer'"'"'s selection.

8. The computer-implemented method of claim 6, wherein presenting the one or more options and obtaining a selection of the one or more options further comprises:

displaying one or more time synchronized commented data streams of a specific content type to the viewer, based on the viewer'"'"'s selection, wherein the content type includes text messages, audio messages, video feeds, gestures and facial expressions provided by one or more users.

9. The computer-implemented method of claim 1, further comprising rendering the time synchronized commented data stream to the viewer, via the audiovisual device, while simultaneously recording the viewer'"'"'s interactions with the multimedia content stream.

10. The computer-implemented method of claim 1, wherein displaying the one or more time synchronized commented data streams further comprise:

simultaneously recording the viewer'"'"'s interactions with the multimedia content stream while rendering the one or more time synchronized commented data streams to the viewer.

11. The computer-implemented method of claim 1, wherein:

the receiving the viewer'"'"'s selection of the multimedia content stream comprises displaying the multimedia content stream to the viewer via an audiovisual device connected to the computing device;

the recording the viewer'"'"'s interactions with the multimedia content stream comprises recording text messages, audio messages and video feeds provided by the viewer, while the viewer views the multimedia content stream;

the recording the viewer'"'"'s interactions with the multimedia content stream comprises recording gestures, postures and facial expressions performed by the viewer, while the viewer views the multimedia content stream;

the generating the time synchronized commented data stream comprises determining a time stamp of the viewer'"'"'s interactions relative to a virtual start time at which the multimedia content stream is rendered to the viewer, wherein the time synchronized commented data stream includes the viewer'"'"'s interactions time stamped relative to the virtual start time at which the multimedia content stream is rendered to the viewer;

the displaying one or more time synchronized commented data streams comprises simultaneously recording the viewer'"'"'s interactions with the multimedia content stream while rendering the one or more time synchronized commented data streams to the viewer.

12. One or more processor readable storage devices having processor readable code embodied on said one or more processor readable storage devices, the processor readable code for programming one or more processors to perform a method comprising:

receiving one or more time synchronized commented data streams related to one or more users;

generating a report of time synchronized commented data streams for a multimedia content stream viewed by the one or more users;

receiving a request from a viewer to view the one or more time synchronized commented data streams related to the one or more users; and

providing the one or time synchronized commented data streams related to the one or more users, to the viewer.

13. One or more processor readable storage devices according to claim 12, wherein providing the one or time synchronized commented data streams related to the one or more users further comprises:

identifying the one or more users who provided comments related to the multimedia content stream being viewed by the viewer, utilizing the report;

identifying a subset of users from the one or more users whose comments the viewer is eligible to view, based on a comment viewing eligibility related to the one or more users, wherein the comment viewing eligibility includes one or more groups of users in a social graph related to the one or more users that the one or more users wish to make comments provided by the one or more users available to, for viewing; and

providing the one or time synchronized commented data streams related to the subset of users, to the viewer.

14. One or more processor readable storage devices according to claim 12, further comprising:

receiving program information related to the multimedia content stream;

receiving preference information related to the one or more users; and

generating the report of time synchronized commented data streams for the multimedia content stream viewed by the one or more users based on the program information and the preference information.

15. One or more processor readable storage devices according to claim 14, wherein the preference information is utilized to determine one or more groups of users in the social graph related to the one or more users that the one or more users wish to make comments provided by the one or more users available to, for viewing.

16. A system for generating a time synchronized commented data stream based on a viewer'"'"'s interaction with a multimedia content stream, comprising:

one or more client devices in communication with a centralized data server via a communications network, wherein the one or more client devices include instructions causing a processing device in the client devices to;

record interactions from one or more viewers with a multimedia content stream being viewed by the one or more viewers;

generate one or more time synchronized commented data streams based on the interactions;

provide the time synchronized commented data streams to the centralized data server;

receive a selection from the one or more viewers to view multimedia content;

determine whether a commented data stream exists for the multimedia content; and

upon selection by the one or more viewers to view the commented data stream, present the multimedia content with the commented data stream.

17. The apparatus of claim 16, wherein:

the one or more client devices record visual and audio interactions of the one or more viewers in the commented data stream.

18. The apparatus of claim 17, further comprising:

an audiovisual device connected to the one or more client devices, the audiovisual device displays visual and audio interactions of other users in commented data streams with the multimedia content stream being viewed by the viewer.

19. The apparatus of claim 18, further comprising:

a depth camera connected to the one or more client devices, the depth camera tracks the interactions from the one or more viewers based on movements, gestures, postures and facial expressions performed by the one or more viewers in a field of view of the one or more client devices.

20. The apparatus of claim 16, further comprising:

a mobile computing device connected to the one or more client devices, wherein the mobile computing device receives the interactions from the one or more viewers, and wherein the mobile computing device is synchronized to the one or more client devices streaming the multimedia content stream to the viewers.