Methods, apparatus, and program products to close interaction loops for social tv

• US 8,082,571 B2
• Filed: 06/05/2006
• Issued: 12/20/2011
• Est. Priority Date: 06/05/2006
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Inventors: Aoki, Paul M., Szymanski, Margaret H., Thornton, James D.
• Primary Examiner(s): Beliveau, Scott
• Assistant Examiner(s): Alata, Yassin
• Application Number:
  US11/447,717
• Publication Number:
  US 20070280638A1
• Time in Patent Office: 2,024 Days
• Field of Search: 725 32- 36, 725/131, 348/14.01
• US Class Current: 725/131
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4786 e-mailing message switching systems, e.g. electronic mail systems H04L51/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

One aspect of the disclosed technology determines at least one content extent within an experiential data stream respective to at least one commentary clip, extracts at least one portion of said experiential data stream responsive to the at least one content extent, and stores the at least one portion of said experiential data stream.

Claims

1. A computer controlled method comprising:

receiving, at a computer, a video stream and a plurality of overlapping commentary audio clips associated with the video stream;

determining, by the computer, a content range within the video stream corresponding to the overlapping commentary audio clips by determining the starting and ending positions of the overlapping commentary audio clips, wherein determining the content range involves determining that the overlapping commentary audio clips are associated with a sequential presentation mode, and adjusting a playback vector of the video stream to slow the presentation of the video stream based on time required to sequentially play the overlapping commentary audio clips in a non-overlapping fashion, such that the overlapping commentary audio clips are sequentially played during the slowed presentation of the video stream;

extracting, by the computer, a portion of the video stream based on the determined content range and the adjusted playback vector;

generating another video stream comprising the extracted portion and the sequentially presented overlapping commentary audio clips; and

storing the generated video stream.

2. The computer controlled method of claim 1, wherein each of the plurality of overlapping commentary audio clips has a respective trigger position and wherein determining the content range further comprises determining whether a commentary audio clip is enabled.

3. The computer controlled method of claim 1, wherein determining the content range further comprises one or more of the group consisting of:

analyzing audio data to determine an extent of social engagement of one or more local audience members;

extending the content range to a conversation transition;

analyzing video data of at least one local audience member to determine an extent of the social engagement of said at least one local audience member; and

extending the content range to a video scene transition within the video stream.

4. The computer controlled method of claim 1, wherein determining the content range is responsive to activation of a user selectable control.

5. The computer controlled method of claim 1, further comprising tagging the portion of the video stream responsive to determining the content range.

6. The computer controlled method of claim 5, wherein storing the generated video stream further comprises one or more of the group consisting of:

storing the portion of the video stream that was tagged;

storing the overlapping commentary audio clips;

establishing a network connection; and

transmitting the generated video steam over said network connection.

7. The computer controlled method of claim 1, wherein storing the generated video stream involves storing the extracted portion of the video stream on a data storage media.

8. The computer controlled method of claim 7, wherein the generated video stream stored on said data storage media includes one or more of a group consisting of audio data, video data, single image data, audio effect data, and video effect data.

9. The computer controlled method of claim 1, wherein storing the generated video stream further comprises storing the overlapping commentary audio clips on a data storage media.

10. The computer controlled method of claim 9, wherein the plurality of overlapping commentary audio clips includes a commentary audio clip from a first audience member and a commentary audio clip from a second audience member.

11. The computer controlled method of claim 1, wherein the video stream includes replacement/additional content.

12. An apparatus comprising:

a processor;

a receiver logic configured to receive a video stream and a plurality of overlapping commentary audio clips associated with the video stream;

a range determination logic configured to determine a content range within the video stream corresponding to the overlapping commentary audio clips by determining the starting and ending positions of the overlapping commentary audio clips, wherein the range determination logic is configured to determine that the overlapping commentary audio clips are associated with a sequential presentation mode, and to adjust a playback vector of the video stream to slow the presentation of the video stream based on time required to sequentially play the overlapping commentary audio clips in a non-overlapping fashion, such that the overlapping commentary audio clips are sequentially played during the slowed presentation of the video stream;

a content extraction logic configured to extract a portion of the video stream based on the determined content range and the adjusted playback vector;

a video-stream-generation logic configured to generate another video stream comprising the extracted portion of the video stream and the sequentially presented overlapping commentary audio clips; and

a storage logic configured to store the generated video stream.

13. The apparatus of claim 12, wherein each of the plurality of overlapping commentary audio clips has a respective trigger position and wherein the range determination logic further comprises an enablement detection logic configured to determine whether a commentary audio clip is enabled.

14. The apparatus of claim 12, wherein the range determination logic further comprises one or more of the group consisting of:

a control detection logic configured to detect activation of a user selectable control;

an audio social engagement determination logic configured to analyze audio data to determine an extent of a social engagement of a plurality of local audience members;

a range expansion logic configured to extend the content range by a predetermined amount;

a video scene extent expansion logic configured to extend the content range to a video scene transition within the video stream;

a conversation transition range expansion logic configured to extend the content range to a conversation transition; and

a video social engagement determination logic configured to analyze video data of at least one local audience member to determine an extent of the social engagement of the plurality of audience members.

15. The apparatus of claim 12, further comprising a content marker logic configured to tag the portion of the video stream responsive to determining the content range.

16. The apparatus of claim 15, wherein the storage logic further comprises one or more of the group consisting of:

a video-stream storage logic configured to store the extracted portion of the video stream that was tagged by the content marker logic;

a commentary storage logic configured to store the overlapping commentary audio clips;

a combination storage logic configured to combine and store the extracted portion of the video stream that was tagged by the content marker logic and the commentary clips; and

a network interface logic configured to establish a network connection; and

further configured to transmit the generated video stream over said network connection.

17. The apparatus of claim 12, wherein the storage logic stores the generated video steam on a data storage media.

18. The apparatus of claim 17, wherein the generated video stream stored on said data storage media includes one or more of a group consisting of audio data, video data, single image data, audio effect data, and video effect data.

19. The apparatus of claim 12, wherein the storage logic stores the overlapping commentary audio clips on a data storage media.

20. The apparatus of claim 19, wherein the plurality of overlapping commentary audio clips includes a commentary clip from a first audience member and/or a commentary clip from a second audience member.

21. The apparatus of claim 12, wherein the video stream includes replacement/additional content.

22. A non-transitory computer-usable storage medium storing instructions that, when executed by a computer, cause said computer to perform a method comprising:

receiving, at a computer, a video stream and a plurality of overlapping commentary audio clips associated with the video stream;

determining, by the computer, a content range within the video stream corresponding to the overlapping commentary audio clips by determining the starting and ending positions of the overlapping commentary audio clips wherein determining the content range involves determining that the overlapping commentary audio clips are associated with a sequential presentation mode, and adjusting a playback vector of the video stream to slow the presentation of the video stream based on time required to sequentially play the overlapping commentary audio clips in a non-overlapping fashion, such that the overlapping commentary audio clips are sequentially played during the slowed presentation of the video stream;

extracting, by the computer, a portion of the video stream based on the determined content range and the adjusted playback vector;

generating another video stream comprising the extracted portion of the video stream and the sequentially presented overlapping commentary audio clips; and

storing the generated video stream.

23. The computer-usable storage medium of claim 22, wherein each of the plurality of overlapping commentary audio clips has a respective trigger position and wherein determining the content range further comprises determining whether a commentary audio clip is enabled.

24. The computer-usable storage medium of claim 22, wherein determining the content range further comprises one or more of the group consisting of:

analyzing audio data to determine an extent of a social engagement of one or more local audience members;

extending the content range to a conversation transition;

analyzing video data of at least one local audience member to determine an extent of the social engagement of said at least one local audient member; and

extending the content range to a video scene transition within the video stream.

25. The computer-usable storage medium of claim 22, wherein determining the one content range is responsive to activation of a user selectable control.

26. The computer-usable storage medium of claim 22, further comprising tagging the portion of the video stream responsive to determining the content range.

27. The computer-usable storage medium of claim 26, wherein storing the generated video stream further comprises one or more of the group consisting of:

storing the portion of the video stream that was tagged;

storing the overlapping commentary audio clips;

establishing a network connection; and

transmitting the generated video stream over said network connection.

28. The computer-usable storage medium of claim 22, wherein storing the generated video steam comprises storing the extracted portion of the video stream on a data storage media.

29. The computer-usable storage medium of claim 28, wherein the generated video stream stored on said data storage media includes one or more of a group consisting of audio data, video data, single image data, audio effect data, and video effect data.

30. The computer-usable storage medium of claim 22, wherein storing the generated video stream further comprises storing the overlapping commentary audio clips on a data storage media.

31. The computer-usable storage medium of claim 30, wherein the plurality of overlapping commentary audio clips includes a commentary audio clip from a first audience member and/or a commentary audio clip from a second audience member.

32. The computer-usable storage medium of claim 22, wherein the video stream includes replacement/additional content.