Skimming continuous multimedia content

• US 7,293,280 B1
• Filed: 05/05/2000
• Issued: 11/06/2007
• Est. Priority Date: 07/08/1999
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Rui, Yong, He, Li-Wei, Gupta, Anoop, Li, Francis C.
• Primary Examiner(s): Koenig; Andrew Y.
• Application Number:
  US09/565,819
• Time in Patent Office: 2,741 Days
• Field of Search: 725/110, 725/131, 725/139, 725/151, 725/134, 725/152, 725114-117, 386/45, 386/55, 348/553, 348/701
• US Class Current: 725/139
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04N 9/8042 : involving data reduction

Abstract

A program distribution system includes a plurality of set-top boxes that receive broadcast programming and segmentation data from content and information providers. The segmentation information indicates portions of programs that are to be included in skimmed or condensed versions of the received programming, and is produced using manual or automated methods. Automated methods include the use of ancillary production data to detect the most important parts of a program. A user interface allows a user to control time scale modification and skimming during playback, and also allows the user to easily browse to different points within the current program.

Claims

1. A recording device comprising:

a receiver of broadcast television content;

an interface to a public network;

a non-linearly accessible storage medium;

the recording device being configured to;

record received television content on the non-linearly accessible storage medium;

retrieve skimming data from the public network, the skimming data indicating portions of the recorded television content and based at least in part upon non-broadcast production data corresponding to the recorded television content, the non-broadcast production data selected from a group consisting of;

a laugh track;

active camera data;

computer-generated data used in producing the recorded television content; and

data used in creating graphics overlays for producing the recorded television content; and

skim the recorded television content by playing the portions of the recorded television content indicated by the skimming data,

wherein the recording device retrieves the skimming data in response to viewer requests for skimmed playback.

2. A recording device as recited in claim 1, wherein the skimming data indicates portions of the recorded television content corresponding to different levels of skimming.

3. A recording device as recited in claim 1, wherein the recording device retrieves the skimming data contemporaneously with recording the received television content.

4. A recording device as recited in claim 1, wherein the recording device retrieves the skimming data after recording the received television content.

5. A recording device as recited in claim 1, wherein the recording device records only the portions of the recorded television content indicated by the skimming data.

6. A recording device as recited in claim 1, wherein the recording device deletes portions of the recorded television content other than the portions indicated by the skimming data.

7. A method of skimming continuous media content, comprising:

recording the continuous media content to allow non-linear access to the continuous media content;

retrieving skimming data from a remote provider, wherein the skimming data;

is produced based upon non-broadcast production data corresponding to the continuous media content and selected from a group consisting of;

a laugh track;

active camera data;

computer-generated data used in producing the continuous media content; and

data used in creating graphics overlays for producing the continuous media content, and

indicates portions of the recorded continuous media content; and

playing the portions of the recorded continuous media content indicated by the skimming data in response to a viewer request for skimmed playback,

wherein retrieving the skimming data for different recorded continuous media content is performed at predetermined times.

8. A method as recited in claim 7, wherein the continuous media content comprises video content.

9. A method as recited in claim 7, wherein the continuous media content comprises audio and video content.

10. A method as recited in claim 7, wherein the skimming data indicates portions of the recorded continuous media content corresponding to different levels of skimming.

11. A method as recited in claim 7, wherein retrieving the skimming data is performed contemporaneously with recording the continuous media content.

12. A method as recited in claim 7, wherein retrieving the skimming data is performed after recording the continuous media content.

13. A method as recited in claim 7, wherein retrieving the skimming data is performed prior to viewer requests for skimmed playback.

14. One or more computer-readable media containing program instructions that are executable by a computer to perform the method recited in claim 7.

15. One or more computer-readable storage media containing a program for skimming continuous audio/video content, the program comprising:

receiving the continuous audio/video content from a broadcast source;

recording the continuous audio/video content as it is received, to allow non-linear access to the continuous audio/video content;

retrieving skimming data from a remote provider, independently of receiving the continuous audio/video content, the skimming data indicating portions of the recorded continuous audio/video content and based at least in part upon non-broadcast production data corresponding to the continuous audio/video content and including computer-generated data used in producing the continuous audio/video content; and

playing the portions of the recorded continuous audio/video content indicated by the skimming data in response to a viewer request for skimmed playback,

wherein retrieving skimming data is performed prior to or contemporaneously with recording the continuous audio/video content, and

wherein recording is performed only for the portions of the continuous audio/video content indicated by the skimming data.

16. One or more computer-readable storage media as recited in claim 15, wherein the skimming data indicates portions of the recorded continuous audio/video content corresponding to different levels of skimming.

17. One or more computer-readable storage media as recited in claim 15, wherein retrieving the skimming data is performed prior to viewer requests for skimmed playback.

18. One or more computer-readable storage media as recited in claim 15, wherein retrieving the skimming data is performed in response to viewer requests for skimmed playback.

19. A method comprising:

analyzing non-broadcast production data used in producing a broadcast television program to produce skimming data corresponding to the broadcast television program, the non-broadcast production data including at least a laugh track;

storing the skimming data corresponding to a plurality of broadcast television programs, the skimming data indicating portions of the broadcast television programs that are to be played during skimmed playback of the broadcast television programs;

accepting a request from a network client for skimming data corresponding to a particular broadcast television program; and

in response to said request, providing the requested skimming data to the requesting network client, for subsequent use in skimmed playback of the particular broadcast television program.

20. A method as recited in claim 19, wherein the skimming data indicates portions of the broadcast television programs corresponding to different levels of skimming.

21. A method as recited in claim 19, wherein the broadcast television programs comprise broadcast audio and video, the method further comprising:

producing the skimming data using ancillary production data other than the broadcast audio and video.

22. A method as recited in claim 19, further comprising analyzing closed captioning data associated with a broadcast television program to produce skimming data corresponding to said broadcast television program.

23. A method as recited in claim 19, further comprising analyzing active camera data associated with a broadcast television program to produce skimming data corresponding to said broadcast television program.

24. A method as recited in claim 19, further comprising analyzing computer-generated data used in a broadcast television program to produce skimming data corresponding to said broadcast television program.

25. A method as recited in claim 19, further comprising analyzing overlaid graphics information used in a broadcast television program to produce skimming data corresponding to said broadcast television program.

26. An Internet information provider comprising:

stored skimming data corresponding to a plurality of continuous media programs that are available independently of the Internet information provider, the skimming data indicating portions of the continuous media programs that are to be played during skimmed playback of the continuous media programs and based at least in part upon non-broadcast production data corresponding to the plurality of continuous media programs, wherein the non-broadcast production data comprises one or more of;

a laugh track;

active camera data;

computer-generated data used in producing one of the plurality of continuous media programs;

or

data used in creating graphics overlays for one of the plurality of continuous media programs; and

a data server that provides requested skimming data to network clients for subsequent use in skimmed playback of said continuous media programs.

27. An Internet information provider as recited in claim 26, wherein the skimming data indicates portions of the continuous media programs corresponding to different levels of skimming.

28. A method comprising:

analyzing non-broadcast production data used in producing a broadcast television program wherein the non-broadcast production data includes at least a laugh track associated with one of the broadcast television program, or computer-generated data used in producing the broadcast television program;

based on said analysis of non-broadcast production data, identifying portions of the broadcast television program that are to be included during skimmed playback of said broadcast television program; and

storing skimming data, corresponding to the identified portions of the broadcast television program that are to be included during skimmed playback of said broadcast television program, with an Internet information provider.

29. A method as recited in claim 28, wherein the computer-generated data comprises active camera data.

30. A method as recited in claim 28, wherein the computer-generated data comprises data used in creating graphics overlays for the broadcast television program.

31. One or more computer-readable storage media containing a computer-executable program comprising:

producing a continuous media program, the continuous media program comprising one or more continuous media streams;

analyzing non-broadcast production data used in producing the continuous media program, wherein said non-broadcast production data is other than the one or more media streams and includes at least computer-generated data used in producing the continuous media program; and

based on said analysis of production data, identifying time portions of the continuous media program that are to be included during skimmed playback of said continuous media program; and

storing skimming data, corresponding to the identified time portions of the continuous media program that are to be included during skimmed playback of said continuous media program, with an Internet information provider.

32. One or more computer-readable storage media as recited in claim 31, wherein said analyzing comprises analyzing a laugh track.

33. One or more computer-readable storage media as recited in claim 31, wherein said analyzing comprises analyzing active camera data.

34. One or more computer-readable storage media as recited in claim 31, wherein said analyzing comprises analyzing data used in creating graphics overlays for the continuous media program.