Method and apparatus for dynamically generating a visual program summary from a multi-source video feed

• US 6,870,573 B2
• Filed: 01/22/1999
• Issued: 03/22/2005
• Est. Priority Date: 01/22/1999
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Yeo, Boon-Lock, Yeung, Minerva Ming-Yee
• Primary Examiner(s): Miller, John
• Assistant Examiner(s): Tran, Trang U.
• Application Number:
  US09/235,783
• Publication Number:
  US 20020070958A1
• Time in Patent Office: 2,251 Days
• Field of Search: 348/569, 348/570, 348/564, 348/906, 348/731, 348/732, 725/41, 725/43, 725/48, 725/56, 725/59, 345/327
• US Class Current: 348/569
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4263 involving specific tuning arrangements, e.g. two tuners
• CPC Class Codes: H04N 21/42661 for reading from or writing on a magnetic storage medium, e.g. hard disk drive
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4335 Housekeeping operations, e.g. prioritizing content for deletion because of storage space restrictions storage management, e.g. defragmentation G06F3/0604; unloading stored programs G06F9/445; storage management in file systems G06F16/10; buffering arrangements in a network node or in an end terminal in packet networks H04L49/90
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/440263 by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4821 using a grid, e.g. sorted out by channel and broadcast time
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 5/4448 for frame-grabbing
• CPC Class Codes: H04N 5/50 Tuning indicators; Automatic tuning control

Abstract

A method of generating a visual program summary is disclosed for a multiple source video feed. In the disclosed method, a computing device continuously captures frames from a set of available video feeds such as television channels. The computing device analyzes the captured video frames to remove redundant frames. The computing device then selects a set of frames to generate a visual program summary. The selected frames are composited together to generate a visual program summary.

Claims

1. A method comprising:

repeatedly tuning at least one tuner at a regular interval of time to differing channels of a set of channels to receive video frames from each channel of the set of channels;

repeatedly capturing a plurality of sets of video frames, each set of video frames being comprised of a plurality of video frames received and captured from each channel of the set of channels as each channel is tuned to;

displaying a visual program summary comprised of at least two of the sets of video frames; and

repeatedly updating the at least two of the sets of video frames displayed by replacing those at least two of the sets of video frames displayed with at least two more recent sets of video frames received and captured from the same channels of the set of channels from which the at least two of the sets of video frames displayed were earlier received and captured as the same channels are repeatedly tuned.

2. The method of claim 1, further comprising displaying textual information concerning a video program received with at least one of the sets of video frames of the plurality of sets of video frames that depicts at least a portion of the video program.

3. The method of claim 1, wherein displaying the visual program summary further comprises accessing a program schedule and displaying information from that program schedule.

4. The method of claim 1, wherein displaying the visual program summary further comprises displaying video frames in a two-dimensional array, with sets of video frames from the plurality of sets of video frames being visually distinguished from each other in one dimension, and the progression of time for the sets of video frames from the plurality of sets of video frames being visually distinguished in the other dimension.

5. The method of claim 4, wherein the two-dimensional array is organized as rows and columns, with each row corresponding to a set of video frames from the plurality of sets of video frames, and each column corresponding to the passage of time for the sets of video frames from the plurality of sets of video frames such that newly captured video frames within each set of video frames is displayed in the left-most column, while progressively older video frames within each set of video frames are displayed in columns to the right of the left-most column.

6. The method of claim 1, further comprising deleting a first video frame from at least one set of video frames of the plurality of sets of video frames prior to displaying the at least one set of video frames if the first video frame is redundant to a second video frame also from the same at least one set of video frames.

7. The method of claim 6, wherein the color histograms of the first and second video frames are used to determine if the first video frame is redundant to the second video frame.

8. The method of claim 6, wherein motion vector correlation is used to determine if the first video frame is redundant to the second video frame.

9. The method of claim 1, further comprising deleting a video frame from at least one set of the plurality of sets of video frames if the at least one set of video frames spans a boundary such that the video frames of the at least one set of video frames span a plurality of video programs.

10. The method of claim 1, wherein the regular interval of time is adjustable.

11. The method of claim 1. wherein the set of channels excludes at least one channel that a viewer of the visual program summary has chosen to eliminate.

12. An apparatus comprising:

at least one tuner to repeatedly tune at regular intervals to differing channels of a set of channels to receive video frames from each channel of the set of channels;

a capture device coupled to the tuner to capture a plurality of sets of video frames, each set of video frames being comprised of a plurality of video frames received and captured each channel of the set of channels as each channel is repeatedly tuned to by the at least one tuner;

a processing device coupled to the capture device generating a visual program summary comprised of at least two of the sets of video frames wherein the at least two of the sets of video frames are repeatedly updated by replacing those at least two sets of video frames with at least two more recent sets of video frames received and captured from the same channels of the set of channels from which the at least two sets of video frames were earlier received and captured as the same channels are repeatedly tuned by the at least one tuner.

13. The apparatus of claim 12, wherein the capture device captures each frame that comprises at least one set of the plurality of sets of video frames at an adjustable interval.

14. The apparatus of claim 12, wherein the capture device stores at least one video frame of at least one set of the plurality of sets of video frames as a digital video frame.

15. The apparatus of claim 12, wherein the capture device comprises a television tuner and a video frame digitizer.

16. The apparatus of claim 12, wherein the processing device adds at least a portion of textual information received with at least one video program depicted within a set of video frames to the visual program summary.

17. The apparatus of claim 12, wherein the processing device accesses a program schedule and adds at least a portion of the information from that program schedule to the visual program summary.

18. The apparatus of claim 12, wherein the processing device deletes a first video frame from at least one set of the plurality of sets of video frames captured by the capturing device if the first video frame is redundant to a second video frame also from the same at least one set of video frames.

19. The apparatus of claim 17, wherein the color histograms of the first and second video frames are used to determine if the first video frame is redundant to the second video frame.

20. The apparatus of claim 17, wherein motion vector correlation is used to determine if the first video frame is redundant to the second video frame.

21. The apparatus of claim 12, wherein the processing device deletes a video frame from at least one set of the plurality of sets of video frames captured by the capture device if the at least one set of video frames spans a boundary such that the video frames of the at least one set of video frames span a plurality of programs.

22. The apparatus of claim 12, wherein the set of channels tuned at regular intervals by the at least one tuner excludes at least one channel that a viewer of the visual program summary has chosen to eliminate.

23. A computer readable medium comprising instructions, which when executed by a processor, causes the processor to:

repeatedly tune at least one tuner at a regular interval of time to differing channels of a set of channels to receive video frames from each channel of the set of channels;

repeatedly capture a plurality of sets of video frames, each set of video frames being comprised of a plurality of video frames received and captured from each channel of the set of channels as each channel is tuned to;

display a visual program summary comprised of at least two of the sets of video frames; and

repeatedly update the at least two of the sets of video frames displayed by replacing those at least two of the sets of video frames displayed with at least two more recent sets of video frames received and captured from the same channels of the set of channels from which the at least two of the sets of video frames displayed were earlier received and captured as the same channels are repeatedly tuned.

24. The computer readable medium of claim 23, further comprising causing the processor to display textual information concerning a video program received with at least one of the sets of video frame of the plurality of sets of video frames that depicts at least a portion of the video program.

25. The computer readable medium of claim 23, wherein the display of the visual program summary further comprises causing the processor to access a program schedule and display information from that program schedule.

26. The computer readable medium of claim 23, wherein the display of the visual program summary further comprises causing the processor to display video frames in a two-dimensional array, with sets of video frames from the plurality of sets of video frames being visually distinguished from each other in one dimension, and the progression of time for the sets of video frames from the plurality of sets of video frames being visually distinguished in the other dimension.

27. The computer readable medium of claim 26, wherein the two-dimensional array is organized as rows and columns, with each row corresponding to a set of video frames from the plurality of sets of video frames, and each column corresponding to the passage of time for the sets of video frames from the plurality of sets of video frames such that newly captured video frames within each set of video frames is displayed in the left-most column, while progressively older video frames within each set of video frames are displayed in columns to the right of the left-most column.

28. The computer readable medium of claim 23, further comprising causing the processor to delete a first video frame from at least one set of the plurality of sets of video frames if the first video frame is redundant to a second video frame also from the same at least one set of video frames.

29. The computer readable medium of claim 28, wherein the color histograms of the first and second video frames are used to determine if the first video frame is redundant to the second video frame.

30. The computer readable medium of claim 28, wherein motion vector correlation is used to determine if the first video frame is redundant to the second video frame.

31. The computer readable medium of claim 23, further comprising causing the processor to delete a video frame from at least one set of the plurality of sets of video frames if the at least one set of video frames spans a boundary such that the video frames of the at least one set of video frames span a plurality of programs.

32. The computer readable medium of claim 23, wherein the regular interval of time is adjustable.

33. The computer readable medium of claim 23, wherein the set of channels excludes at least one channel that a viewer of the visual program summary has chosen to eliminate.