System and method for content-based navigation of live and recorded TV and Video programs

• US 20070098350A1
• Filed: 10/31/2005
• Published: 05/03/2007
• Est. Priority Date: 10/31/2005
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Corporation (AT&T, Inc.)
• Inventors: Shahraray, Behzad, Liu, Zhu, Gibbon, David
• Granted Patent: US 9,042,703 B2
• Time in Patent Office: Days
• US Class Current: 386/241
• CPC Class Codes: G11B 27/102 Programmed access in sequence to addressed parts of tracks of operating record carriers access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816
• CPC Class Codes: G11B 27/3081 used signal is a video-frame or a video-field (P.I.P)
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

A system, method and computer-readable medium are presented for providing real-time content-based navigation of live video programming. The video programming is received and a searchable database is generated. The method aspect of the invention comprises receiving a live video program, generating an index to the received live video program by extracting images and/or text from the video program, recording the live video program, presenting at least a portion of data associated with the generated index to a user, receiving user input regarding a search to a portion of the recorded video program to which the user desires to navigate and playing back the recorded video program starting at the searched portion identified by the user input. The search may be of an image and/or text portion of the presentation.

Claims

1. A method for providing real-time content-based bavigation of live video programming, the method comprising:

receiving a live video program;

generating an index to the received live video program by extracting images and/or text from the video program;

recording the live video program;

presenting a search field to a user to enable the user to search at least one of text information and image information associated with the live video program;

receiving user search input regarding a portion of the recorded video program to which the user desires to navigate;

navigating to the portion of the recorded video program associated with the search input; and

playing back the recorded video program starting at the navigated portion.

2. The method of claim 1, wherein the portion of data associated with the index is at least one of:

images extracted from the live video program, text or a combination of text and images.

3. The method of claim 2, wherein the portion of data associated with the index is other data obtained from at least one of:

a source external from the live video program, and data that accompanies the live video program.

4. The method of claim 3, wherein if the user search is an image search, then navigating to the portion of the recorded video program associated with the search input further comprises identifying at least one video program scene with images that are similar to a scene associated with the user search.

5. The method of claim 1, wherein the presenting at least a portion of data associated with the generated index to a user occurs on a computing device different from the computing device which is used to view the video program.

6. The method of claim 1, wherein if a plurality of portions of the video program match the search input, then presenting to the user an option to select from the plurality of portions and wherein playing back the recorded video program starting at the navigated portion is in response to a user selection from the plurality of portions.

7. The method of claim 1, wherein generating the index further comprises using a module to generate a searchable database of images and/or text from the video program and at least one of:

a content-based sampling module to extract images, a textual module to extract text and an automatic speech recognition module to extract text.

8. A system for providing real-time content-based navigation of live video programming, the system comprising:

a module configured to receive a live video program;

a module configured to generate an index to the received live video program by extracting images and/or text from the video program;

a module configured to record the live video program;

a module configured to present a search field to a user to enable the user to search at least one of text information and image information associated with the live video program;

a module configured to receive user search input regarding a portion of the recorded video program to which the user desires to navigate;

a module configured to navigate to the portion of the recorded video program associated with the search input; and

a module configured to playback the recorded video program starting at the navigated portion.

9. The system of claim 8, wherein the portion of data associated with the index is at least one of:

images extracted from the live video program, text or a combination of text and images.

10. The system of claim 9, wherein the portion of data associated with the index is other data obtained from at least one of:

a source external from the live video program, and data that accompanies the live video program.

11. The system of claim 10, wherein if the user search is an image search, then the module configured to navigate to the portion of the recorded video program associated with the search input further identifies at least one video program scene with images that are similar to a scene associated with the user search.

12. The system of claim 8, wherein the module configured to present at least a portion of data associated with the generated index to a user operates on a computing device different from the computing device which is used to view the video program.

13. The system of claim 8, further comprising a module configured to present to the user an option to select from a plurality of portions of the video program if more than one portions of the video program match the search input, and wherein the module configured to play back the recorded video program starting at the navigated portion plays the recorded video program in response to a user selection from the plurality of portions.

14. The system of claim 8, wherein the module configured to generate the index further uses a module to generate a searchable database of images and/or text from the video program and at least one of:

a content-based sampling module to extract images, a textual module to extract text and an automatic speech recognition module to extract text.

15. A computer-readable medium storing instructions for controlling a computing device to provide real-time content-based navigation of live video programming, the instructions comprising:

receiving a live video program;

generating an index to the received live video program by extracting images and/or text from the video program;

recording the live video program;

presenting a search field to a user to enable the user to search at least one of text information and image information associated with the five video program;

receiving user search input regarding a portion of the recorded video program to which the user desires to navigate;

navigating to the portion of the recorded video program associated with the search input; and

playing back the recorded video program starting at the navigated portion.

16. The computer-readable medium of claim 15, wherein the portion of data associated with the index is at least one of:

images extracted from the live video program, text or a combination of text and images.

17. The computer-readable medium of claim 16, wherein the portion of data associated with the index is other data obtained from at least one of:

a source external from the live video program, and data that accompanies the live video program.

18. The computer-readable medium of claim 17, wherein if the user search is an image search, then navigating to the portion of the recorded video program associated with the search input further comprises identifying at least one video program scene with images that are similar to a scene associated with the user search.

19. The computer-readable medium of claim 15, wherein the presenting at least a portion of data associated with the generated index to a user occurs on a computing device different from the computing device which is used to view the video program.

20. The computer-readable medium of claim 15, wherein if a plurality of portions of the video program match the search input, then presenting to the user an option to select from the plurality of portions and wherein playing back the recorded video program starting at the navigated portion is in response to a user selection from the plurality of portions.

21. The computer-readable medium of claim 15, wherein generating the index further comprises using a module to generate a searchable database of images and/or text from the video program and at least one of:

a content-based sampling module to extract images, a textual module to extract text and an automatic speech recognition module to extract text.