System and method for content-based navigation of live and recorded TV and video programs

• US 9,743,144 B2
• Filed: 05/22/2015
• Issued: 08/22/2017
• Est. Priority Date: 10/31/2005
• Status: Active Grant

• Current Assignee: AT&T Corporation (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Gibbon, David Crawford, Liu, Zhu, Shahraray, Behzad
• Primary Examiner(s): Dang, Hung
• Application Number:
  US14/720,290
• Publication Number:
  US 20150256887A1
• Time in Patent Office: 823 Days
• Field of Search: 386239-248, 386291-299
• CPC Class Codes: G11B 27/102 Programmed access in sequence to addressed parts of tracks of operating record carriers access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816
• CPC Class Codes: G11B 27/3081 used signal is a video-frame or a video-field (P.I.P)
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

A system, method and computer-readable medium are presented for providing real-time content-based navigation of live video programming. The video programming is received and a searchable database is generated. The method aspect of the invention comprises receiving a live video program, generating an index to the received live video program by extracting images and/or text from the video program, recording the live video program, presenting at least a portion of data associated with the generated index to a user, receiving user input regarding a search to a portion of the recorded video program to which the user desires to navigate and playing back the recorded video program starting at the searched portion identified by the user input. The search may be of an image and/or text portion of the presentation.

Claims

1. A method comprising:

receiving a broadcast video program from a first source;

performing an analysis of images and text displayed in the video program, to generate a content-based index, wherein the content-based index;

is generated independent of index information transmitted with the broadcast video program; and

is generated by combining extracted images and the text from the video program with first network-based content provided by an external source, the first network-based content being transmitted separately from the broadcast video program;

automatically, via a processor, supplementing the content-based index with second network-based content as the content-based index is generated, wherein the second network-based content is from a second source that is distinct from the first source and the external source;

presenting a search field, wherein presenting of the search field occurs on a first computing device different from a second computing device which displays the broadcast video program, wherein the first computing device is a hand-held device;

receiving user input in the search field;

searching the content-based index to identify a location in the video program associated with the user input; and

sending a signal to the second device to play back the video program starting at the location.

2. The method of claim 1, wherein the network-based content accompanies the broadcast video program.

3. The method of claim 1, further comprising:

when a plurality of portions of the broadcast video program match the user input;

presenting the plurality of portions to a user via the second device.

4. The method of claim 3, further comprising:

receiving a location selection from the user from among the plurality of portions.

5. The method of claim 4, wherein the location for the playing back of the video program corresponds to the location selection.

6. The method of claim 1, wherein the analysis further comprises performing automatic speech recognition on audio in the video program.

7. The method of claim 1, wherein the analysis further comprises extracting the extracted images from the broadcast video program.

8. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising;

receiving a broadcast video program from a first source;

performing an analysis of images and text displayed in the video program, to generate a content-based index, wherein the content-based index;

is generated independent of index information transmitted with the broadcast video program; and

is generated by combining extracted images and the text from the video program with first network-based content provided by an external source, the first network-based content being transmitted separately from the broadcast video program;

automatically supplementing the content-based index with second network-based content as the content-based index is generated, wherein the second network-based content is from a second source that is distinct from the first source and the external source;

presenting a search field, wherein presenting of the search field occurs on a first computing device different from a second computing device which displays the broadcast video program, wherein the first computing device is a hand-held device;

receiving user input in the search field;

searching the content-based index to identify a location in the video program associated with the user input; and

sending a signal to the second device to play back the video program starting at the location.

9. The system of claim 8, wherein the first network-based content accompanies the broadcast video program.

10. The system of claim 8, the computer-readable storage medium having additional instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

when a plurality of portions of the broadcast video program match the user input;

presenting the plurality of portions to a user via the second device.

11. The system of claim 10, the computer-readable storage medium having additional instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

receiving a location selection from the user from among the plurality of portions.

12. The system of claim 11, wherein the location for the playing back of the video program corresponds to the location selection.

13. The system of claim 8, wherein the analysis further comprises performing automatic speech recognition on audio in the video program.

14. The system of claim 8, wherein the analysis further comprises extracting the extracted images from the broadcast video program.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, result in the computing device performing operations comprising:

receiving a broadcast video program from a first source;

performing an analysis of images and text displayed in the video program, to generate a content-based index, wherein the content-based index;

is generated independent of index information transmitted with the broadcast video program; and

is generated by combining extracted images and the text from the video program with first network-based content provided by an external source, the first network-based content being transmitted separately from the broadcast video program;

automatically supplementing the content-based index with second network-based content as the content-based index is generated, wherein the second network-based content is from a second source that is distinct from the first source and the external source;

presenting a search field, wherein presenting of the search field occurs on a first computing device different from a second computing device which displays the broadcast video program, wherein the first computing device is a hand-held device;

receiving user input in the search field;

searching the content-based index to identify a location in the video program associated with the user input; and

sending a signal to the second device to play back the video program starting at the location.

16. The computer-readable storage device of claim 15, wherein the network-based content accompanies the broadcast video program.

17. The computer-readable storage device of claim 15, having additional instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

when a plurality of portions of the broadcast video program match the user input;

presenting the plurality of portions to a user via the second device.

18. The computer-readable storage device of claim 17, having additional instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

receiving a location selection from the user from among the plurality of portions.

19. The computer-readable storage device of claim 18, wherein the location for the playing back of the video program corresponds to the location selection.

20. The computer-readable storage device of claim 15, wherein the analysis further comprises performing automatic speech recognition on audio in the video program.