Search for content data in content

• US 10,277,953 B2
• Filed: 12/06/2016
• Issued: 04/30/2019
• Est. Priority Date: 12/06/2016
• Status: Active Grant

• Current Assignee: DIRECTV, LLC (AT&T, Inc.)
• Original Assignee: The DIRECTV Group, Inc. (AT&T, Inc.)
• Inventors: Engineer, Hiten
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Newlin, Timothy R
• Application Number:
  US15/371,183
• Publication Number:
  US 20180160189A1
• Time in Patent Office: 875 Days
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/74 Browsing; Visualisation therefor end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic program guides, H04N21/472
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4821 using a grid, e.g. sorted out by channel and broadcast time
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Video and audio content is searchable using a text search. A search component can analyze respective items of content to identify words spoken in the items of content, and generate respective transcripts of the respective words of the items of content based on the analysis. The search component receives a text search comprising a keyword and analyzes the respective transcripts to determine whether a transcript(s) contains a word that matches or substantially matches the keyword. The search component generates a search result(s) associated with the transcript(s) that at least is a substantial match to the keyword. The search component can present a time indicator indicating a time position in proximity to where the word is located in the content of the search result(s), and presentation of the content can start from that time position. The search component can be executed in a set-top box associated with a presentation device.

Claims

1. A method, comprising:

based on a keyword, searching, by a system comprising a processor, respective audio items of audio information in respective media items of media content to identify information of interest in a media item of the respective media items;

generating, by the system, a search result associated with the media item and relating to the information of interest based on the searching of the respective audio items in the respective media items;

estimating, by the system, a time location of the information of interest within an audio item in the media item based on a determination of a location of a word within a transcript of the media item relative to other words within the transcript, wherein the word corresponds to the keyword, wherein the transcript is received from a device associated with an external transcript source, wherein the transcript does not comprise time information that indicates the time location, and wherein the audio item is part of the respective audio items; and

determining, by the system, the time location of the information of interest within the audio item, based on a result of analyzing a first portion of the audio item that is in proximity to the estimation of the time location and is less than an entire portion of the audio item, to facilitate presenting a time indicator that indicates the time location in the media item where the information of interest is located relative to an overall time of the media item, wherein the time indicator is selectable to initiate a presentation of a second portion of the media item comprising the information of interest, and wherein a start time location of the second portion of the media item is within a defined proximity of the time location in the media item where the information of interest is determined to be located.

2. The method of claim 1, wherein the media item of the respective media items comprises a member of a group comprising video content and audio content.

3. The method of claim 1, further comprising:

receiving, by the system, a search query via an interface, wherein the search query comprises the keyword.

4. The method of claim 1, wherein the searching the respective audio items comprises searching respective transcripts, comprising respective textual items of textual information that correspond to respective words identified in the respective audio items, wherein the searching of the respective transcripts is performed to identify the information of interest that is associated with a word of the respective words in the respective transcripts that satisfies a defined match criterion with respect to the keyword.

5. The method of claim 4, further comprising:

analyzing, by the system, the respective audio items in the respective media items;

based on the analyzing, determining, by the system, the respective words that are stated in the respective audio items; and

based on the determining of the respective words, generating, by the system, the transcripts comprising the respective textual items that correspond to the respective words stated in the respective audio items.

6. The method of claim 4, further comprising:

obtaining, by the system, copies of the transcripts comprising the respective textual items that correspond to the respective words identified in the respective audio items, wherein the transcripts comprise the transcript.

7. The method of claim 4, further comprising:

obtaining, by the system, the transcripts comprising the respective textual items related to closed-captioning of the respective media items.

8. The method of claim 1, wherein the search result comprises textual information that comprises the word that corresponds to the keyword and the time indicator that indicates the time location in the media item where the information of interest is located relative to the overall time of the media item, and wherein the method further comprises:

presenting, by the system, the search result, comprising the time indicator, in connection with presentation of the media item.

9. The method of claim 8, further comprising:

receiving, by the system, input information indicating selection of the time indicator of the search result; and

in response to the input information, presenting, by the system, the second portion of the media item that has the start time location that is within the defined proximity of the time location in the media item where the information of interest is located based on the selection of the time indicator.

10. The method of claim 9, further comprising:

during the presenting of the second portion of the media item, presenting, by the system, the textual information relating to the information of interest in proximity to the time location in the media item where the information of interest is located; and

in connection with the presenting of the textual information, highlighting, by the system, the textual information relating to the information of interest during the presenting of the second portion of the media item.

11. The method of claim 1, further comprising:

receiving, by the system, the media item from a media source device, wherein the media source device is associated with a member of a group comprising an application, a cable television service, a satellite television service, a media streaming service, a media-on-demand service, a pay-per-view media service, a media content provider associated with an Internet, a media content provider associated with an intranet, a terrestrial television service, and a terrestrial radio service.

12. A system, comprising:

a processor; and

a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising;

searching respective items of audio data in respective media items to identify data of interest in a media item of the respective media items, based on a keyword;

generating a search result relating to the data of interest based on the searching of the respective items of the audio data in the respective media items, wherein the media item comprises a member of a group comprising video content and audio content;

estimating a time location of the data of interest within an item of audio data in the media item based on a location of a word within a transcript of the media item in relation to respective locations of other words within the transcript, wherein the word corresponds to the keyword, wherein the transcript is received from a device associated with an independent transcript source, wherein the transcript does not comprise time data that indicates the time location, and wherein the item of audio data is one of the respective items of audio data; and

determining the time location of the data of interest within the item of audio data, based on a result of analyzing a first portion of the item of audio data that is in proximity to the estimation of the time location and is less than an entire portion of the item of audio data, to facilitate presenting a time indicator that indicates the time location in the media item where the data of interest is located relative to a total time of the media item, wherein the time indicator is selectable to initiate a presentation of a second portion of the media item beginning at a defined period of time prior to the time location in the media item where the data of interest is determined to be located.

13. The system of claim 12, wherein the operations further comprise:

receiving a search request via an interface component, and wherein the search request comprises the keyword.

14. The system of claim 12, wherein the searching the respective items of the audio data comprises searching respective transcripts, comprising respective items of textual information that correspond to respective words identified in the respective items of the audio data, wherein the searching of the respective transcripts is performed to identify the data of interest that is associated with the word of the respective words in the respective transcripts that sufficiently corresponds to the keyword to satisfy a defined match criterion, and wherein the defined match criterion is used to define a keyword match.

15. The system of claim 14, wherein the operations further comprise:

analyzing the respective items of the audio data in the respective media items;

determining the respective words that are stated in the respective items of the audio data based on a result of the analyzing; and

generating the transcripts comprising the respective items of textual data that correspond to the respective words stated in the respective items of the audio data, based on the determining of the respective words.

16. The system of claim 15, wherein the generating of the transcripts, the searching of the respective items of the audio data in the respective media items, and the generating of the search result are executed within a set-top box device.

17. The system of claim 12, wherein the search result comprises textual data that comprises the word that corresponds to the keyword and the time indicator that indicates the time location in the media item where the data of interest is located relative to the total time of the media item, and wherein the operations further comprise:

displaying the search result in connection with presenting the media item.

18. The system of claim 17, wherein the operations further comprise:

receiving selection information indicating selection of the search result; and

in response to the selection information, initiating the presentation of the second portion of the media item beginning at the defined period of time prior to the time location in the media item where the data of interest is located.

19. A non-transitory machine-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

based on a keyword, searching respective items of audio information in respective items of video content comprising respective items of audio content to identify information of interest in an item of video content of the respective items of video content;

generating a search result associated with the item of video content and relating to the information of interest based on the searching of the respective items of audio information in the respective items of video content;

estimating a time location of the information of interest within an item of audio information in the item of video content based on a determination of a location of a word within a transcript of the item of video content relative to other words within the transcript, wherein the word corresponds to the keyword, wherein the transcript is received from a device associated with an external transcript source, wherein the transcript does not comprise time data that indicates the time location, and wherein the item of audio information is part of the respective items of audio information; and

determining the time location of the information of interest within the item of audio information, based on a result of analyzing a first portion of the item of audio information that is in within a defined amount of time of the estimation of the time location and is less than an entire portion of the item of audio information, to facilitate presenting a time indicator that indicates the time location in the item of video content where the information of interest is located relative to an overall time of the item of video content, wherein the time indicator is selectable to initiate a presentation of a second portion of the item of video content that begins at a start time location that is within a defined proximity of the time location in the item of video content where the information of interest is determined to be located.

20. The non-transitory machine-readable storage medium of claim 19, wherein the searching the respective items of audio information in the respective items of video content comprises searching respective transcripts, comprising respective items of textual information that correspond to respective words identified in the respective items of audio information, wherein the searching of the respective transcripts facilitates identifying the information of interest that is associated with a word of the respective words in the respective transcripts that satisfies a defined match criterion, and wherein the defined match criterion relates to keyword matches.