Time ordered indexing of an information stream

• US 8,972,840 B2
• Filed: 04/12/2007
• Issued: 03/03/2015
• Est. Priority Date: 11/03/2001
• Status: Active Grant

• Current Assignee: Longsand Limited (Open Text Corporation)
• Original Assignee: Longsand Limited (Open Text Corporation)
• Inventors: Karas, D. Matthew, Muldrew, William J.
• Primary Examiner(s): Paula, Cesar
• Assistant Examiner(s): Schallhorn, Tyler J
• Application Number:
  US11/734,409
• Publication Number:
  US 20070198259A1
• Time in Patent Office: 2,882 Days
• Field of Search: 704/211, 704/253, 715/208, 725/51
• US Class Current: 715/203
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: G10L 15/05 Word boundary detection
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/56 Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

Methods and apparatuses in which two or more types of attributes from an information stream are identified. Each of the identified attributes from the information stream is encoded. A time ordered indication is assigned with each of the identified attributes. Each of the identified attributes shares a common time reference measurement. A time ordered index of the identified attributes is generated.

Claims

1. A method, comprising:

converting, by a computer, spoken words in an information stream to written text, the information stream containing at least audio information; and

generating, by the computer, a separate encoded file for every spoken word, wherein each encoded file shares a common time reference.

2. The method of claim 1, wherein the information stream contains audio-visual information and the each encoded file shares a common time reference to a video frame.

3. The method of claim 2, further comprising:

detecting shot change information;

creating thumbnail images for each shot change;

generating an encoded file for every shot change, each encoded file for the respective shot change containing a time ordered indication referencing to one or more corresponding spoken words.

4. The method of claim 2, further comprising:

generating a link to the video frame based upon a user selecting one or more of the spoken words.

5. The method of claim 2, further comprising:

generating a link to respective material based upon the spoken words and synchronizing a display of the link in less than five seconds from analyzing the information stream.

6. A non-transitory machine-readable medium storing instructions, which when executed by a machine, cause the machine to

convert spoken words in an information stream to written text, the information stream containing audio-visual information;

and

generate a separate encoded file for every spoken word, each encoded file containing a time ordered indication reference to a respective video frame.

7. The machine-readable medium of claim 6, storing further instructions which when executed cause the machine to:

detect shot change information;

create thumbnail images for each shot change; and

generate an encoded file for every shot change, each encoded file for the respective shot change containing a time ordered indication referencing to one or more corresponding spoken words.

8. The machine-readable medium of claim 6, storing further instructions which when executed cause the machine to:

generate a link to respective material based upon the spoken words and synchronizing a display of the link in less than five seconds from analyzing the information stream.

9. The machine-readable medium of claim 6, storing further instructions which when executed cause the machine to:

individually synchronize each word in a transcript from the information stream to be frame accurate to corresponding video data based upon both sharing a common time reference.

10. An apparatus, comprising:

a non-transitory computer readable medium storing instructions; and

at least one processor, the instructions executable on the at least one processor to;

convert spoken words in an information stream to written text, the information stream containing at least audio information; and

generate a separate encoded file for every spoken word, wherein each encoded file shares a common time reference.

11. The apparatus of claim 10, wherein the information stream contains audio-visual information and the each encoded file shares a common time reference to a video frame.

12. The apparatus of claim 10, wherein the instructions are executable on the at least one processor to:

detect shot change information;

create thumbnail images for each shot change;

generate an encoded file for every shot change, each encoded file for the respective shot change containing a time ordered indication referencing to one or more corresponding spoken words.

13. The apparatus of claim 11, wherein the instructions are executable on the at least one processor to:

generate a link to the video frame based upon a user selecting one or more of the spoken words.