TIME ORDERED INDEXING OF AN INFORMATION STREAM

• US 20070198259A1
• Filed: 04/12/2007
• Published: 08/23/2007
• Est. Priority Date: 11/03/2001
• Status: Active Grant

• Current Assignee: Longsand Limited (Open Text Corporation)
• Original Assignee: Longsand Limited (Open Text Corporation)
• Inventors: Muldrew, William, Karas, D.
• Granted Patent: US 8,972,840 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: G10L 15/05 Word boundary detection
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/56 Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

Methods and apparatuses in which two or more types of attributes from an information stream are identified. Each of the identified attributes from the information stream is encoded. A time ordered indication is assigned with each of the identified attributes. Each of the identified attributes shares a common time reference measurement. A time ordered index of the identified attributes is generated.

Claims

1. A method, comprising:

converting spoken words in an information stream to written text, the information stream containing at least audio information; and

generating a separate encoded file for every word, wherein each encoded file shares a common time reference.

2. The method of claim 1, wherein the information stream contains audio-visual information and the each encoded file shares a common time reference to a relevant video frame.

3. The method of claim 2, further comprising:

detecting shot change information; and

creating thumbnail images for each shot change; and

generating an encoded file for every shot change, each encoded file containing a time ordered indication referencing to one or more corresponding spoken words.

4. The method of claim 2, further comprising:

generating a link to the corresponding relevant video frame based upon a user selecting one or more of the spoken words.

5. The method of claim 2, further comprising:

generating a link to relevant material based upon the spoken words and synchronizing a display of the link in less than five seconds from analyzing the information stream.

6. A machine-readable medium that stores instructions, which when executed by a machine, to cause the machine to perform operations comprising:

converting spoken words in an information stream to written text, the information stream containing audio-visual information; and

generating a separate encoded file for every word, each encoded file contains a time ordered indication reference to a relevant video frame.

7. The article of manufacture of claim 6, which executes further instructions to cause the machine to perform the further operations comprising:

detecting shot change information; and

creating thumbnail images for each shot change;

generating an encoded file for every shot change, each encoded file containing a time ordered indication referencing to one or more corresponding spoken words.

8. The article of manufacture of claim 6, which executes further instructions to cause the machine to perform the further operations comprising:

generating a link to relevant material based upon the spoken words and synchronizing a display of the link in less than five seconds from analyzing the information stream.

9. The article of manufacture of claim 7, which executes farther instructions to cause the machine to perform the farther operations comprising:

generating an encoded file for every shot change, each encoded file containing a time ordered indication referencing to one or more corresponding spoken words.

10. The article of manufacture of claim 6, which executes further instructions to cause the machine to perform the further operations comprising:

individually synchronizing each word in a transcript from the information stream to be frame accurate to corresponding video data based upon both sharing a common time reference.

11. An apparatus comprising:

a software engine operable to apply one or more attribute filters to detect attributes from an information stream carrying at least audio information, identify the attributes, and assign a time ordered indication with each of the identified attributes so that each identified attribute of the information stream shares a common time reference, the software engine having an index control module to facilitate time order indexing of the identified attributes, and a manipulation-module to perform operations on a first set of attributes in order to manipulate a second set of attributes; and

a computer readable medium to store the software engine, and to provide instruction to a machine to execute instructions associated with the software engine.

12. The apparatus of claim 11, wherein the time ordered indication comprises a beginning frame count referenced to universal frame count referenced for all of the attributes from the information stream and an amount of frames in which the attribute was conveyed.

13. The apparatus of claim 11, wherein the time ordered indication comprises a start time and a time frame in which the identified attribute was conveyed.

14. The apparatus of claim 13, wherein the first set of attributes compromises a section of transcripted text and the second set of attributes comprises video images having approximately the same time ordered indications as the transcripted text.

15. The apparatus of claim 11, further comprising:

a triggering and synchronization module to dynamically trigger a link and synchronize the appearance of the link based upon a transcripted text from the information stream.