Technique for annotating media

• US 6,332,144 B1
• Filed: 12/03/1998
• Issued: 12/18/2001
• Est. Priority Date: 03/11/1998
• Status: Expired due to Term

• Current Assignee: Eureka Database Solutions, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: AltaVista Company (Apollo Global Management, Inc.)
• Inventors: deVries, Arjen P., Sokolov, Michael, Kovalcin, David E., Eberman, Brian
• Primary Examiner(s): Amsbury, Wayne
• Assistant Examiner(s): HAVAN, THU THAO
• Application Number:
  US09/204,284
• Time in Patent Office: 1,111 Days
• Field of Search: 707/103, 707/102, 707/530, 707/4, 707/512, 707/3, 707/5, 709/205, 709/217, 364/926, 364/927, 704/8, 345/328, 345/326, 345/331, 345/302, 345/118, 345/2, 345/507, 711/152
• US Class Current: 1/1
• CPC Class Codes: G06F 16/7343 Query language or query format
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/955 Object-oriented
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/961 Associative
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure

Abstract

To annotate media, one or more particular times within a period defined by a start time and an end time of a media stream forming an item of audio or video media, are identified. The identified times are those at which content within the media stream corresponds to an annotation value. The annotation value is associated with the identified times to annotate the media.

Claims

1. A method for annotating media, comprising the steps of:

identifying one or more particular times within a period defined by a start time and an end time of a media stream at which content within the media stream corresponds to an annotation value;

associating the annotation value with the identified one or more particular times; and

identifying a probability representing a measure of confidence in an accuracy of the annotation value corresponding to the identified one or more particular times.

2. A method as recited in claim 1, wherein each of the identified one or more particular times defines a start time of an independently viewable portion of the media stream.

3. A method as recited in claim 1, wherein the period defined by the start time and the end time of the media stream forms an item of media, and wherein the item of media is one of an item of audio media and an item of video media.

4. A method as recited in claim 1, wherein the annotation value includes a textual item.

5. A method as recited in claim 4, wherein the textual item is a word.

6. A method as recited in claim 1, wherein the annotation value includes one of a person and a thing.

7. A method as recited in claim 1, wherein the annotation value is a first annotation value, and further comprising the steps of:

also identifying one or more particular times within the period at which content within the media stream corresponds to a second annotation value different than the first annotation value; and

associating the second annotation value with the also identified one or more particular times.

8. A method as recited in claim 7, wherein the first annotation value is a first type of annotation and the second annotation value is a second type of annotation which is different than the first type of annotation.

9. A method as recited in claim 8, wherein:

each of the identified and the also identified one or more particular times defines a start time of an independently viewable portion of the media stream; and

at least one of the independently viewable portions of the media stream having the start time defined by the identified one or more particular times overlaps at least one of the independently viewable portions of the media stream having the start time defined by the also identified one or more particular times.

10. A method as recited in claim 7, wherein the first annotation value is the same type of annotation as the second annotation value.

11. A method as recited in claim 1, further comprising the steps of:

associating the annotation value with the probability.

12. A method as recited in claim 11, wherein the probability is a first probability, further comprising the steps of:

later identifying one or more particular times within the period at which content within the media stream corresponds to the annotation value;

identifying a second probability representing a measure of confidence in an accuracy of the annotation value corresponding to the later identified one or more particular times; and

associating the annotation value with the later identified one or more particular times.

13. A method as recited in claim 12, further comprising the step of:

disassociating the identified one or more particular times with the annotation value if the second probability is higher than the first probability.

14. A method as recited in claim 1, wherein the identifying is performed by one of an automatic process and a manual process.

15. A method as recited in claim 14, wherein the identifying is performed by the automatic process, further comprising the steps of:

later identifying, by the manual process, one or more particular times within the period at which content within the media stream corresponds to the annotation value; and

associating the annotation value with the later identified one or more particular times.

16. A system for annotating media, comprising:

a processor configured to identify one or more particular times within a period defined by a start time and an end time of a media stream at which content within the media stream corresponds to an annotation value, and to identify a probability representing a measure of confidence in an accuracy of the annotation value corresponding to the identified one or more particular times; and

a memory configured store an annotation index having the annotation value associated with the identified one or more particular times.

17. A system as recited in claim 16, wherein:

the annotation value is a first annotation value;

the processor is further configured to also identify one or more particular times within the period at which content within the media stream corresponds to a second annotation value different than the first annotation value; and

the memory is further configured to store the annotation index with the second annotation value in association with the also identified one or more particular times.

18. A system as recited in claim 16, wherein:

the memory is further configured to store the annotation index with the annotation value associated with the probability.

19. A system as recited in claim 18, wherein the processor is a first processor and the probability is a first probability, and further comprising:

a second processor configured to later identify one or more particular times within the period at which content within the media stream corresponds to the annotation value, and to identify a second probability representing a measure of confidence in an accuracy of the annotation value corresponding to the later identified one or more particular times;

wherein the memory is further configured to store the annotation index with the annotation value associated with only the later identified one or more particular times if the second probability is higher than the first probability.

20. A system as recited in claim 19, further comprising:

a network interconnecting the first processor, the second processor, and the memory;

wherein the first processor, the second processor, and the memory are each located at a different network site.

21. An article of manufacture for annotating media, the article of manufacture comprising:

a computer readable storage medium; and

computer programming stored on the storage medium;

wherein the stored computer programming is configured to be readable from the computer readable storage medium by one or more computers and thereby cause the one or more computers to operate so as to;

identify one or more particular times within a period defined by a start time and an end time of a media stream at which content within the media stream corresponds to an annotation value;

associate the annotation value with the identified one or more particular times; and

identify a probability representing a measure of confidence in an accuracy of the annotation value corresponding to the identified one or more particular times.

22. An article of manufacture as recited in claim 21, wherein the annotation value is a first annotation value and the stored computer programming is further configured to be readable by the one or more computers to thereby cause the one or more computers to operate so as to:

also identify one or more particular times within the period at which content within the media stream corresponds to a second annotation value different than the first annotation value; and

associate the annotation value with the also identified one or more particular times.

23. An article of manufacture as recited in claim 21, wherein the stored computer programming is further configured to be readable by the one or more computers to thereby cause the one or more computers to operate so as to:

associate the annotation value with the probability.

24. An article of manufacture as recited in claim 23, wherein the probability is a first probability and the stored computer programming is further configured to be readable by the one or more computers to thereby cause the one or more computers to operate so as to:

later identify one or more particular times within the period at which content within the media stream corresponds to the annotation value;

identify a second probability representing a measure of confidence in an accuracy of the annotation value corresponding to the later identified one or more particular times; and

associate the annotation value with the later identified one or more particular times and the second probability.