Method and system for generating annotations video

• US 7,050,110 B1
• Filed: 10/29/1999
• Issued: 05/23/2006
• Est. Priority Date: 10/29/1999
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Yeo, Boon-Lock, Lienhart, Rainer Wolfgang
• Primary Examiner(s): Yenke, Brian P.
• Application Number:
  US09/430,234
• Time in Patent Office: 2,398 Days
• Field of Search: 386/45, 386 68- 70, 386125-126, 386/96, 386/98, 348/575, 348/474, 348/584, 348/589, 345/328.BRS
• US Class Current: 348/474
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 5/60 for the sound signals
• CPC Class Codes: H04N 5/9201 involving the multiplexing of an additional signal and the video signal

Abstract

A method and system for processing video signals is disclosed. The system receives a video signal, a first audio signal containing an annotation and a second audio signal containing environmental sounds corresponding to the video signal. In one embodiment the system generates searchable annotations corresponding to the video and second audio signals via the first audio signal.

Claims

1. A method for processing video comprising:

receiving a video signal;

receiving a first audio signal containing annotations, wherein each annotation is preceded by a keyword to specify a type of that annotation;

receiving a second audio signal containing environmental sounds corresponding to the video signal; and

converting the annotations into searchable annotations organized as hierarchical shot clusters using a voice-to-text conversion system.

2. The method of claim 1 further comprising removing the annotations from the second audio signal.

3. The method of claim 2 wherein removing the annotation from the second audio signal further comprises utilizing a least-mean-square algorithm.

4. The method of claim 1 further comprising:

generating a center text title via the searchable annotations; and

generating a scrolling text banner via the searchable annotations.

5. The method of claim 1 further comprising generating a video abstract via the first and second audio signals, the video signal and the searchable annotations.

6. A system for processing video comprising:

a display device;

a video signal displayed on the display device;

a first audio signal containing annotations, wherein each annotation is preceded by a keyword to specify a type of that annotation;

a second audio signal containing environmental sounds corresponding to the video signal; and

a voice-to-text conversion system that converts the annotations into searchable annotations organized as hierarchical shot clusters.

7. The system of claim 6 further comprising a processor to remove the annotations from the second audio signal.

8. The system of claim 7 wherein the processor is further to:

generate a center text title with the computer searchable annotations; and

generate a scrolling text banner with the computer searchable annotations.

9. The system of claim 7 wherein the processor is further to generate a video abstract via the first and second audio signals, the video signal and the searchable annotations.

10. The system of claim 6 wherein the video signal is received from a video recorder.

11. The system of claim 6 wherein the first and second audio signals are received from at least one microphone.

12. A machine-readable medium having data stored thereon representing sets of instructions which, when executed by a machine, cause the machine to:

receive a video signal;

receive a first audio signal containing annotations, wherein each annotation is preceded by a keyword to specify a type of that annotation;

receive a second audio signal containing environmental sounds corresponding to the video signal; and

convert the annotations into searchable annotations organized as hierarchical shot clusters using a voice-to-text conversion system.

13. The machine-readable medium of claim 12 wherein the sets of instructions, when executed by the machine, further cause the machine to remove the annotations from the second audio signal.

14. The machine-readable medium of claim 12 wherein the sets of instructions, when executed by the machine, further cause the machine to:

generate a center text title via the searchable annotations; and

generate a scrolling text banner via the searchable annotations.

15. The machine-readable medium of claim 12 wherein the sets of instructions, when executed by the machine, further cause the machine to generate a video abstract via the first and second audio signals, the video signal and the searchable annotations.

16. An apparatus comprising:

an analog to digital (A/V) converter; and

a processor coupled to the A/V converter, the processor to

receive a video signal,

receive a first audio signal containing annotations, wherein each annotation is preceded by a keyword to specify a type of that annotation,

receive a second audio signal containing environmental sounds corresponding to the video signal, and

convert the annotations into searchable annotations organized as hierarchical shot clusters using a voice-to-text conversion system.

17. The apparatus of claim 16 wherein the processor is further to remove the annotations from the second audio signal.

18. The apparatus of claim 16 wherein the processor is further to:

generate a center text title with the computer searchable annotations; and

generate a scrolling text banner with the computer searchable annotations.

19. The apparatus of claim 16 wherein the video signal is received from a video recorder.