Audio enhanced electronic insertion of indicia into video

• US 6,184,937 B1
• Filed: 10/29/1998
• Issued: 02/06/2001
• Est. Priority Date: 04/29/1996
• Status: Expired due to Term

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Princeton Video Image, Inc. (Gabriel Technologies Corporation)
• Inventors: Williams, Brown F., Rosser, Roy J.
• Primary Examiner(s): Lee, Michael
• Application Number:
  US09/171,941
• Time in Patent Office: 831 Days
• Field of Search: H04/N.9475, 348/515, 348/512, 348/518, 348/571, 348/576, 348/578, 348/632, 348/633, 348/722, 348/423, 348/462, 348/480-485, 345/302, 704/270, 386/52, 386/54, 386/75
• US Class Current: 348/515
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A system and method (40) of altering the audio portion of a live television broadcast signal substantially in real time. The system is used to enhance the effects of live video insertion systems. The broadcast signal is received and separated into a pattern recognition unit (72) in order to recognize predetermined events. The broadcast audio is then altered based on the occurrence of said events. Alterations (68, 70) include modifications to attributes such as volume, tone, pitch, synchronization, echo, reverberation, and frequency profile. Once altered, the audio is re-synchronized (80) with the video channel which has undergone its own modification.

Claims

1. A method of altering the audio portion of a live television broadcast signal substantially in real time, said method comprising the steps of:

(a) receiving 18 said live television broadcast signal;

(b) separating the video and audio portions of said live television broadcast signal into separate channels;

(c) delaying 28 the video portion of said live television broadcast signal;

(d) recognizing 72 an event within the audio or video portion of said live television broadcast signal;

(e) altering 6870 the audio portion of said live television broadcast signal based upon said event;

(f) re-synchronizing 80 the audio and video portions of said live television broadcast signal; and

(g) outputting 50 the audio altered live television broadcast signal.

2. The method of claim 1 wherein said altering 68 step (e) optionally includes mixing 68 a second audio channel containing a predetermined audio clip 84 into said live television broadcast audio channel.

3. The method of claim 2 wherein said audio channels include audio attributes such as volume, tone, pitch, synchronization, echo, reverberation, and frequency profile.

4. The method of claim 3 wherein said altering 70 step (e) modifies at least one of said audio attributes.

5. The method of claim 4 wherein said recognizing 72 step (d) is based on audio pattern recognition of said event.

6. The method of claim 4 wherein said recognizing step (d) is based on video pattern recognition 64 of said event.

7. The method of claim 4 wherein said recognizing step (d) is based on direct operator input 66.

8. A method of altering the audio portion of a live television broadcast signal substantially in real time, said method comprising the steps of:

(a) receiving 18 said live television broadcast signal;

(b) converting 74 said live television broadcast signal from the analog domain to the digital domain;

(c) separating the video and audio portions of said live television broadcast signal into separate channels;

(d) delaying 28 the video portion of said live television broadcast signal;

(e) recognizing an event within the audio 72 or video 64 portion of said live television broadcast signal;

(f) altering 6870 the audio portion of said live television broadcast signal based upon said event;

(g) re-synchronizing 80 the audio and video portions of said live television broadcast signal;

(h) re-converting 82 said live television broadcast signal back to the analog domain; and

(i) outputting 50 the audio altered live television broadcast signal.

9. The method of claim 8 wherein said altering step (f) optionally includes mixing 68 a second audio channel containing a predetermined audio clip 84 into said live television broadcast audio channel.

10. The method of claim 9 wherein said audio channels include audio attributes 70 such as volume, tone, pitch, synchronization, echo, reverberation, and frequency profile.

11. The method of claim 10 wherein said altering 70 step (f) modifies at least one of said audio attributes.

12. The method of claim 11 wherein said recognizing step (e) is based on audio pattern recognition 72 of said event.

13. The method of claim 11 wherein said recognizing step (e) is based on video pattern recognition 64 of said event.

14. The method of claim 11 wherein said recognizing step (e) is based on direct operator input 66.

15. A method of altering the audio and video portion of a live television broadcast signal substantially in real time, said method comprising the steps of:

(a) receiving 18 said live television broadcast signal;

(b) converting 74 said live television broadcast signal from the analog domain to the digital domain;

(c) separating the video and audio portions of said live television broadcast signal into separate channels;

(d) delaying 28 the video portion of said live television broadcast signal;

(e) recognizing at least one event within the audio 72 or video 64 portion of said live television broadcast signal;

(f) altering 6870 the audio portion of said live television broadcast signal based upon said at least one event;

(g) altering the video portion of said live television broadcast signal based upon the same or a different one of said at least one event;

(h) re-synchronizing 80 the audio and video portions of said live television broadcast signal;

(i) re-converting 82 said live television broadcast signal back to the analog domain; and

(j) outputting 50 the audio altered live television broadcast signal.

16. The method of claim 15 wherein said altering step (f) optionally includes mixing 68 a second audio channel containing a predetermined audio clip 84 into aid live television broadcast audio channel.

17. The method of claim 16 wherein said audio channels include audio attributes such as volume, tone, pitch, synchronization, echo, reverberation, and frequency profile.

18. The method of claim 17 wherein said altering 70 step (f) modifies at least one of said audio attributes.

19. The method of claim 18 wherein said recognizing step (e) is based on audio pattern recognition 72 of said event.

20. The method of claim 18 wherein said recognizing step (e) is based on video pattern recognition 64 of said event.

21. The method of claim 18 wherein said recognizing step (e) is based on direct operator input 66.

22. A system for altering the audio portion of a live television broadcast signal substantially in real time comprising:

separation means for separating the audio and video portions of said live television broadcast signal into separate channels which are independently manipulatable;

audio pattern recognition means 72 for recognizing an event within the audio portion of said live television broadcast signal;

audio processor means 60 for receiving said audio portion of said live television broadcast signal and altering same based upon said event; and

,

re-synchronization means for re-synchronizing the audio and video portions of said live television broadcast signal after said live television broadcast signal audio portion has been altered.

23. The system of claim 22 wherein said audio processor means 60 further comprises:

first audio storage means 80 for storing and delaying said live television broadcast signal audio portion;

second audio storage means 84 for storing an insertable audio clip;

audio coordinator means 62 for receiving information regarding said event and controlling the type and timing of the altering of said live television broadcast signal audio portion;

audio mixer means 68 for selectively mixing, as controlled by said audio coordinator means, said insertable audio clip and said live television broadcast signal audio portion; and

audio effects means 70 for selectively modifying attributes of said live television broadcast signal audio portion and said mixed live television broadcast signal audio portion, as controlled by said audio coordinator means.

24. The system of claim 23 wherein said event information further includes signals received into said audio coordinator means 62 from sources outside of said audio processor means 60.

25. The system of claim 24 wherein said outside sources comprise operator input means 66, video pattern recognition means 64, field synchronization means 76, external trigger means 78, external clock means 78, or any combination thereof.

26. The system of claim 25 wherein said attributes include volume, tone, pitch, synchronization, echo, reverberation, and frequency profile.