Multi-channel audio enhancement for television

• US 8,046,792 B2
• Filed: 03/20/2002
• Issued: 10/25/2011
• Est. Priority Date: 03/20/2002
• Status: Active Grant

• Current Assignee: TiVo Corporation (Adeia Inc.)
• Original Assignee: TVWorks LLC (Comcast Corporation)
• Inventors: Sisson, Coleman Dale Jr., Seidel, Craig Howard
• Primary Examiner(s): SHANG, ANNAN Q
• Application Number:
  US10/103,486
• Publication Number:
  US 20030179283A1
• Time in Patent Office: 3,506 Days
• Field of Search: 348461- 2, 348/468, 348/569, 725 37- 61, 725 87-116, 725136-139, 709217-231
• US Class Current: 725/38
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4826 using recommendation lists, e.g. of programs or channels sorted out according to their score
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/602 for digital sound signals

Abstract

A comprehensive mechanism is provided for broadcasting and accessing multiple audio sources in connection with the viewing of a television program. In the preferred embodiment, the first step in providing audio is collecting the audio through the use of standard audio capture techniques. Next, the audio is distributed by either of in-band via broadcast or out-of-band techniques. In-band audio is preferably provided via an MPEG stream associated with the current television program. Out-of-band (OOB) audio can be broadcast as well, although it is preferable to select which channel is distributed upstream first, rather than broadcast all channels downstream and consume bandwidth for unselected audio. Thus, it is preferred that only the desired audio channel(s) are sent over the OOB channel. The audio is preferably tagged with metadata, such that information describing the audio accompanies each audio channel. This allows, for example, a description of the audio to be provided to the viewer as part of a selection mechanism (see below), and/or provides control information that is used by the system, for example to configure the system for a particular type of audio processing, e.g. DTS; display accompanying graphic information; such as an ad; or engage a viewer authentication/billing mechanism, for example to provide upstream information concerning the viewer'"'"'s selections. With either system, the viewer operates a set top box to select the appropriate audio channel(s) and route the television audio to a television or to a separate amplifier and speakers for reproduction.

Claims

1. A method comprising:

generating, by a computer, a multiplexed signal comprising;

a video signal corresponding to a program;

a plurality of audio signals corresponding to said video signal;

parental control rating information for at least one of the audio signals permitting a receiver to control which of the audio signals are presentable based on the rating information; and

metadata providing a description of audio content of each of the audio signals, wherein the description indicates that a first of the plurality of audio signals comprises audio commentary for the program from a first participant or first announcer and that a second of the plurality of audio signals comprises audio commentary for the program from a second participant or second announcer, and wherein the description provides information for prioritizing an order of titles of two or more of the audio signals based on viewer preferences for simultaneous presentation of the titles in the order; and

causing distribution of said multiplexed signal.

2. The method of claim 1, wherein one or more of said audio signals are recorded remotely from said video signal.

3. The method of claim 1, wherein said video signal and said audio signals are recorded simultaneously.

4. The method of claim 1, wherein said audio signals are encoded as MPEG signals.

5. The method of claim 1, wherein the first or second participant participate in an event depicted in the program, and wherein the audio commentary for the program from the first or second announcer describe activities occurring in the event.

6. A system comprising:

a distribution center comprising;

a multiplexing module configured to generate a multiplexed signal comprising;

a video signal corresponding to a program;

a plurality of audio signals corresponding to said video signal;

parental control rating information for at least one of the audio signals; and

metadata associated individually with each of the audio signals so that a description relating to each of the audio signals can be embedded in the multiplexed signal independently of a description relating to the other audio signals, wherein a first description indicates that a first of the plurality of audio signals comprises audio commentary for the program from a first participant or first announcer and a second description indicates that a second of the plurality of audio signals comprises audio commentary for the program from a second participant or second announcer; and

a transmission module configured to cause distribution of said multiplexed signal; and

a user unit comprising;

a receiving module configured to receive said multiplexed signal;

a demultiplexing module configured to demultiplex said multiplexed signal to provide said video signal and said plurality of audio signals in discrete form; and

a selection module configured to limit selection, based on the rating information, of which of the plurality of audio signals to play with said video signal.

7. The system of claim 6, wherein said selection module generates available audio signal options for a graphics overlay on a screen.

8. An apparatus comprising:

a receiving module configured to receive a multiplexed signal, said multiplexed signal comprising;

a video signal corresponding to a program;

a plurality of audio signals corresponding to said video signal;

parental control rating information for at least one of the audio signals; and

metadata providing a description of audio content of each of the audio signals, wherein the description indicates that a first of the plurality of audio signals comprises audio commentary for the program from a first participant or first announcer and that a second of the plurality of audio signals comprises audio commentary for the program from a second participant or second announcer, and wherein the description provides information for prioritizing an order of titles of two or more of the audio signals based on viewer preferences for simultaneous presentation of the titles in the order;

a demultiplexing module configured to demultiplex said multiplexed signal to provide said video signal and said plurality of audio signals in discrete form;

a selection module configured to limit presentation of the audio signals based on the rating information and to receive a selection of one of said plurality of audio signals; and

an output module configured to output said video signal and said selected audio signal.

9. The apparatus of claim 8, wherein said selection module is configured to generate available audio signal options for a graphics overlay on a display device.

10. The apparatus of claim 9, wherein said apparatus is a set top box.

11. A method comprising:

generating a video signal corresponding to a program;

generating, by a computer, a plurality of audio signals corresponding to said video signal;

generating parental control rating information for at least one of the audio signals permitting a receiver to control which of the audio signals are presentable based on the rating information; and

generating metadata providing a description of audio content of each of the audio signals, wherein the description indicates that a first of the plurality of audio signals comprises audio commentary for the program from a first participant or first announcer and that a second of the plurality of audio signals comprises audio commentary for the program from a second participant or second announcer;

causing distribution of said video signal; and

causing distribution of said audio signals as either an in-band audio signal or an out-of-band audio signal.

12. The method of claim 11, wherein one or more of said audio signals are recorded remotely from said video signal.

13. The method of claim 11, wherein said video signal and said audio signals are recorded simultaneously.

14. The method of claim 11, wherein the in-band audio signal is provided via an MPEG stream associated with said program.

15. The method of claim 11, wherein the description provides information for prioritizing an order of titles of two or more of the audio signals based on viewer preferences for simultaneous presentation of the titles in the order.

16. An apparatus comprising:

an audio capture module configured to receive a plurality of audio signals from at least two audio sources corresponding to a video signal; and

a multiplexor configured to generate a multiplexed signal comprising the video signal, the plurality of audio signals, parental control rating information for at least one of the audio signals permitting a receiver to control which of the audio signals are presentable based on the rating information, and metadata associated with each of the plurality of audio signals, wherein the metadata provides a description of audio content of each of the plurality of audio signals, and wherein the description indicates that a first of the plurality of audio signals comprises audio commentary for the video signal from a first participant or first announcer and that a second of the plurality of audio signals comprises audio commentary for the video signal from a second participant or second announcer.

17. A method comprising:

providing a multiplexed signal, the multiplexed signal comprising;

a video signal corresponding to a program,

a plurality of audio signals corresponding to the video signal,

parental control rating information for at least one of the audio signals; and

metadata providing a description of audio content of each of the audio signals, wherein the description indicates that a first of the plurality of audio signals comprises audio commentary for the program from a first participant or first announcer and that a second of the plurality of audio signals comprises audio commentary for the program from a second participant or second announcer;

demultiplexing, by a processor, the multiplexed signal to provide the video signal and the plurality of audio signals;

culling an audio signal list comprising the plurality of audio signals based on the parental control rating information;

causing presentation of the culled audio signal list;

receiving a selection of the first of the plurality of audio signals from the culled audio signal list; and

outputting the video signal and the first of the plurality of audio signals.

18. The method of claim 17, further comprising collecting preference information based on input information or on viewing preferences.

19. The method of claim 18, further comprising:

prioritizing an audio signal list comprising the plurality of audio signals based on the preference information; and

causing presentation of the audio signal list.

20. The method of claim 19,

wherein the preference information is generated based on inferences from the viewing preferences.

21. The method of claim 18, further comprising:

culling an audio signal list comprising the plurality of audio signals based on the preference information; and

causing presentation of the audio signal list.

22. The method of claim 18, further comprising:

receiving a selection of the second of the plurality of audio signals; and

causing audible output of the first of the plurality of audio signals simultaneous with causing output of closed captioning text of the second of the plurality of audio signals.

23. The method of claim 18, further comprising:

receiving a selection of the second of the plurality of audio signals; and

causing audible output of the first of the plurality of audio signals simultaneous with causing audible output of the second of the plurality of audio signals.