SYSTEM AND METHOD FOR DYNAMICALLY CONSTRUCTING AUDIO IN A VIDEO PROGRAM

• US 20100122285A1
• Filed: 11/07/2008
• Published: 05/13/2010
• Est. Priority Date: 11/07/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Vleck, Paul Van, Gibbon, David C., Begeja, Lee
• Granted Patent: US 8,122,468 B2
• Time in Patent Office: Days
• US Class Current: 725/34
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0271 Personalized advertisement
• CPC Class Codes: G06Q 30/0273 Determination of fees for advertising
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

Disclosed herein are systems, methods, and computer readable-media for dynamically constructing audio in a video program. The method includes extracting video metadata from a video program displayed on a playback device to a viewer, extracting component metadata from a plurality of audio components stored in a media object library, extracting viewer preferences from a viewer profile, receiving synchronization information about the video program, identifying a segment of the video program susceptible to inserting an audio component, based on extracted video metadata, component metadata, and viewer preferences, and transmitting the audio component to the playback device and a set of instructions detailing how to insert the audio component in real time in the segment of the video program. Video metadata can be extracted in real time. A viewer profile can be based on demographic information and a log of user behavior. The video program and the audio component can be combined before transmitting the video component and the set of instructions to the playback device. An audio component can be selected based on which advertiser offers to pay the most. The transmitted audio component and set of instructions can be stored as a construction list for future use.

Claims

1. A method of dynamically constructing audio in a video program, the method comprising:

receiving synchronization information about a video program;

identifying a segment of the video program susceptible to inserting an audio component, based on the video metadata from the video program displayed on a playback device and component metadata from a plurality of audio components stored in a media object library;

transmitting the audio component to the playback device and a set of instructions detailing how to insert the audio component in real time in the identified segment of the video program; and

constructing audio in the video program at the playback device using the audio component and the set of instructions.

2. The method of claim 1, wherein identifying a segment of the video program is based at least in part on viewer preferences.

3. The method of claim 1, wherein video metadata is extracted in real time.

4. The method of claim 1, wherein a viewer profile is based on demographic information and a log of user behavior.

5. The method of claim 1, the method further comprising combining the video program and the audio component before transmitting the video component and the set of instructions to the playback device.

6. The method of claim 1, wherein constructing the audio is done in conjunction with dynamic personalized video replacement.

7. The method of claim 1, the method further comprising storing the transmitted audio component and set of instructions as a construction list for future use.

8. The method of claim 1, the method further comprising:

ranking segments by prominence and audibility in the video program; and

assigning a price to each segment based on the ranking.

9. The method of claim 1, wherein an advertiser establishes guidelines governing the usage and placement of an advertiser'"'"'s audio components.

10. The method of claim 1, the method further comprising:

receiving feedback based on viewer behavior; and

generating a behavior model for the viewer based on the received feedback.

11. A system for dynamically constructing audio in a video program, the system comprising:

a module configured to receive synchronization information about a video program;

a module configured to identify a segment of the video program susceptible to inserting an audio component, based on the video metadata from the video program displayed on a playback device and component metadata from a plurality of audio components stored in a media object library;

a module configured to transmit the audio component to the playback device and a set of instructions detailing how to insert the audio component in real time in the identified segment of the video program; and

a module configured to construct audio in the video program at the playback device using the audio component and the set of instructions.

12. The system of claim 11, wherein identifying a segment of the video program is based at least in part on viewer preferences.

13. The system of claim 11, wherein video metadata is extracted in real time.

14. The system of claim 11, wherein a viewer profile is based on demographic information and a log of user behavior.

15. The system of claim 11, the system further comprising a module configured to combine the video program and the audio component before transmitting the video component and the set of instructions to the playback device.

16. A tangible computer-readable medium storing a computer program having instructions for dynamically constructing audio in a video program, the instructions comprising:

receiving synchronization information about a video program;

identifying a segment of the video program susceptible to inserting an audio component, based on the video metadata from the video program displayed on a playback device and component metadata from a plurality of audio components stored in a media object library;

transmitting the audio component to the playback device and a set of instructions detailing how to insert the audio component in real time in the identified segment of the video program; and

constructing audio in the video program at the playback device using the audio component and the set of instructions.

17. The computer-readable medium of claim 16, wherein identifying a segment of the video program is based at least in part on viewer preferences.

18. The computer-readable medium of claim 16, wherein video metadata is extracted in real time.

19. The computer-readable medium of claim 16, wherein a viewer profile is based on demographic information and a log of user behavior.

20. The computer-readable medium of claim 16, the instructions further comprising combining the video program and the audio component before transmitting the video component and the set of instructions to the playback device.