Methods, systems, and products for alternate audio sources

• US 9,264,586 B2
• Filed: 04/28/2015
• Issued: 02/16/2016
• Est. Priority Date: 02/28/2007
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Meek, Dennis, Koch, Robert A.
• Primary Examiner(s): Smith, Chenea
• Application Number:
  US14/697,660
• Publication Number:
  US 20150237237A1
• Time in Patent Office: 294 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/4392 involving audio buffer management
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8166 involving executable data, e.g. software arrangements for executing specific programs G06F9/44; broadcasting computer programmes in broadcast systems H04H20/91; involving the movement of software or configuration parameters H04L67/34
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/04 : Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 5/265 : Mixing
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 5/607 : for more than one sound signal, e.g. stereo, multilanguages H04N5/602 takes precedence

Abstract

Audio and video signals are synchronized for pleasing presentation of content. As content is streamed to a device, an audio portion may lag or lead a video portion. Spoken words, for example, are out of synch with the lip movements. Video content is thus synchronized to audio content to ensure streaming content is pleasing.

Claims

1. A method, comprising:

receiving, by an electronic device, a video signal having video time stamps;

receiving, by the electronic device, an audio signal comprising audio time stamps;

obtaining, by the electronic device, an amount of asynchronism from the audio signal, the amount of asynchronism permitted between the video signal and the audio signal;

determining, by the electronic device, a difference between the audio time stamps and the video time stamps; and

delaying, by the electronic device, at least one of the video signal and the audio signal until the difference satisfies the amount of asynchronism.

2. The method of claim 1, further comprising querying for the audio signal related to the video signal.

3. The method of claim 1, further comprising:

determining the audio signal leads the video signal;

determining the difference between one of the audio time stamps and a corresponding one of the video time stamps; and

delaying the audio signal until the difference satisfies the amount of asynchronism.

4. The method of claim 1, further comprising:

determining the video signal leads the audio signal;

determining the difference between one of the audio time stamps and a corresponding one of the video time stamps; and

delaying the video signal until the difference satisfies the amount of asynchronism.

17. The memory device of claim 1, wherein the operations further comprise matching a video content identifier obtained from the video signal to an audio content identifier obtained from the audio signal.

5. A system, comprising:

a processor; and

a memory storing code that when executed causes the processor to perform operations, the operations comprising;

receiving a video signal comprising video time stamps;

separately receiving an audio signal comprising audio time stamps;

obtaining, from the video signal, a first amount of asynchronism permitted between the video signal and the audio signal;

obtaining, from the audio signal, a second amount of asynchronism permitted between the video signal and the audio signal;

selecting a smaller value of the first amount of asynchronism obtained from the video signal and the second amount of asynchronism obtained from the audio signal;

determining a difference between the audio time stamps and the video time stamps; and

delaying at least one of the video signal and the audio signal until the difference satisfies the smaller value selected from the first amount of asynchronism and the second amount of asynchronism.

6. The system of claim 5, wherein the operations further comprise querying for the audio signal.

7. The system of claim 5, wherein the operations further comprise determining the audio signal leads the video signal.

8. The system of claim 5, wherein the operations further comprise determining the audio signal lags the video signal.

9. The system of claim 5, wherein the operations further comprise retrieving the first amount of asynchronism encoded within the video signal.

10. The system of claim 5, wherein the operations further comprise retrieving the second amount of asynchronism encoded within the audio signal.

11. The system of claim 5, wherein the operations further comprise retrieving the first amount of asynchronism from the video signal.

12. The system of claim 5, wherein the operations further comprise retrieving the second amount of asynchronism from the audio signal.

13. A memory device storing instructions that when executed cause a processor to perform operations, the operations comprising:

receiving a video signal having video time stamps;

separately receiving an audio signal comprising audio time stamps;

receiving an amount of asynchronism from the video signal;

determining a difference between the audio time stamps and the video time stamps; and

delaying at least one of the video signal and the audio signal until the difference satisfies the amount of asynchronism.

14. The memory device of claim 13, wherein the operations further comprise querying for the audio signal.

15. The memory device of claim 13, wherein the operations further comprise determining the audio signal leads the video signal.

16. The memory device of claim 13, wherein the operations further comprise determining the audio signal lags the video signal.