Providing audio and alternate audio simultaneously during a shared multimedia presentation

• US 9,971,319 B2
• Filed: 04/22/2014
• Issued: 05/15/2018
• Est. Priority Date: 04/22/2014
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Johnston, Robert, Kingsmill, Kirk, Wood, James
• Primary Examiner(s): Saunders, Jr., Joseph
• Application Number:
  US14/258,819
• Publication Number:
  US 20150301788A1
• Time in Patent Office: 1,484 Days
• Field of Search: 700 94
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: H04N 21/4112 having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages

Abstract

Aspects of the subject disclosure may include, for example, decoding first and second encoded audio portions extracted from a digitally encoded data stream to obtain first and second decoded audio portions. The digitally encoded data stream includes an encoded video portion, multiple encoded audio portions including the first and second audio portions and a reference marker. The first and second decoded audio portions are synchronized to a decoded video portion based on the reference marker. The first decoded audio portion is forwarded to equipment of a first user and the second decoded audio portion is forwarded to equipment of a second user. Presentations of the first decoded audio portion by the equipment of the first user and the second decoded audio portion by the equipment of the second user are synchronized to a presentation of the decoded video portion. Other embodiments are disclosed.

Claims

1. A method comprising:

receiving, by a media processing system including a processor, a digitally encoded data stream comprising an encoded video data portion, and a plurality of encoded audio data portions;

extracting, by the media processing system, from the digitally encoded data stream, a first encoded audio data portion of the plurality of encoded audio data portions comprising a default audio data portion;

decoding, by the media processing system, the first encoded audio data portion to obtain a first decoded audio portion;

forwarding, by the media processing system, the first decoded audio portion to a directional audio system, wherein a presentation of the first decoded audio portion by the directional audio system is synchronized to a presentation of a decoded video portion obtained from the encoded video data portion;

monitoring, by the media processing system, a selection of a second encoded audio data portion of the plurality of encoded audio data portions;

responsive to detecting the selection of the second encoded audio data portion;

extracting, by the media processing system, from the digitally encoded data stream, the second encoded audio data portion;

decoding, by the media processing system, the second encoded audio data portion to obtain a second decoded audio portion;

determining, by the media processing system, a timing error between the first decoded audio portion and the second decoded audio portion;

adjusting, by the media processing system, a variable delay of the second decoded audio portion by way of a feedback loop based on the timing error to obtain a delayed second decoded audio portion; and

forwarding, by the media processing system, the delayed second decoded audio portion to the directional audio system, wherein a presentation of the delayed second decoded audio portion by the directional audio system is synchronized to the presentation of the decoded video portion, and wherein the directional audio system directs first decoded audio portion and the delayed second decoded audio portion to different spatial regions within a viewing range of the presentation of the decoded video.

2. The method of claim 1, wherein the presentation of the delayed second decoded audio portion is acoustically isolated from the presentation of the first decoded audio portion based on a phasing of the decoded audio portion and a phasing of the delayed second decoded audio portion.

3. The method of claim 2, wherein the first decoded audio portion comprises a language and the delayed second decoded audio portion comprises a different language, each of the language and the different language corresponding to the presentation of the decoded video portion.

4. The method of claim 2, wherein the first decoded audio portion comprises a first verbal portion and a first non-verbal portion, and the delayed second decoded audio portion comprises a second verbal portion and a second non-verbal portion, wherein one of the second verbal portion, the second non-verbal portion, or both differ from a corresponding one of the first verbal portion, the first non-verbal portion, or both according to a hearing impairment.

5. The method of claim 1, further comprising providing by the media processing system, to equipment of a user, an indication of the plurality of encoded audio data portions.

6. The method of claim 5, wherein the selection of the second encoded audio data portion is responsive to the providing of the indication of the plurality of encoded audio data portions.

7. The method of claim 1, wherein the forwarding of the delayed second decoded audio portion to the directional audio system comprises forwarding the delayed second decoded audio portion, over-the-air, according to a wireless communication protocol.

8. A media processor comprising:

a memory that stores executable instructions; and

a processing system including a processor coupled to the memory, wherein the processing system, responsive to executing the instructions, facilitates performance of operations, the operations comprising;

extracting from a digitally encoded data stream, a first encoded audio portion, wherein the digitally encoded data stream comprises an encoded video portion, and a plurality of encoded audio portions;

decoding the first encoded audio portion to obtain a first decoded audio portion;

forwarding the first decoded audio portion to a directional audio system, wherein a presentation of the first decoded audio portion by the directional audio system is synchronized to a presentation of a decoded video portion obtained from the encoded video portion;

responsive to detecting a selection of a second encoded audio portion of the plurality of encoded audio portions;

extracting from the digitally encoded data stream, the second encoded audio portion;

decoding the second encoded audio portion to obtain a second decoded audio portion;

determining a timing error between the first decoded audio portion and the second decoded audio portion;

adjusting a variable delay of the second decoded audio portion by way of a feedback loop based on the timing error to obtain a delayed second decoded audio portion; and

forwarding the delayed second decoded audio portion to the directional audio system, wherein presentation of the delayed second decoded audio portion by the directional audio system is synchronized to the presentation of the decoded video portion, and wherein the directional audio system directs first decoded audio portion and the delayed second decoded audio portion to different spatial regions within a viewing range of the presentation of the decoded video.

9. The media processor of claim 8, wherein the presentation of the delayed second decoded audio portion is acoustically isolated from the presentation of the first decoded audio portion.

10. The media processor of claim 9, wherein the first decoded audio portion comprises a language and the delayed second decoded audio portion comprises a different language, each of the language and the different language corresponding to the presentation of the decoded video portion.

11. The media processor of claim 9, wherein the first decoded audio portion comprises a first verbal portion and a first non-verbal portion, and the delayed second decoded audio portion comprises a second verbal portion and a second non-verbal portion, wherein one of the second verbal portion, the second non-verbal portion, or both differ from a corresponding one of the first verbal portion, the first non-verbal portion, or both according to a hearing impairment.

12. The media processor of claim 8, wherein the operations further comprise providing to equipment of a user, an indication of the plurality of encoded audio portions.

13. The media processor of claim 12, wherein the selection of the second encoded audio portion is responsive to the providing of the indication of the plurality of encoded audio portions.

14. The media processor of claim 8, wherein the forwarding of the delayed second decoded audio portion to the directional audio system comprises forwarding the delayed second decoded audio portion, over-the-air, according to a wireless communication protocol.

15. A machine-readable storage device, comprising executable instructions which, responsive to being executed by a processing system including a processor, cause the processor to facilitate performance of operations comprising:

decoding a first encoded audio portion extracted from a digitally encoded data stream to obtain a first decoded audio portion, wherein the digitally encoded data stream comprises an encoded video portion, and a plurality of encoded audio portions;

forwarding the first decoded audio portion to a directional audio system, wherein a presentation of the first decoded audio portion by the directional audio system is synchronized to a presentation of a decoded video portion obtained from the encoded video portion;

monitoring for a selection based on a second encoded audio portion of the plurality of encoded audio portions;

responsive to detecting the selection;

decoding the second encoded audio portion to obtain a second decoded audio portion;

determining a timing error between the first decoded audio portion and the second decoded audio portion;

adjusting a variable delay of the second decoded audio portion by way of a feedback loop based on the timing error to obtain a delayed second decoded audio portion; and

forwarding the delayed second decoded audio portion to the directional audio system, wherein presentation of the delayed second decoded audio portion by the directional audio system is synchronized to the presentation of the decoded video portion, and wherein the directional audio system directs first decoded audio portion and the delayed second decoded audio portion to different spatial regions within a viewing range of the presentation of the decoded video.

16. The machine-readable storage device of claim 15, wherein the presentation of the delayed second decoded audio portion is acoustically isolated from the presentation of the first decoded audio portion.

17. The machine-readable storage device of claim 16, wherein the first decoded audio portion comprises a language and the delayed second decoded audio portion comprises a different language, each of the language and the different language corresponding to the presentation of the decoded video portion.

18. The machine-readable storage device of claim 15, wherein the operations further comprise providing, to equipment of a user, an indication of the plurality of encoded audio portions.

19. The machine-readable storage device of claim 18, wherein the selection of the second encoded audio portion is responsive to the providing of the indication of the plurality of encoded audio portions.

20. The machine-readable storage device of claim 15, wherein the forwarding of the delayed second decoded audio portion to the directional audio system comprises forwarding the delayed second decoded audio portion, over-the-air, according to a wireless communication protocol.