Synchronization of multiple audio assets and video data

• US 10,341,714 B2
• Filed: 09/01/2017
• Issued: 07/02/2019
• Est. Priority Date: 04/27/2011
• Status: Active Grant

• Current Assignee: Time Warner Cable Enterprises LLC (Charter Communications Incorporated)
• Original Assignee: Time Warner Cable Enterprises LLC (Charter Communications Incorporated)
• Inventors: Hawkins, Sherisse, Osminer, Matthew, Cholas, Chris
• Primary Examiner(s): Nguyen Ba, Hoang Vu A
• Application Number:
  US15/693,626
• Publication Number:
  US 20170366839A1
• Time in Patent Office: 669 Days
• Field of Search: None
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/41415 involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/4856 for language selection, e.g. for the menu or subtitles
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56

Abstract

Digital video data and digital multiple-audio data are extracted from a source, using a hardware processor in a content source device within a premises. The extracted digital video data is processed for display on a main display device in the premises; and the extracted digital multiple-audio data is processed into a primary soundtrack in a primary language, to be listened to within the premises in synchronization with the displayed extracted digital video data. The primary soundtrack corresponds to the displayed extracted digital video data, in the primary language. The extracted digital multiple-audio data is processed into at least one secondary audio asset, different than the primary soundtrack; and the at least one secondary audio asset is transmitted to a personal media device within the premises, for apprehension by a user of the personal media device in synchronization with the displayed extracted digital video data.

Claims

1. A method comprising the steps of:

obtaining, at a personal media device in a premises, from a content source device in said premises, a secondary audio asset; and

providing, from said personal media device to said content source device, data indicative of a time delay causing said content source device to delay display of digital video data and playback of a primary soundtrack synchronizing a playback of said at least one secondary audio asset by said personal media device with said display of said digital video data and said playback of said primary soundtrack.

2. The method of claim 1, wherein said obtaining of said secondary audio asset comprises obtaining as packets specifically addressed to said personal media device.

3. The method of claim 1, wherein said secondary audio asset comprises at least one of:

a secondary soundtrack in a secondary language, said secondary soundtrack corresponding to said displayed digital video data, in said secondary language; and

a descriptive audio track.

4. The method of claim 3, wherein said obtaining of said secondary audio asset comprises obtaining non-compressed pulse code modulated audio wrapped in IP frames.

5. The method of claim 1, further comprising displaying, by said personal media device, subtitles of said secondary audio asset.

6. The method of claim 5, wherein in said step of obtaining said secondary audio asset, said subtitles comprise subtitles in a language other than a primary language of said primary soundtrack, corresponding to said displayed digital video data.

7. The method of claim 1, wherein said content source device is provided by a multi-services operator, further comprising said multi-services operator inviting a user of said personal media device to download thereto an appropriate software application which enables said personal media device at least to provide a menu selection to said content source device specifying a chosen form of said secondary audio asset.

8. A method comprising the steps of:

obtaining, at a personal media device in a premises, from a content source device in said premises, a secondary audio asset; and

providing, from said personal media device to said content source device, data indicative of a time delay causing said content source device to delay display of digital video data synchronizing a playback of said secondary audio asset by said personal media device with said display of said digital video data, wherein a primary soundtrack is not played back by said content source.

9. The method of claim 8, wherein said obtaining of said secondary audio asset comprises obtaining as packets specifically addressed to said personal media device.

10. The method of claim 8, wherein said secondary audio asset comprises at least one of:

a secondary soundtrack in a secondary language, said secondary soundtrack corresponding to said displayed digital video data, in said secondary language; and

a descriptive audio track.

11. The method of claim 10, wherein said obtaining of said secondary audio asset comprises obtaining non-compressed pulse code modulated audio wrapped in IP frames.

12. The method of claim 8, further comprising:

displaying, by said personal media device, subtitles of said secondary audio asset and

playing, by said personal media device, said primary soundtrack.

13. The method of claim 12, wherein in said step of obtaining said secondary audio asset, said subtitles comprise subtitles in a language other than a primary language of said primary soundtrack, corresponding to said displayed digital video data.

14. The method of claim 8, wherein said content source device is provided by a multi-services operator, further comprising said multi-services operator inviting a user of said personal media device to download thereto an appropriate software application which enables said personal media device at least to provide a menu selection to said content source device specifying a chosen form of said secondary audio asset.