Secondary soundtrack delivery

• US 9,813,776 B2
• Filed: 06/25/2012
• Issued: 11/07/2017
• Est. Priority Date: 06/25/2012
• Status: Active Grant

• Current Assignee: Pin Pon LLC
• Original Assignee: Pin Pon LLC
• Inventors: Garcia, Roberto
• Primary Examiner(s): MAUNG, THOMAS H
• Application Number:
  US13/532,089
• Publication Number:
  US 20130345841A1
• Time in Patent Office: 1,961 Days
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

Methods and systems for providing a secondary soundtrack to a user viewing an audiovisual work associated with a primary soundtrack. A secondary soundtrack corresponding to the primary soundtrack is determined. Soundtrack synchronization data from a user computing device is transmitted to a server, which determines a position within the primary soundtrack based on the soundtrack synchronization data. The selected secondary soundtrack is streamed to the client computing device based on the determined position, and played for a user of the client computing device.

Claims

1. One or more non-transitory computer-readable media having embodied thereon computer-executable instructions, wherein when executed by a computing device, the computer-executable instructions cause the computing device to:

transmit a primary soundtrack to a remote computing device, wherein the primary soundtrack includes a primary soundtrack identification data and is associated with a first spoken language, and wherein the primary soundtrack identification data includes one or more locations;

match, by the remote computing device, the one or more locations of a plurality of stored soundtracks associated with the one or more locations;

identify, by the remote computing device, at least one candidate primary soundtrack based on the match of the one or more locations to the plurality of stored soundtracks, wherein each of the at least one candidate primary soundtrack is associated with at least one secondary soundtrack, and wherein the at least one secondary soundtrack is associated with a second spoken language and is a translation of the first spoken language;

transmit, by the remote computing device, the at least one candidate primary soundtrack to the computing device;

receive a selection from a user of the computing device of one of the at least one candidate primary soundtrack, wherein the selection is associated to one of the at least one secondary soundtrack;

transmit the selection to the remote computing device;

receive, via a microphone of the computing device, a plurality of audio signals of the primary soundtrack;

calculate an acoustic fingerprint of the primary soundtrack based on the received plurality of audio signals;

transmit the calculated acoustic fingerprint to the remote computing device, wherein the remote computing device is configured to determine a position in the primary soundtrack based on the acoustic fingerprint, determine a corresponding position in the selection based on the determined position in the primary soundtrack, and determine a corresponding position in the secondary soundtrack based on the determined position in the selection;

receive a stream of the secondary soundtrack based on the determined position;

determine whether an earphone or headphone is coupled in communication with the computing device;

upon determining that an earphone or headphone is not coupled in communication with the computing device, prompt a user to couple the earphone or the headphone to the computing device; and

upon determining that an earphone or headphone is coupled in communication with the computing device, play the secondary soundtrack through the earphone or headphone based on the corresponding position in the secondary soundtrack.

2. The computer-readable media of claim 1, wherein the computer-executable instructions further cause the computing device to transmit a location of the computing device to a the remote computing device, such that the primary soundtrack is determined from one or more candidate primary soundtracks that match the transmitted location of the computing device.

3. The computer-readable media of claim 1, wherein the computer-executable instructions cause the computing device to:

generate a soundtrack identification sample of the primary soundtrack based on the plurality of audio signals; and

determine the primary soundtrack based on the soundtrack identification sample.

4. The computer-readable media of claim 3, wherein the computer-executable instructions cause the computing device to:

calculate an acoustic fingerprint of at least a portion of the soundtrack identification sample;

transmit the acoustic fingerprint to the remote computing device; and

receive, in response to the transmitted acoustic fingerprint, an identifier of the primary soundtrack from the remote computing device.

5. The computer-readable media of claim 1, wherein the computer-executable instructions further cause the computing device to decrease a brightness of a display of the computing device while the secondary soundtrack is played.

6. The computer-readable media of claim 1, wherein the computer-executable instructions further cause the computing device to:

calculate a target position within the secondary soundtrack based on a current position within the secondary soundtrack and a soundtrack position adjustment option when the soundtrack position adjustment option is selected by the user of the computing device, the soundtrack position adjustment option configured to directly adjust the position of the secondary soundtrack; and

play the secondary soundtrack based on the calculated target position.

15. The computer-readable media of claim 1, wherein the computer-executable instructions further cause the computing device to:

receive a determination of one or more primary soundtrack candidates;

receive a user selection of the one or more primary soundtrack candidates, the selection being the primary soundtrack;

determine one or more secondary soundtrack candidates; and

receive a user selection of the one or more secondary soundtrack candidates, the selection being the secondary soundtrack.

16. The computer-readable media of claim 1, wherein the remote computing device is further configured to determine a plurality of potential positions in the primary soundtrack based on the calculated acoustic fingerprint.

17. The computer-readable media of claim 16, wherein the remote computing device is further configured to select the position in the primary soundtrack based on a previous position in the primary soundtrack and the plurality of potential positions in the primary soundtrack.

18. The computer-readable media of claim 16, wherein the remote computing device is further configured to:

transmit a request to the computing device for additional synchronization data;

receive the additional synchronization data from the computing device; and

determine the position in the primary soundtrack based on the additional synchronization data and the plurality of potential positions in the primary soundtrack.

19. The computer-readable media of claim 1, wherein the remote computing device is further configured to

determine an additional secondary soundtrack;

determine a position in the additional secondary soundtrack based on the determined position in the primary soundtrack; and

combine the secondary soundtrack and the additional secondary soundtrack into a single stream to transmit to the computing device.

7. A method comprising:

transmitting a primary soundtrack to a remote computing device, wherein the primary soundtrack includes a primary soundtrack identification data and is associated with a first spoken language, and wherein the primary soundtrack identification data includes one or more locations;

matching, by the remote computing device, the one or more locations a plurality of stored soundtracks associated with the one or more locations;

identifying, by the remote computing device, at least one candidate primary soundtrack based on the match of the one or more locations to the plurality of stored soundtracks, wherein each of the at least one candidate primary soundtrack is associated with at least one secondary soundtrack, and wherein the at least one secondary soundtrack is associated with a second spoken language and is a translation of the first spoken language;

transmitting, by the remote computing device, the at least one candidate primary soundtrack to a computing device;

receiving, at a computing device, a selection from a user of the computing device of one of the at least one candidate primary soundtrack, wherein the selection is associated to one of the at least one secondary soundtrack;

transmitting the selection to the remote computing device;

receiving, via a microphone of the computing device, a plurality of audio signals of the primary soundtrack;

calculating an acoustic fingerprint of the primary soundtrack based on the received plurality of audio signals;

transmitting the calculated acoustic footprint fingerprint to the remote computing device, wherein the remote computing device is configured to determine a position within the primary soundtrack based on the acoustic fingerprint and determine a corresponding position in the selection based on the determined position in the primary soundtrack, and determine a corresponding position in the secondary soundtrack based on the determined position in the selection;

receiving a stream of the secondary soundtrack based on the determined position;

calculating a synchronization offset based on a computational latency associated with the computing device;

determining whether an earphone or headphone is coupled in communication with the computing device; and

upon determining that an earphone or headphone is coupled in communication with the computing device, playing the secondary soundtrack to the user based on the determined corresponding position and the synchronization offset.

8. The method of claim 7, further comprising:

generating a soundtrack identification sample of the primary soundtrack based on the received plurality of audio signals;

determining a candidate primary soundtrack based on the received soundtrack identification sample;

displaying an identifier of the candidate primary soundtrack to the user; and

displaying to the user one or more secondary soundtrack identifiers, each secondary soundtrack identifier corresponding to a plurality of secondary soundtracks associated with the candidate primary soundtrack, wherein receiving a selection comprises receiving from the user a selection of one of the displayed secondary soundtrack identifiers.

9. The method of claim 8, wherein determining a candidate primary soundtrack comprises determining a plurality of candidate primary soundtracks, and wherein displaying an identifier of the candidate primary soundtrack comprises displaying a plurality of primary soundtrack identifiers corresponding to the plurality of candidate primary soundtracks.

10. The method of claim 9, further comprising displaying to the user a plurality of candidate primary soundtrack identifiers corresponding to the plurality of candidate primary soundtracks, and receiving, from the user, a selection of one of the primary soundtrack identifiers, wherein displaying one or more secondary soundtrack identifiers comprises displaying one or more secondary soundtrack identifiers that are associated with the selection of one of the displayed primary soundtrack identifiers.

11. The method of claim 7, further comprising:

receiving, from the user, a soundtrack position adjustment request of the secondary soundtrack;

calculating a target position within the selected secondary soundtrack based on a current position within the selected secondary soundtrack and the received soundtrack position adjustment request; and

playing the secondary soundtrack associated with the selection to the user based on the calculated target position.

12. A system for providing a soundtrack to a user, said system comprising:

a memory device for storing a primary soundtrack and a secondary soundtrack, wherein the primary soundtrack is associated with a first spoken language, and wherein the secondary soundtrack is associated with a second spoken language and is a translation of the primary soundtrack;

a microphone;

a media output component; and

a processor coupled to said memory device and programmed to;

transmit a primary soundtrack to a remote computing device, wherein the primary soundtrack includes a primary soundtrack identification data and is associated with a first spoken language, and wherein the primary soundtrack identification data includes one or more locations;

match, by the remote computing device, the one or more locations of a plurality of stored soundtracks associated with the one or more locations;

identify, by the remote computing device, at least one candidate primary soundtrack based on the match of the one or more locations to the plurality of stored soundtracks, wherein each of the at least one candidate primary soundtrack is associated with at least one secondary soundtrack, and wherein the at least one secondary soundtrack is associated with a second spoken language and is a translation of the first spoken language;

transmit, by the remote computing device, the at least one candidate primary soundtrack to a computing device;

receive a selection from a user of one of the at least one candidate primary soundtrack, wherein the selection is associated to one of the at least one secondary soundtrack;

transmit the selection to the remote computing device;

receive, via the microphone, a plurality of audio signals of the primary soundtrack;

calculate an acoustic fingerprint of the primary soundtrack based on the received plurality of audio signals;

transmit the calculated acoustic fingerprint to the remote computing device, wherein the remote computing device is configured to determine a position within the primary soundtrack based on the acoustic fingerprint, calculate a synchronization offset based on a computational latency associated with the system, determine a corresponding position in the selection based on the determined position in the primary soundtrack, and determine a corresponding position in the secondary soundtrack based on the determined position in the selection;

receive a stream of the secondary soundtrack based on the determined position;

determine whether an earphone or headphone is coupled in communication with the media output component; and

upon determining that an earphone or headphone is coupled in communication with the media output component, play the secondary soundtrack associated with the selection to the user based on the corresponding position and the synchronization offset.

13. The system of claim 12, wherein said processor is programmed to:

generate a soundtrack identification sample of the primary soundtrack based on the plurality of audio signals; and

determine the primary soundtrack based on soundtrack identification sample.

14. The system of claim 13, wherein said processor is programmed to select one secondary soundtrack of the one or more secondary soundtracks at least in part by:

calculate an acoustic fingerprint of at least a portion of the soundtrack identification sample;

transmit, to the remote computing device, the acoustic fingerprint; and

receive, in response to the transmitted acoustic fingerprint, an identifier of the primary soundtrack from the remote computing device.