Using digital fingerprints to associate data with a work

• US 9,081,778 B2
• Filed: 09/25/2012
• Issued: 07/14/2015
• Est. Priority Date: 09/25/2012
• Status: Active Grant

• Current Assignee: Audible Magic Corporation
• Original Assignee: Audible Magic Corporation
• Inventors: Garside, Vic, Friedman, Jay, Schrempp, James, Williams, Robert
• Primary Examiner(s): AL HASHEMI, SANA A
• Application Number:
  US13/626,709
• Publication Number:
  US 20140089307A1
• Time in Patent Office: 1,022 Days
• Field of Search: 707/607, 707/609, 707/705, 707/790, 707/813, 707/821
• US Class Current: 1/1
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: H04L 9/3247 involving digital signatures

Abstract

A computing device, during sampling or playback of a work, receives a command to associate data with the work at a particular point in the work. The computing device generates a digital fingerprint of a segment of the work, wherein the segment corresponds to the particular point in the work. The computing device then associates the data with the digital fingerprint.

Claims

1. A method comprising:

receiving, by a user device, a command to associate data with a work at a particular point in the work;

generating, by the user device, a user digital fingerprint of a segment of the work, wherein the segment corresponds to the particular point in the work, and wherein the user digital fingerprint comprises a feature vector of the segment of the work generated by the user device; and

associating the data with the user digital fingerprint, wherein the user digital fingerprint associated with the data is usable to identify the particular point in the work at which an action associated with the data is to be performed.

2. The method of claim 1, wherein said data comprises at least one of a text commentary, a digital image, a uniform resource locator (URL), a video, a sound effect, or a command.

3. The method of claim 1, further comprising:

querying a server, the query comprising the user digital fingerprint;

receiving a master digital fingerprint of a segment of a copy of the work from the server, the segment of the copy corresponding to the segment of the work, wherein the master digital fingerprint comprises a feature vector of a high quality version of the work; and

replacing the user digital fingerprint with the master digital fingerprint.

4. The method of claim 3, further comprising:

analyzing a quality of the segment of the work based on at least one of characteristics of the segment or characteristics of the user digital fingerprint; and

querying the server in response to determining, based on the analysis, that the quality of the segment of the work fails to satisfy a quality threshold.

5. The method of claim 1, further comprising:

transmitting the user digital fingerprint and associated data to a server for later use during playback of the work on a computing device.

6. The method of claim 1, further comprising:

sending a request to a server to subscribe to additional data provided by an entity that generated the additional data;

receiving the additional data and an additional fingerprint associated with the additional data, the additional fingerprint having been generated from an additional segment of the work that corresponds to an additional point in the work;

during playback of the work on the user device, identifying the additional point in the work using the additional fingerprint; and

presenting, by the user device, the additional data during the playback of the additional point in the work.

7. The method of claim 6, wherein identifying the additional point in the work comprises:

generating a plurality of fingerprints for a plurality of segments of the work; and

comparing the additional fingerprint to the plurality of fingerprints to find one of the plurality of fingerprints that approximately matches the additional fingerprint.

8. A method comprising:

receiving, by a computing device, a digital fingerprint of a segment of a work and data associated with the digital fingerprint, wherein the digital fingerprint comprises a feature vector of the segment of the work and is usable to identify a particular point in the work at which an action associated with the data is to be performed;

comparing, by the computing device, the digital fingerprint to a collection of digital fingerprints of known works, each of the collection of digital fingerprints comprising a feature vector of a segment of a known work;

identifying an additional digital fingerprint from the collection of digital fingerprints that approximately matches the digital fingerprint of the segment of the work, wherein the additional digital fingerprint is of a segment of a known work that corresponds to the segment of the work;

associating, by the computing device, the data with the matching digital fingerprint; and

storing the data by the computing device, wherein the data is configured to be presented during playback of the segment of the known work.

9. The method of claim 8, wherein said data comprises at least one of a text commentary, a digital image, a uniform resource locator (URL), a video, a sound effect, or a command.

10. The method of claim 8, wherein the data comprises the digital fingerprint, the method further comprising:

determining, based on the digital fingerprint, that the segment of the work is of a lower quality than a corresponding segment of the known work in the collection; and

replacing the digital fingerprint in the data with the additional digital fingerprint.

11. The method of claim 8, further comprising:

transmitting, by the computing device, the additional digital fingerprint and the data back to a client device from which the digital fingerprint was received.

12. The method of claim 8, further comprising:

receiving a request for the known work from a client;

streaming the known work to the client;

determining, based on the additional digital fingerprint, a point in the known work to insert the data; and

sending the data to the client such that the data will be presented to the client at the point in the known work.

13. The method of claim 8, further comprising:

receiving a request from a client to subscribe to data provided by an entity that generated the data; and

transmitting the data and the additional digital fingerprint to the client, wherein the client determines, based on the additional digital fingerprint, a point in the known work to present the data.

14. A computer readable medium having instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

sending a request to a server to subscribe to data associated with a work;

receiving the data and a digital fingerprint associated with the data, the digital fingerprint having been generated from a segment of the work that corresponds to a particular point in the work, wherein the digital fingerprint comprises a feature vector of the segment of the work;

during playback of the work, identifying, by the processing device, the point in the work using the digital fingerprint; and

performing, by the processing device, an action associated with the data during the playback of the particular point in the work.

15. The computer readable medium of claim 14, the operations further comprising

during playback of the work by the processing device, receiving a command to associate additional data with the work at an additional particular point in the work;

generating, by the processing device, a user digital fingerprint of an additional segment of the work, wherein the additional segment corresponds to the additional particular point in the work; and

associating the additional data with the user digital fingerprint.

16. The computer readable medium of claim 15, the operations further comprising:

querying the server, the query comprising the user digital fingerprint;

receiving a master digital fingerprint of a segment of a copy of the work from the server, the segment of the copy corresponding to the additional segment of the work; and

replacing the user digital fingerprint with the master digital fingerprint.

17. The computer readable medium of claim 16, the operations further comprising:

analyzing a quality of the additional segment of the work based on at least one of characteristics of the additional segment or characteristics of the user digital fingerprint; and

querying the server in response to determining, based on the analysis, that a quality of the additional segment of the work fails to satisfy a quality threshold.

18. The computer readable medium of claim 15, the operations further comprising:

transmitting the user digital fingerprint and associated data to the server for later use during playback of the work on a computing device.

19. A computer readable medium having instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receiving a user digital fingerprint of a segment of a work and data associated with the user digital fingerprint, wherein the user digital fingerprint comprises a feature vector of the segment of the work generated by a user device and is usable to identify a particular point in the work at which an action associated with the data is to be performed;

comparing, by the processing device, the user digital fingerprint to a collection of master digital fingerprints of known works, wherein each master digital fingerprint of the collection of master digital fingerprints comprises a feature vector of a high quality version of a known work;

identifying a master digital fingerprint from the collection of master digital fingerprints that approximately matches the user digital fingerprint of the segment, wherein the master digital fingerprint is of a segment of a known work that corresponds to the segment of the work;

associating, by the processing device, the data with the master digital fingerprint; and

storing the data, wherein the data is configured to be presented during playback of the segment of the known work.

20. The computer readable medium of claim 19, the wherein the data comprises the digital fingerprint, the operations further comprising:

determining, based on the user digital fingerprint, that the segment is of a lower quality than a corresponding segment of the known work in the collection; and

replacing the user digital fingerprint in the data with the master digital fingerprint.

21. The computer readable medium of claim 19, the operations further comprising:

transmitting, by the processing device, the master digital fingerprint and the data back to a client device from which the user digital fingerprint was received.

22. The computer readable medium of claim 19, the operations further comprising:

receiving a request for the known work from a client;

streaming the known work to the client;

determining, based on the master digital fingerprint, a point in the known work to insert the data; and

sending the data to the client such that the data will be presented to the client at the point in the known work.

23. The computer readable medium of claim 19, the operations further comprising:

receiving a request from a client to subscribe to data provided by an entity that generated the data;

transmitting the data and the master digital fingerprint to the client, wherein the client determines, based on the master digital fingerprint, a point in the known work to present the data.

24. A system, comprising:

a first computing device comprising a memory and a processor coupled with the memory, wherein the processor is to;

receive a user digital fingerprint of a segment of a work and data associated with the user digital fingerprint, wherein the user digital fingerprint comprises a feature vector of the segment of the work generated by a user device and is usable to identify a particular point in the work at which an action associated with the data is to be performed;

compare the user digital fingerprint to a collection of master digital fingerprints of known works, wherein each master digital fingerprint of the collection of master digital fingerprints comprises a feature vector of a high quality version of a known work;

identify a master digital fingerprint from the collection of master digital fingerprints that approximately matches the user digital fingerprint of the segment, wherein the master digital fingerprint is of a segment of a known work that corresponds to the segment of the work;

associate the data with the master digital fingerprint; and

store the data, wherein the data is configured to be presented during playback of the segment of the known work.

25. The system of claim 24, wherein the data comprises the user digital fingerprint, the processor being further to:

determine, based on the user digital fingerprint, that the segment is of a lower quality than a corresponding segment of the known work in the collection; and

replace the user digital fingerprint in the data with the master digital fingerprint.

26. The system of claim 24, wherein the processor is further to:

transmit the master digital fingerprint and the data back to a client device from which the user digital fingerprint was received.

27. The system of claim 24, wherein the processor is further to:

receive a request for the known work from a client;

stream the known work to the client;

determine, based on the master digital fingerprint, a point in the known work to insert the data; and

send the data to the client such that the data will be presented to the client at the point in the known work.

28. The system of claim 24, wherein the processor is further to:

receive a request from a client to subscribe to data provided by an entity that generated the data; and

transmit the data and the master digital fingerprint to the client, wherein the client determines, based on the master digital fingerprint, a point in the known work to present the data.

29. The system of claim 24, further comprising:

a second computing device networked to the first computing device, wherein the second computing device is to;

during playback of the work on the second computing device, receive a command to associate the data with the work at a particular point in the work;

generate the user digital fingerprint of the segment of the work, wherein the segment corresponds to the particular point in the work;

associate the data with the user digital fingerprint; and

transmit the user digital fingerprint and associated data to the first computing device.

30. The system of claim 24, further comprising:

a second computing device networked to the first computing device, wherein the second computing device is to;

send a request to the first computing device to subscribe to a particular data category, wherein the data is associated with the particular data category;

receive the data and the master fingerprint associated with the data;

during playback of the work on the computing device, identify a point in the work using the master fingerprint; and

present the data at the identified point in the work.