Using digital fingerprints to associate data with a work

• US 9,608,824 B2
• Filed: 06/08/2015
• Issued: 03/28/2017
• Est. Priority Date: 09/25/2012
• Status: Active Grant

• Current Assignee: Audible Magic Corporation
• Original Assignee: Audible Magic Corporation
• Inventors: Garside, Vic, Friedman, Jay, Schrempp, James, Williams, Robert
• Primary Examiner(s): Al Hashemi, Sana
• Application Number:
  US14/733,578
• Publication Number:
  US 20150270976A1
• Time in Patent Office: 659 Days
• Field of Search: 707/607, 707/609, 707/705, 707/813, 707/821
• US Class Current: 1/1
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: H04L 9/3247 involving digital signatures

Abstract

A computing device, during sampling or playback of a work, receives a command to associate data with the work at a particular point in the work. The computing device generates a digital fingerprint of a segment of the work, wherein the segment corresponds to the particular point in the work. The computing device then associates the data with the digital fingerprint.

Claims

1. A method comprising:

receiving, by a computing device, data and a digital fingerprint associated with the data, the digital fingerprint having been generated from a segment of a work that corresponds to a point in the work, wherein the digital fingerprint comprises a feature vector of the segment of the work;

during playback of the work, identifying, by the computing device, the point in the work using the digital fingerprint; and

performing, by the computing device, an action associated with the data during the playback of the point in the work.

2. The method of claim 1, further comprising

during playback of the work on the computing device, receiving a command to associate additional data with the work at an additional point in the work;

generating an additional digital fingerprint of an additional segment of the work, wherein the additional segment corresponds to the additional point in the work; and

associating the additional data with the additional digital fingerprint.

3. The method of claim 2, further comprising:

querying a server, the query comprising the additional digital fingerprint;

receiving a master digital fingerprint of a segment of a copy of the work from the server, the segment of the copy corresponding to the segment of the work; and

replacing the additional digital fingerprint with the master digital fingerprint.

4. The method of claim 3, further comprising:

analyzing a quality of the additional segment of the work based on at least one of characteristics of the additional segment or characteristics of the additional digital fingerprint; and

querying the server in response to determining, based on the analysis, that a quality of the additional segment of the work fails to satisfy a quality threshold.

5. The method of claim 2, further comprising:

transmitting the additional digital fingerprint and associated data to a server for later use during playback of the work on at least one of the computing device or an additional computing device.

6. The method of claim 1, further comprising:

sending a request to a server to subscribe to at least one of first data associated with the work or second data associated with a particular account, at least one of the first data or the second data comprising the received data.

7. The method of claim 1, wherein the data comprises at least one of a text commentary, a digital image, a uniform resource locator (URL), a video, a sound effect, or a command.

8. A non-transitory computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receiving, by the processing device, a command to associate data with a work at a point in the work;

generating, by the processing device, a first digital fingerprint of a segment of the work, wherein the segment corresponds to the point in the work, and wherein the first digital fingerprint comprises a feature vector of the segment of the work; and

associating the data with the first digital fingerprint, wherein the first digital fingerprint associated with the data is usable to identify the point in the work at which an action associated with the data is to be performed.

9. The non-transitory computer readable medium of claim 8, wherein said data comprises at least one of a text commentary, a digital image, a uniform resource locator (URL), a video, a sound effect, or a command.

10. The non-transitory computer readable medium of claim 8, the operations further comprising:

querying a server, the query comprising the first digital fingerprint;

receiving a second digital fingerprint of a segment of a high quality version of the work from the server, the segment of the high quality version of the work corresponding to the segment of the work; and

replacing the first digital fingerprint with the second digital fingerprint.

11. The non-transitory computer readable medium of claim 10, the operations further comprising:

analyzing a quality of the segment of the work based on characteristics of the segment; and

querying the server in response to determining, based on the analysis, that the quality of the segment of the work fails to satisfy a quality threshold.

12. The non-transitory computer readable medium of claim 10, the operations further comprising:

analyzing a quality of the segment of the work based on characteristics of the first digital fingerprint; and

querying the server in response to determining, based on the analysis, that the quality of the segment of the work fails to satisfy a quality threshold.

13. The non-transitory computer readable medium of claim 8, the operations further comprising:

transmitting the first digital fingerprint and associated data to a server for later use during playback of the work on at least one of the computing device or an additional computing device.

14. The non-transitory computer readable medium of claim 8, the operations further comprising:

sending a request to a server to subscribe to additional data;

receiving the additional data and an additional digital fingerprint associated with the additional data, the additional digital fingerprint having been generated from an additional segment of the work that corresponds to an additional point in the work;

during playback of the work on the computing device, identifying the additional point in the work using the additional digital fingerprint; and

presenting the additional data during the playback of the additional point in the work.

15. The non-transitory computer readable medium of claim 14, wherein identifying the additional point in the work comprises:

generating a plurality of fingerprints for a plurality of segments of the work; and

comparing the additional fingerprint to the plurality of fingerprints to find one of the plurality of fingerprints that approximately matches the additional fingerprint.

16. A computing device comprising:

a memory; and

a processing device coupled to the memory, the processing device to;

receive a command to associate data with a work at a point in the work;

generate a first digital fingerprint of a segment of the work, wherein the segment corresponds to the point in the work, and wherein the first digital fingerprint comprises a feature vector of the segment of the work; and

associate the data with the first digital fingerprint, wherein the first digital fingerprint associated with the data is usable to identify the point in the work at which an action associated with the data is to be performed.

17. The computing device of claim 16, wherein the processing device is further to:

query a server, the query comprising the first digital fingerprint;

receive a second digital fingerprint of a segment of a high quality version of the work from the server, the segment of the high quality version of the work corresponding to the segment of the work; and

replace the first digital fingerprint with the second digital fingerprint.

18. The computing device of claim 17, wherein the processing device is further to:

analyze a quality of the segment of the work based on at least one of characteristics of the segment or characteristics of the first digital fingerprint; and

query the server in response to determining, based on the analysis, that the quality of the segment of the work fails to satisfy a quality threshold.

19. The computing device of claim 16, wherein the processing device is further to:

transmit the first digital fingerprint and associated data to a server for later use during playback of the work on at least one of the computing device or an additional computing device.

20. The computing device of claim 16, wherein the processing device is further to:

send a request to a server to subscribe to additional data;

receive the additional data and an additional digital fingerprint associated with the additional data, the additional digital fingerprint having been generated from an additional segment of the work that corresponds to an additional point in the work;

during playback of the work on the computing device, identify the additional point in the work using the additional digital fingerprint; and

present the additional data during the playback of the additional point in the work.