Methods for identifying audio or video content

• US 8,458,482 B2
• Filed: 12/14/2012
• Issued: 06/04/2013
• Est. Priority Date: 12/23/2005
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Conwell, William Y.
• Primary Examiner(s): McNally, Michael S
• Application Number:
  US13/714,930
• Publication Number:
  US 20130110870A1
• Time in Patent Office: 172 Days
• Field of Search: 713/176
• US Class Current: 713/176
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06N 5/048 Fuzzy inferencing
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06Q 50/18 Legal services
• CPC Class Codes: G06Q 50/265 Personal security, identity or safety
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 9/3247 involving digital signatures

Abstract

The disclosed technology generally relates to methods for identifying audio and video entertainment content. Certain shortcomings of fingerprint-based content identification can be redressed through use of human-reviewers.

Claims

1. A method comprising:

obtaining fingerprint data derived from user uploaded visual or audio content, the user uploaded visual or audio content having been uploaded by a user to a first party'"'"'s online video service for distribution from the first party'"'"'s online video service to the public, in which the user uploaded visual or audio content has been altered prior to being uploaded relative to a corresponding version of the user uploaded video or audio content;

determining reference content, from a universe of reference content, that is a possible match of the user uploaded visual or audio content, said determining being based on the fingerprint data and being performed by a computer system configured to perform such act;

queuing for review by a second party, different than the first party, the user uploaded visual or audio content item and data associated with the determined reference content;

obtaining assessment data from the second party, the assessment data indicating a result of a comparison of the user uploaded visual or audio content and the reference content by one or more human reviewer(s);

using the assessment data in concluding that the reference content corresponds with the user uploaded visual or audio content; and

controlling distribution of the user uploaded visual or audio content from the first party'"'"'s online video service to the public based on the concluding.

2. The method of claim 1 in which the user uploaded visual or audio content has been intentionally altered to avoid fingerprint matching.

3. The method of claim 1 in which said determining reference content utilizes a hamming distance.

4. The method of claim 1 in which said controlling distribution comprises interrupting delivery to a public user.

5. The method of claim 4 further comprising providing an explanatory message to the public user.

6. The method of claim 1 in which the first party provides a graphical interface to allow access by the second party for reviewing queued items.

7. The method of claim 1 in which said queuing includes providing a link to the determined reference content.

8. The method of claim 1 that further comprises deriving the fingerprint data from the user uploaded visual or audio content, said deriving comprising analyzing a transformed representation of the user uploaded visual or audio content, and in which said deriving utilizes hashing.

9. The method of claim 1 in which the user uploaded visual or audio content is available for distribution to the public from the first party'"'"'s online video service pending a result of said controlling distribution.

12. The computer system of claim 1 in which said determining reference content utilizes a hamming distance.

10. A computer system comprising:

one or more processors;

a non-transitory computer-readable readable medium storing executable code, the code when executed by the one or more processors causes the computer system to perform acts including;

obtaining fingerprint data derived from user uploaded visual or audio content, the user uploaded visual or audio content having been uploaded by a user to a first party'"'"'s online video service for distribution from the first party'"'"'s online video service to the public, in which the user uploaded visual or audio content has been altered prior to upload relative to a corresponding version of the user uploaded video or audio content;

determining reference content, from a universe of reference content, that is a possible match of the user uploaded visual or audio content, the determining being based on the fingerprint data;

queuing for review by a second party, different than the first party, the user uploaded visual or audio content item and data associated with the determined reference content;

obtaining assessment data from the second party, the assessment data indicating a result of a comparison of the user uploaded visual or audio content and the reference content by one or more human reviewer(s);

using the assessment data in concluding that the reference content corresponds with the user uploaded visual or audio content; and

controlling distribution of the user uploaded visual or audio content from the first party'"'"'s online video service to the public based on the concluding.

11. The computer system of claim 10 in which the user uploaded visual or audio content has been intentionally altered to avoid fingerprint matching.

13. The computer system of claim 10 further comprising code that when executed by the one or more processors causes the computer system to perform an act of updating the universe of reference content with the user uploaded visual or audio content.

14. The computer system of claim 10 in which the controlling distribution comprises interrupting delivery to a public user.

15. The computer system of claim 14 further comprising code that when executed by the one or more processors causes the computer system to perform an act of providing an explanatory message to the public user.

16. The computer system of claim 10 further comprising code that when executed by the one or more processors causes the computer system to perform an act of providing a graphical interface to allow access by the second party for reviewing queued items.

17. The computer system of claim 10 in which said queuing includes providing a link to the determined reference content.

18. The computer system of claim 10 that further comprises code that when executed by the one or more processors causes the computer system to perform acts including deriving the fingerprint data from the user uploaded visual or audio content, the deriving comprising analyzing a transformed representation of the user uploaded visual or audio content, and in which the deriving the fingerprint data utilizes hashing.

19. The computer system of claim 10 in which the user uploaded visual or audio content is available for distribution to the public from the first party'"'"'s online video service pending a result of said controlling distribution.

20. A non-transitory computer-readable readable medium storing executable code, the code when executed by one or more processors causes a computer system to perform acts including:

obtaining fingerprint data derived from user uploaded visual or audio content, the user uploaded visual or audio content having been uploaded by a user to a first party'"'"'s online video service for distribution from the first party'"'"'s online video service to the public, in which the user uploaded visual or audio content has been altered prior to upload relative to a corresponding version of the user uploaded video or audio content;

determining reference content, from a universe of reference content, that is a possible match of the user uploaded visual or audio content, the determining being based on the fingerprint data;

queuing for review by a second party, different than the first party, the user uploaded visual or audio content item and data associated with the determined reference content;

obtaining assessment data from the second party, the assessment data indicating a result of a comparison of the user uploaded visual or audio content and the reference content by one or more human reviewer(s);

using the assessment data in concluding that the reference content corresponds with the user uploaded visual or audio content; and

controlling distribution of the user uploaded visual or audio content from the first party'"'"'s online video service to the public based on the concluding.

21. The non-transitory computer-readable readable medium of claim 20 in which said determining reference content utilizes a hamming distance.

22. The non-transitory computer-readable readable medium of claim 20 further comprising code that when executed by the one or more processors causes the computer system to perform an act of updating the universe of reference content with the user uploaded visual or audio content.

23. The non-transitory computer-readable readable medium of claim 20 further comprising code that when executed by the one or more processors causes the computer system to perform an act of providing an explanatory message to the public user, and in which said determining reference content utilizes a hamming distance.

24. The non-transitory computer-readable readable medium of claim 20 further comprising code that when executed by the one or more processors causes the computer system to perform an act of providing a graphical interface to allow access by the second party for reviewing queued items, and in which the user uploaded visual or audio content is available for distribution to the public from the first party'"'"'s online video service pending a result of said controlling distribution.

25. The non-transitory computer-readable readable medium of claim 20 that further comprises code that when executed by the processor causes the computer system to perform acts including deriving the fingerprint data from the user uploaded visual or audio content, the deriving comprising analyzing a transformed representation of the user uploaded visual or audio content, and in which the deriving utilizes hashing.

26. A method comprising:

obtaining fingerprint data derived from user uploaded visual or audio content, the user uploaded visual or audio content having been uploaded by a user to a first party'"'"'s online video service for distribution from the first party'"'"'s online video service to the public;

determining reference content, from a universe of reference content, that is a possible match of the user uploaded visual or audio content, said determining being based on the fingerprint data and being performed by a computer system configured to perform such act;

queuing for review by a second party, different than the first party, the user uploaded visual or audio content item and data associated with the determined reference content, in which the first party provides a graphical interface to allow access by the second party for reviewing queued items;

obtaining assessment data from the second party, the assessment data indicating a result of a comparison of the user uploaded visual or audio content and the reference content by one or more human reviewer(s);

using the assessment data in concluding that the reference content corresponds with the user uploaded visual or audio content; and

controlling distribution of the user uploaded visual or audio content from the first party'"'"'s online video service to the public based on the concluding.

27. The method of claim 26 further comprising deriving the fingerprint data from the user uploaded visual or audio content, said deriving comprising analyzing a transformed representation of the user uploaded visual or audio content, and in which said deriving the fingerprint data utilizes hashing.

28. The method of claim 26 in which said queuing includes providing a link to the determined reference content.

29. The method of claim 26 in which the user uploaded visual or audio content is available for distribution to the public from the first party'"'"'s online video service pending a result of said controlling distribution.

30. The method of claim 26 in which said determining reference content utilizes a hamming distance.