Metadata management and generation using perceptual features

• US 8,953,908 B2
• Filed: 06/13/2005
• Issued: 02/10/2015
• Est. Priority Date: 06/22/2004
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rodriguez, Tony F., Calhoon, Sean, Reed, Alastair M.
• Primary Examiner(s): LE, BRIAN Q
• Application Number:
  US11/152,685
• Publication Number:
  US 20060115108A1
• Time in Patent Office: 3,529 Days
• Field of Search: 382/100, 382/118, 382/224, 382/305, 348/231.3, 348/231.5, 348/231.2, 348/231.4, 707 1- 10, 707100-1041, 707200-206
• US Class Current: 382/305
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: H04N 1/32149 Methods relating to embedding, encoding, decoding, detection or retrieval operations
• CPC Class Codes: H04N 1/32352 Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers for decoding, detection or retrieval operations H04N1/32149 and subgroups take precedence

Abstract

The present disclosure relates to signal processing. One claim recites a method comprising: receiving an imagery or audio file; utilizing a configured multi-purpose electronic processor, identifying perceptual features in the imagery or audio file; and based on the perceptual features or data representing the perceptual features automatically creating metadata for the imagery or audio file. The act of automatically creating metadata utilizes at least some data obtained from a process in a portable computing device, the process comprises communication with a device that is separate from an apparatus that is performing the method. Of course, other claims and are provided too.

Claims

1. A method comprising:

receiving a media file including first metadata;

identifying, using one or more electronic processors of a computing device, at least one perceptual feature of the media file;

identifying at least one attribute of the computing device based on the perceptual features or data representing the perceptual features;

requesting, from a portable computer device, a search based on the at least one perceptual feature and the at least one attribute of the computing device;

receiving, from the portable computer device, search results based on the search; and

creating second metadata for the media file utilizing at least some data obtained from the search.

2. The method of claim 1, further comprising indexing the first and second metadata in an index.

3. The method of claim 1, wherein the media file comprises at least one of an image, a video, and an audio file.

4. The method of claim 1, wherein identifying the at least one perceptual feature of the media file comprises analyzing a three dimensional color-space histogram.

5. The method of claim 1, wherein identifying the at least one perceptual feature of the media file comprises determining a fingerprint or a hash of the media file, and wherein the fingerprint or the hash comprises a reduced-bit representation of the at least one perceptual feature.

6. The method of claim 1, wherein associating the second metadata with the media file comprises attaching the second metadata to the media file.

7. The method of claim 1, wherein the at least one attribute of the computing device comprises at least one of user information associated with the computing device and a location of the computing device.

8. The method of claim 7, wherein the search is further based on information describing an author of the media file, wherein the author of the media file is determined in part using the at least one attribute of the computing device.

9. An apparatus, comprising:

a processor executing on a computing device, the processor configured to;

receive a media file including first metadata;

identify at least one perceptual feature of the media file;

identify at least one attribute of the computing device based on the perceptual features or data representing the perceptual features;

request a search, from a portable computer device, based on the at least one perceptual feature and the at least one attribute of the computing device;

receive, from the portable computer device, search results based on the search; and

create second metadata for the media file utilizing at least some data obtained from the search.

10. The apparatus of claim 9, wherein the computing device is further configured to index the first and second metadata in an index.

11. The apparatus of claim 9, wherein the media file comprises at least one of an image, a video, and an audio file.

12. The apparatus of claim 9, wherein identifying the at least one perceptual feature of the media file comprises analyzing a three dimensional color-space histogram.

13. The apparatus of claim 9, wherein identifying the at least one perceptual feature of the media file comprises determining a fingerprint or a hash of the media file, and wherein the fingerprint or the hash comprises a reduced-bit representation of the at least one perceptual feature.

14. The apparatus of claim 9, wherein associating the second metadata with the media file comprises attaching the second metadata to the media file.

15. The apparatus of claim 9, wherein the at least one attribute of the computing device comprises at least one of user information associated with the computing device and a location of the computing device.

16. The apparatus of claim 15, wherein the search is further based on information describing an author of the media file, wherein the author of the media file is determined in part using the at least one attribute of the computing device.

17. A non-transitory computer-readable medium having instructions stored thereon that, if executed by a computing device, cause the computing device to perform operations comprising:

receiving a media file including first metadata;

identifying at least one perceptual feature of the media file;

identifying at least one attribute of the computing device based on the perceptual features or data representing the perceptual features;

requesting a search, from a portable computer device, based on the at least one perceptual feature and the at least one attribute of the computing device;

receive, from the portable computer device, search results based on the search; and

creating second metadata for the media file utilizing at least some data obtained from the search.

18. The computer-readable medium of claim 17, wherein the computing device is further configured to index the first and second metadata in an index.

19. The computer-readable medium of claim 17, wherein the media file comprises at least one of an image, a video, and an audio file.

20. The computer-readable medium of claim 17, wherein identifying the at least one perceptual feature of the media file comprises analyzing a three dimensional color-space histogram.

21. The computer-readable medium of claim 17, wherein identifying the at least one perceptual feature of the media file comprises determining a fingerprint or a hash of the media file, and wherein the fingerprint or the hash comprises a reduced-bit representation of the at least one perceptual feature.

22. The computer-readable medium of claim 17, wherein associating the second metadata with the media file comprises attaching the second metadata to the media file.

23. The computer-readable medium of claim 17, wherein the at least one attribute of the computing device comprises at least one of user information associated with the computing device and a location of the computing device.

24. The computer-readable medium of claim 23, wherein the search is further based on information describing an author of the media file, wherein the author of the media file is determined in part using the at least one attribute of the computing device.