Digital asset management and linking media signals with related data using watermarks

• US 20020188841A1
• Filed: 04/05/2002
• Published: 12/12/2002
• Est. Priority Date: 07/27/1995
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Levy, Kenneth L., Rhoads, Geoffrey B., Rodriguez, Tony F., Jones, Kevin C., Hiatt, R. Stephen, Mosher, Brian, Aggson, Cynthia K.
• Granted Patent: US 7,095,871 B2
• Time in Patent Office: Days
• US Class Current: 713/153
• CPC Class Codes: B42D 25/00 Information-bearing cards or sheet-like structures characterised by identification or security features; Manufacture thereof printing processes to produce identification or security features B41M3/14
• CPC Class Codes: B42D 25/333 Watermarks
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06K 19/06037 multi-dimensional coding
• CPC Class Codes: G06K 19/06046 Constructional details
• CPC Class Codes: G06K 19/14 the marking being sensed by radiation
• CPC Class Codes: G06K 19/18 Constructional details
• CPC Class Codes: G06K 2019/06253 for a specific application
• CPC Class Codes: G06K 7/1417 2D bar codes
• CPC Class Codes: G06K 7/1447 extracting optical codes from image or text carrying said optical code
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 20/341 Active cards, i.e. cards including their own processing means, e.g. including an IC or chip
• CPC Class Codes: G06Q 20/40145 Biometric identity checks
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: G07C 9/253 visually
• CPC Class Codes: G07D 7/0034 using watermarks
• CPC Class Codes: G07D 7/004 using digital security elements, e.g. information coded on a magnetic thread or strip
• CPC Class Codes: G07F 17/26 for printing, stamping, franking, typing or teleprinting apparatus ticket printing or the like apparatus G07F17/42
• CPC Class Codes: G07F 7/086 by passive credit-cards adapted therefor, e.g. constructive particularities to avoid counterfeiting, e.g. by inclusion of a physical or chemical security-layer for security documents G07D7/00; for the reading of record-carriers in general G06K7/00; for the design of coded credit-cards G06K19/10
• CPC Class Codes: G07F 7/1008 : Active credit-cards provided with means to personalise their use, e.g. with PIN-introduction/comparison system
• CPC Class Codes: G10L 19/018 : Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: G11B 20/00086 : Circuits for prevention of unauthorised reproduction or copying, e.g. piracy indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
• CPC Class Codes: G11B 20/00884 : involving a watermark, i.e. a barely perceptible transformation of the original data which can nevertheless be recognised by an algorithm
• CPC Class Codes: G11B 20/00891 : embedded in audio data
• CPC Class Codes: H04N 1/00005 : relating to image data
• CPC Class Codes: H04N 1/00037 : Detecting, i.e. determining the occurrence of a predetermined state H04N1/00031 takes precedence
• CPC Class Codes: H04N 1/00079 : remotely
• CPC Class Codes: H04N 1/32122 : in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 1/32144 : embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/3216 : using Fourier transforms
• CPC Class Codes: H04N 1/32203 : Spatial or amplitude domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/32208 : involving changing the magnitude of selected pixels, e.g. overlay of information or super-imposition H04N1/32219, H04N1/32224 take precedence
• CPC Class Codes: H04N 1/32251 : in multilevel data, e.g. greyscale or continuous tone data
• CPC Class Codes: H04N 1/32288 : Multiple embedding, e.g. cocktail embedding, or redundant embedding, e.g. repeating the additional information at a plurality of locations in the image
• CPC Class Codes: H04N 1/32352 : Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers for decoding, detection or retrieval operations H04N1/32149 and subgroups take precedence
• CPC Class Codes: H04N 21/23892 : involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/8358 : involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3205 : of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3207 : of an address
• CPC Class Codes: H04N 2201/3225 : of data relating to an image, a page or a document
• CPC Class Codes: H04N 2201/3226 : of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
• CPC Class Codes: H04N 2201/3233 : of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3271 : Printing or stamping
• CPC Class Codes: H04N 2201/3274 : Storage or retrieval of prestored additional information
• CPC Class Codes: H04N 2201/328 : Processing of the additional information

Abstract

A method of performing digital asset management of media content. In this method, a watermark reader device reads a watermark embedded into media content. The watermark conveys watermark information, such as a content identifier and creator identifier. The reader forwards the watermark information to a router. The router then uses the watermark information to find a metadata database identifier. It then sends a request for metadata along with the watermark information to the metadata database identified by the metadata database identifier. The metadata database uses the watermark information to find related metadata for the media content and sends the related metadata to the reader device.

Claims

1. A method of performing digital asset management of media content comprising:

in a reader device, reading a watermark embedded into media content, the watermark conveying watermark information;

forwarding the watermark information to a router;

in the router, using the watermark information to find a metadata database identifier;

sending a request for metadata along with the watermark information to the metadata database identified by the metadata database identifier;

from the metadata database, using the watermark information to find related metadata for the media content and sending the related metadata to the reader device.

2. The method of claim 1 wherein the reader device has a user interface that enables a user to input a media content file for watermark reading, and in response to input of the media content file, the reader device requests and displays related metadata returned from the metadata database in the user interface.

3. The method of claim 2 wherein the user interface enables the user to input the media content file by dragging and dropping a representation of the media content file into the user interface with a cursor control device.

4. The method of claim 1 wherein the metadata includes information about an object depicted in a watermarked image signal.

5. The method of claim 1 wherein the metadata includes information about how to purchase or license the media content to which it is related.

6. The method of claim 1 wherein the router routes requests for metadata to different metadata databases based on watermark information decoded from watermarked media content.

7. The method of claim 1 wherein the reader is operable to fetch metadata relating to a media object file from two or more different metadata databases.

8. The method of claim 1 wherein the reader device comprises an Internet browser program including a watermark reader executing on a computer.

9. The method of claim 1 wherein the reader device comprises a watermark reader program executing on a computer, and the reader application includes a user interface for displaying the metadata returned from the metadata database.

10. The method of claim 1 wherein the reader device fetches metadata from two or more different metadata databases linked to the media content by the watermark and integrates the metadata from the different databases into a user interface display.

11. The method of claim 1 including:

using the watermark information to find related media content to the media content from which the watermark is read, and returning information about the related media content to the reader device.

14. The method of claim 13 further comprising a step of permitting access to a data storage resource comprising enhanced content that is related to the content media only when the comparison of the first digital watermark and the second digital watermark confirms that the first digital watermark and the second digital watermark correspond.

15. The method of claim 13, wherein the physical package comprises at least one of a video cassette tape, a DVD, a CD, paper, label, covering, packaging, plastic and a jewel case.

16. The method of claim 13, wherein said first digital watermark comprises a first identifier and said second digital watermark comprises a second identifier.

17. The method of claim 16, wherein the first digital watermark and the second digital watermark are confirmed to correspond if the second identifier provides a key to the first digital watermark.

18. The method of claim 17, wherein the key is at least one of an encryption key, a decoding key, and a watermark location key.

19. The method of claim 16, wherein said associating step ensures that the first identifier and the second identifier correspond.

20. The method of claim 19, wherein the first identifier and the second identifier are associated via at least one of a data record and index.

12. A method comprising the steps of:

comparing a first watermark encoded on a package with a second watermark encoded within content contained in the package; and

allowing access to the content only when the first and second watermarks coincide.

13. A method of controlling unauthorized distribution of content media, the content media being contained in a physical package, said method comprising:

digitally watermarking the content media with a first digital watermark;

associating the first digital watermark with a second digital watermark; and

digitally watermarking the physical package with the second digital watermark, wherein access to the content media is intended only when a comparison of the first digital watermark and the second digital watermark confirms that the first digital watermark and the second digital watermark correspond.

21. A media package comprising physical packaging and media content, said media content comprising a first digital watermark, and said physical packaging comprising at least a second digital watermark, wherein said first digital watermark and said second digital watermark reduce the unauthorized distribution of the media content by requiring cooperation between the first digital watermark and the second digital watermark to permit access to the media content.

22. The media package of claim 21 wherein said first digital watermark comprises a first identifier and said second digital watermark comprises a second identifier, and wherein said second identifier comprises a key to unscramble or decode the first identifier.

23. The media package of claim 22, wherein the first identifier comprises a decryption key to decrypt the media content.

25. The system of claim 24 wherein content files include digital watermarks that provide content type information used to index the content files in the database.

24. A content searching system comprising:

a plurality of search agent programs, each operable to search corresponding computer systems and to report descriptive metadata and storage locations of content files found on the corresponding computer systems to a database;

the database being operable to store the descriptive metadata and being searchable by keywords to find content files with descriptive metadata data relating to the keywords;

wherein at least one of the search agents is in communication with a digital watermark detector operable to extract content identifiers embedded in selected content files, the content identifiers providing a reference to the descriptive metadata for the selected content files.

26. In a metadata management system in which media content is persistently linked to related metadata via a digital watermark embedded in the media content, a method of formatting metadata for display comprising:

receiving metadata from a metadata source that has been identified via a digital watermark;

receiving information about a client device on which the metadata is to be rendered for output; and

reformatting the metadata for rendering on the client device based on the information about the client device.