Content metadata directory services

• US 9,218,429 B2
• Filed: 01/29/2013
• Issued: 12/22/2015
• Est. Priority Date: 12/21/2005
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Levy, Kenneth L.
• Primary Examiner(s): Yen, Syling
• Application Number:
  US13/753,177
• Publication Number:
  US 20130198242A1
• Time in Patent Office: 1,057 Days
• Field of Search: 707/758, 707/781, 707/791, 707/802, 707/803, 707/809, 707/812, 707/999.102, 707/999.103, 709/225, 709/217, 709/229, 382/100
• US Class Current: 1/1
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/211 Schema design and management
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/61 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/80 of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML content-based retrieval of web data G06F16/95
• CPC Class Codes: G06F 16/90335 Query processing
• CPC Class Codes: G06F 16/9038 Presentation of query results
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/00 : Commerce
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04L 65/612 : for unicast
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/535 : Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/63 : Routing a service request depending on the request content or context
• CPC Class Codes: H04N 1/32283 : Hashing
• CPC Class Codes: H04N 21/218 : Source of audio or video content , e.g. local disk arrays details of retrieval in video databases G06F16/739
• CPC Class Codes: H04N 21/2343 : involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/235 : Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2355 : involving reformatting operations of additional data, e.g. HTML pages optimising the visualization of content for information retrieval from the Internet G06F16/9577; tracking of instant messages H04L51/234; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/23892 : involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/252 : Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/25891 : being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/26258 : for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 : sound input device, e.g. microphone
• CPC Class Codes: H04N 21/435 : Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4415 : using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4722 : for requesting additional data associated with the content
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/854 : Content authoring
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

A method of associating a content object with metadata uses a combination of a content identifier and a bounding identifier to enable handling of disparate sets of content identifiers for content objects with potentially conflicting content identifiers. The method receives a content identifier for a content object from among a set of content identifiers. It provides a unique bounding identifier for the set of content identifiers. This unique bounding identifier is used in combination with the content identifier to form a globally unique identifier for the content object. This globally unique identifier is associated with a metadata source, which enables routing of a user to the metadata source.

Claims

1. A method comprising:

in a database system executing on one or more computers, registering different content ID schemas, the registering of the different content ID schemas comprising registering bounding identifiers corresponding to the different content ID schemas;

in the database system, registering a set of content identifiers for each of the different content ID schemas, wherein the content identifiers in a content ID schema correspond to content objects identified by the content ID schema, and the content identifiers are obtained based on identifying information derived by a programmed processor from audio or visual content signals obtained from the corresponding content objects;

forming a globally unique identifier for each of the content objects identified by the different content ID schemas by combining a bounding identifier of the corresponding content ID schema and the content identifier from the same corresponding content ID schema;

for each of the globally unique identifiers, maintaining routing information to a metadata source, the metadata source executing on one or more computers;

receiving a first content identifier for a first content object;

the first content identifier being from a corresponding first content ID schema from the different content ID schemas, the first content identifier being obtained based on first identifying information derived by a programmed processor from an audio or visual content signal obtained from the first content object;

determining a first bounding identifier for the corresponding first content ID schema, the first bounding identifier being separate from the first content identifier;

using the determined first bounding identifier in combination with the first content identifier obtained based on the identifying information to form the globally unique identifier for the first content identifier; and

routing a user device to the metadata source associated with the globally unique identifier for the first content object using the routing information.

2. The method of claim 1 wherein the content identifiers from the different content ID schemas, and having different associated bounding identifiers, are derived from the content object using different readers corresponding to the different associated bounding identifiers.

3. The method of claim 2 wherein the different readers derive the content identifiers using different content identification methods.

4. The method of claim 2 wherein the different readers derive the content identifiers using different attributes of the content object.

5. The method of claim 4 wherein the different attributes comprise different types of embedded auxiliary data.

6. The method of claim 5 wherein one of the types of embedded auxiliary data comprises a digital watermark.

7. The method of claim 4 wherein the different attributes comprise a first attribute corresponding to a first digital watermark and a second attribute corresponding to a second digital watermark.

8. The method of claim 4 wherein different attributes comprise attributes from which different digital watermarks or robust hashes are derived.

9. The method of claim 4 wherein the different attributes comprise in band and out of band attributes of the content object, where in band refers to content that is rendered for perception by a human and out of band refers to auxiliary data carried in the content object but not forming part of the content that is rendered for perception by a human.

10. The method of claim 1 wherein the first content ID schema is determined by a reader used to provide the first content identifier, the content object having more than one content identifier, each readable by a different reader.

11. The method of claim 1 wherein the content identifiers are derived from the content object using different parts of the content object.

12. The method of claim 11 wherein the parts are different in band parts of perceptual content in the content object.

13. The method of claim 11 wherein one part is in band and another part is out of band in the content object.

14. The method of claim 1 wherein said first content identifier and said metadata source is provided by a content provider, and includes links to the content provider'"'"'s metadata, and wherein there is also a second content identifier and second metadata source provided by a second participant that links to the second participant'"'"'s metadata.

15. The method of claim 14 wherein said second participant is a retailer and the second participant'"'"'s metadata includes online commerce opportunities.

16. The method of claim 1 wherein the content objects comprise physical objects, and the content signals are images captured from the physical objects.

17. A non-transitory, computer readable medium on which is stored instructions, which, when executed by one or more computers, performs a method comprising:

in a database system executing on one or more computers, registering different content ID schemas, the registering of the different content ID schemas comprising registering bounding identifiers corresponding to the different content ID schemas;

in the database system, registering a set of content identifiers for each of the different content ID schemas, wherein the content identifiers in a content ID schema correspond to content objects identified by the content ID schema, and the content identifiers are obtained based on identifying information derived by a programmed processor from audio or visual content signals obtained from the corresponding content objects;

forming a globally unique identifier for each of the content objects identified by the different content ID schemas by combining a bounding identifier of the corresponding content ID schema and the content identifier from the same corresponding content ID schema;

for each of the globally unique identifiers, maintaining routing information to a metadata source, the metadata source executing on one or more computers;

receiving a first content identifier for a first content object;

the first content identifier being from a corresponding first content ID schema from the different content ID schemas, the first content identifier being obtained based on first identifying information derived by a programmed processor from an audio or visual content signal obtained from the first content object;

determining a first bounding identifier for the corresponding first content ID schema, the first bounding identifier being separate from the first content identifier;

using the determined first bounding identifier in combination with the first content identifier obtained based on the identifying information to form the globally unique identifier for the first content identifier; and

routing a user device to the metadata source associated with the globally unique identifier for the first content object using the routing information.

18. A system of associating a content object with two or more different metadata sources, the system comprising:

a directory system comprising one or more computers for registering different content ID schemas, the registering of the different content ID schemas comprising registering bounding identifiers corresponding to the different content ID schemas;

the one or more computers of the database system configured to register a set of content identifiers for each of the different content ID schemas, wherein the content identifiers in a content ID schema correspond to content objects identified by the content ID schema, and the content identifiers are obtained based on identifying information derived by a programmed processor from audio or visual content signals obtained from the corresponding content objects;

the one or more computers of the database system configured to form a globally unique identifier for each of the content objects identified by the different content ID schemas by combining a bounding identifier of the corresponding content schema and the content identifier from the same corresponding content ID schema;

a database comprising one or more computers for maintaining routing information to a metadata source for each of the globally unique identifiers;

a router for receiving a first content identifier for a first content object, the first content identifier being from a corresponding first content ID schema from the different content ID schemas, the first content identifier being obtained based on first identifying information derived by a programmed processor from an audio or visual content signal obtained from the first content object;

the router determining a first bounding identifier for the corresponding first content ID schema, the first bounding identifier being separate from the first content identifier, and using the determined first bounding identifier in combination with the first content identifier obtained based on the identifying information to form the globally unique identifier for the first content identifier, and for directing a user device to the metadata source associated with globally unique identifier using the routing information.

19. The system of claim 18 wherein the content identifiers from the different content ID schemas, and having different associated bounding identifiers, are derived from the content object using different readers corresponding to the different associated bounding identifiers.

20. The system of claim 19 wherein the different readers derive the content identifiers using different content identification methods.

21. The system of claim 19 wherein the different readers derive the content identifiers using different attributes of the content object.

22. The system of claim 21 wherein the different attributes comprise different types of embedded auxiliary data.

23. The system of claim 22 wherein one of the types of embedded auxiliary data comprises a digital watermark.

24. The system of claim 21 wherein the different attributes comprise a first attribute corresponding to a first digital watermark and a second attribute corresponding to a second digital watermark.

25. The system of claim 21 wherein different attributes comprise attributes from which different digital watermarks or robust hashes are derived.

26. The system of claim 21 wherein the different attributes comprise in band and out of band attributes of the content object, where in band refers to content that is rendered for perception by a human and out of band refers to auxiliary data carried in the content object but not forming part of the content that is rendered for perception by a human.

27. The system of claim 18 wherein the first content ID schema is determined by a reader used to provide the first content identifier, the content object having more than one content identifier, each readable by a different reader.

28. The system of claim 18 wherein the content identifiers are derived from the content object using different parts of the content object.

29. The system of claim 28 wherein the parts are different in band parts of perceptual content in the content object.

30. The system of claim 28 wherein one part is in band and another part is out of band in the content object.

31. The system of claim 18 wherein said first content identifier and said metadata source is provided by a content provider, and includes links to the content provider'"'"'s metadata, and wherein there is also a second content identifier and second metadata source provided by a second participant that links to the second participant'"'"'s metadata.

32. The system of claim 31 wherein said second participant is a retailer and the second participant'"'"'s metadata includes online commerce opportunities.

33. The system of claim 18 wherein the content objects comprise physical objects, and the content signals are images captured from the physical objects.

34. A system of associating a content object with two or more different metadata sources, the system comprising:

means for registering different content ID schemas, the registering of the different content ID schemas comprising registering bounding identifiers corresponding to the different content ID schemas;

means for registering a set of content identifiers for each of the different content ID schemas, wherein the content identifiers in a content ID schema correspond to content objects identified by the content ID schema, and the content identifiers are obtained based on identifying information derived by a programmed processor from audio or visual content signals obtained from the corresponding content objects;

means for generating a globally unique identifier for each of the content objects identified by the different content ID schemas by combining a bounding identifier of the corresponding content schema and the content identifier from the same corresponding content ID schema;

means for maintaining routing information to a metadata source for each of the globally unique identifiers;

means for obtaining a first content identifier for a first content object, the first content identifier being from a corresponding first content ID schema from the different content ID schemas, the first content identifier being obtained based on first identifying information derived by a programmed processor from an audio or visual content signal obtained from the first content object;

means for generating a first bounding identifier for the corresponding first content ID schema, the first bounding identifier being separate from the first content identifier, and using the generated first bounding identifier in combination with the first content identifier obtained based on the identifying information to form the globally unique identifier for the first content identifier, and

means for directing a user device over a communications network to the metadata source associated with globally unique identifier using the routing information.

35. The system of claim 34 wherein the content objects comprise physical objects, and the content signals are images captured from the physical objects.

36. The system of claim 35 wherein the identifying information comprises digital watermarks embedded in images on the physical objects, and the digital watermarks are decoded from the images to derive the identifying information.

37. The system of claim 34 wherein the content objects comprise audio, and the content signals are audio signals captured by a microphone from rendered playback of the audio.

38. The system of claim 37 wherein the identifying information comprises digital watermarks embedded in the audio, and the digital watermarks are decoded from the audio signals to derive the identifying information.