Rules driven pan ID metadata routing system and network

• US 10,191,996 B2
• Filed: 07/12/2016
• Issued: 01/29/2019
• Est. Priority Date: 12/21/2005
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey B., Rodriguez, Tony F., Levy, Kenneth L.
• Primary Examiner(s): Channavajjala, Srirama
• Application Number:
  US15/208,541
• Publication Number:
  US 20170011134A1
• Time in Patent Office: 931 Days
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/211 Schema design and management
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/61 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/80 of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML content-based retrieval of web data G06F16/95
• CPC Class Codes: G06F 16/90335 Query processing
• CPC Class Codes: G06F 16/9038 Presentation of query results
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/00 : Commerce
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04L 65/612 : for unicast
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/535 : Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/63 : Routing a service request depending on the request content or context
• CPC Class Codes: H04N 1/32283 : Hashing
• CPC Class Codes: H04N 21/218 : Source of audio or video content , e.g. local disk arrays details of retrieval in video databases G06F16/739
• CPC Class Codes: H04N 21/2343 : involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/235 : Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2355 : involving reformatting operations of additional data, e.g. HTML pages optimising the visualization of content for information retrieval from the Internet G06F16/9577; tracking of instant messages H04L51/234; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/23892 : involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/252 : Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/25891 : being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/26258 : for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 : sound input device, e.g. microphone
• CPC Class Codes: H04N 21/435 : Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4415 : using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4722 : for requesting additional data associated with the content
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/854 : Content authoring
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

Content objects are associated with metadata via content identifiers that are derived from sensed signals captured by requesting mobile devices. In response to a content based query from a mobile device, content fingerprints and extracted digital codes decoded from the sensed signals are issued to a network based router system. This system determines identification priority, metadata responses associated with different forms of identification, and priority of metadata responses to the query.

Claims

1. A system for providing metadata responses for an audio or image signal in response to a requesting device, the system comprising:

a first fingerprint database comprising at least one computer configured to receive an electronic version of the audio or image signal for registering a fingerprint in the first fingerprint database as a registered fingerprint linked to a first content ID;

a first fingerprint calculator comprising a programmed computer, the first fingerprint calculator in communication with the first fingerprint database, the first fingerprint calculator configured to receive the electronic version and calculate the registered fingerprint of the electronic version and provide the registered fingerprint to the first fingerprint database, the registered fingerprint comprising registered sub-fingerprints taken from portions of the electronic version, the registered sub-fingerprints linking to the first content ID;

the first fingerprint database configured to receive sub-fingerprints extracted from an audio or image signal sensed from a mobile device sensor of the requesting device, the first fingerprint database configured to obtain the first content ID corresponding to the registered sub-fingerprints matching the extracted sub-fingerprints;

an ID resolver comprising a programmed computer configured to receive the first content ID and determine at least a first metadata response corresponding to the first content ID, the ID resolver further configured with plural different handlers to process corresponding digital codes extracted from the audio or image signal and provide metadata responses for content IDs in the digital codes, wherein a first handler of the plural handlers is configured to receive a second content ID from the requesting device and determine at least a second metadata response corresponding to the second content ID, the second content ID being obtained from a first digital code extracted from the audio or image signal sensed from the mobile device sensor;

a rules processor comprising a programmed computer configured to process rules associated with the first and second content IDs, and determine priority of the first and second metadata responses to be provided to the requesting device, wherein the rules processor is configured to determine priority of the first and second metadata responses based on priority of the first and second content IDs;

plural different registration interfaces for registering different content ID types for the audio or image signal; and

wherein the rules processor is configured to determine priority of metadata response among the different content ID types; and

a response aggregator comprising a programmed computer configured to form a metadata response from the first and second metadata responses based on output of the rules processor, and configured to provide an aggregated metadata response for presentation on the requesting device.

2. The system of claim 1 wherein the first digital code comprises a digital identifier conveying the second content ID extracted from a digital watermark embedded in the audio or image signal.

3. The system of claim 1 wherein the rules processor is configured to determine, in response to a metadata request, types of content IDs to be extracted from the signal, and provide an instruction to be sent to the requesting mobile device specifying the types of content IDs.

4. A method for providing metadata responses for an audio or image signal in response to a requesting device, the method comprising:

at a first fingerprint database comprising at least one computer configured to receive an electronic version of the audio or image signal, registering a fingerprint in the first fingerprint database as a registered fingerprint linked to a first content ID;

in a first fingerprint calculator in communication with the first fingerprint database, receiving the electronic version and calculating the registered fingerprint of the electronic version and providing the registered fingerprint to the first fingerprint database, the registered fingerprint comprising registered sub-fingerprints taken from portions of the electronic version, the registered sub-fingerprints linking to the first content ID;

at the first fingerprint database, receiving sub-fingerprints extracted from an audio or image signal sensed from a mobile device sensor of the requesting device, and obtaining the first content ID corresponding to the registered sub-fingerprints matching the extracted sub-fingerprints;

at an ID resolver, receiving the first content ID and determining at least a first metadata response corresponding to the first content ID, the ID resolver having plural different handlers to process corresponding digital codes extracted from the audio or image signal and providing a metadata response for content IDs in the digital codes, wherein a first handler of the plural handlers is configured to receive a second content ID from the requesting device and determine at least a second metadata response corresponding to the second content ID, the second content ID being obtained from a first digital code extracted from the audio or image signal sensed from the mobile device sensor;

in a rules processor, processing a rule associated with the first and second content IDs, and determining priority of the first and second metadata responses to be provided to the requesting device, the rules processor determining priority of the first and second metadata responses based on priority of the first and second content IDs;

with plural different registration interfaces, registering different content ID types for the audio or image signal; and

the rules processor determining priority of metadata response among the different content ID types; and

with a response aggregator, forming a metadata response from the first and second metadata responses based on output of the rules processor, and providing an aggregated metadata response for presentation on the requesting device.

5. The method of claim 4 wherein the first digital code comprises a digital identifier conveying the second content ID extracted from a digital watermark embedded in the audio or image signal.

6. The method of claim 4 wherein the processing of the rules comprises, determining, in response to a metadata request, types of content IDs to be extracted from the signal, and providing an instruction to be sent to the requesting device specifying the types of content IDs.