Orchestrated encoding and decoding

• US 9,412,386 B2
• Filed: 10/01/2013
• Issued: 08/09/2016
• Est. Priority Date: 11/04/2009
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rodriguez, Tony F.
• Primary Examiner(s): He, Jialong
• Application Number:
  US14/043,450
• Publication Number:
  US 20140114666A1
• Time in Patent Office: 1,043 Days
• Field of Search: 704/273, 382/100
• US Class Current: 1/1
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06T 1/0071 using multiple or alternating watermarks
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 1/32304 Embedding different sets of additional information
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3205 of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3214 of a date
• CPC Class Codes: H04N 2201/3215 of a time or duration
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 which are undetectable to the naked eye, e.g. embedded codes

Abstract

Orchestrated encoding schemes facilitate encoding and decoding of data in content signals at several points in the distribution path of content items. Orchestrated encoding adheres to a set of encoding rules that enables multiple watermarks and corresponding applications to co-exist, avoids collisions among watermarks, and simplifies metadata and routing database infrastructure.

Claims

1. A method of digital watermark processing, the method comprising:

receiving an audio signal;

with one or more processors;

performing a watermark decoding on the audio signal to extract, from the audio signal, a first electronic payload signal embedded in a preexisting watermark layer in the audio signal with a first pseudorandom mapping to time-frequency locations in the audio signal, the first electronic payload signal providing a reference to first metadata;

from the watermark decoding, determining a watermark state of the audio signal;

evaluating a watermarking rule based on the watermark state to determine new watermark encoding to apply to the audio signal to comply with the watermarking rule; and

performing the new watermark encoding on the audio signal to embed a new watermark layer into the audio signal, the new watermark layer comprising a second electronic payload signal encoded with a second pseudorandom mapping to time-frequency locations;

wherein the new watermark layer references the first metadata and second metadata, the second metadata being referenced by the second electronic payload signal.

2. The method of claim 1 wherein the watermark rule manages use of a limited bandwidth within the audio signal for carrying plural watermark layers by selecting between overwriting the preexisting watermark layer and embedding the new watermark layer that co-exists with the preexisting watermark layer.

3. The method of claim 1 wherein the watermark rule enforces a priority of plural watermark layers by determining when to overwrite the preexisting embedded watermark layer with the new watermark layer based on the watermark state and a user goal.

4. The method of claim 3 wherein the user goal comprises embedding watermark information to signal an event in the audio signal to which a desired behavior triggered by the new watermark layer is to be synchronized.

5. The method of claim 1 wherein the watermark rule specifies that a distributor identifier and time stamp are to be embedded in the audio signal and indexed to a corresponding content identifier for a portion of the audio signal in which the distributor identifier and time stamp are embedded.

6. The method of claim 1 wherein the watermark state is determined by detecting a watermark protocol of a watermark embedded in the audio signal.

7. The method of claim 6 wherein the watermark protocol is determined from detection of embedded synchronization signals in the audio signal.

8. The method of claim 1 wherein the new watermark layer is multiplexed within the audio signal with the preexisting watermark layer by frequency multiplexing frequency components of the new watermark layer with frequency components of the preexisting watermark layer.

9. The method of claim 1 wherein the watermark encoding comprises encoding the watermark layer so that the new watermark layer overwrites a preexisting watermark layer, and the first electronic payload signal from the preexisting watermark layer is associated in a database with the second electronic payload signal embedded in the new watermark layer.

10. A non-transitory computer readable medium on which is stored instructions, which, when executed by a computer, perform a method of digital watermark processing on an electronic audio signal, the method comprising:

performing a watermark decoding on the audio signal to extract, from the audio signal, a first electronic payload signal embedded in a preexisting watermark layer in the audio signal with a first pseudorandom mapping to time-frequency locations in the audio signal, the first electronic payload signal providing a reference to first metadata;

from the watermark decoding, determining a watermark state of the audio signal;

evaluating a watermarking rule based on the watermark state to determine new watermark encoding to apply to the audio signal to comply with the watermarking rule; and

performing the new watermark encoding on the audio signal to embed a new watermark layer into the audio signal, the new watermark layer comprising a second electronic payload signal encoded with a second pseudorandom mapping to time-frequency locations;

wherein the new watermark layer references the first metadata and second metadata, the second metadata being referenced by the second electronic payload signal.

11. A digital watermark processor, the processor comprising:

means for receiving an audio signal;

means for performing a watermark decoding on the audio signal to extract, from the audio signal, a first electronic payload signal embedded in a preexisting watermark layer in the audio signal with a first pseudorandom mapping to time-frequency locations in the audio signal, the first electronic payload signal providing a reference to first metadata;

means for determining, from the watermark decoding, a watermark state of the audio signal;

means for evaluating a watermarking rule based on the watermark state to determine new watermark encoding to apply to the audio signal to comply with the watermarking rule;

means for performing the new watermark encoding on the audio signal to embed a new watermark layer into the audio signal, the new watermark layer comprising a second electronic payload signal encoded with a second pseudorandom mapping to time-frequency locations; and

means for storing an association between the first metadata and the new watermark layer, the new watermark layer being readable to provide references to the first metadata and second metadata, the second metadata being referenced by the second electronic payload signal.

12. The processor of claim 11 wherein the means for evaluating manages, based on the watermark rule, a use of a limited bandwidth within the audio signal for carrying plural watermark layers by selecting between overwriting the preexisting watermark layer and embedding the new watermark layer that co-exists with the preexisting watermark layer.

13. The processor of claim 11 wherein the watermark rule enforces a priority of plural watermark layers by determining when to overwrite the preexisting embedded watermark layer with the new watermark layer based on the watermark state and a user goal.

14. The processor of claim 13 wherein the user goal comprises embedding watermark information to signal an event in the audio signal to which a desired behavior triggered by the new watermark layer is to be synchronized.

15. The processor of claim 11 wherein the watermark rule specifies that a distributor identifier and time stamp are to be embedded in the audio signal and indexed to a corresponding content identifier for a portion of the audio signal in which the distributor identifier and time stamp are embedded.

16. The processor of claim 11 wherein the watermark state is determined by detecting a watermark protocol of a watermark embedded in the audio signal.

17. The processor of claim 16 wherein the watermark protocol is determined from detection of embedded synchronization signals in the audio signal.

18. The processor of claim 11 wherein the new watermark layer is multiplexed within the audio signal with the preexisting watermark layer by frequency multiplexing frequency components of the new watermark layer with frequency components of the preexisting watermark layer.

19. The processor of claim 11 wherein the means for performing the new watermark encoding comprises a programmed processor adapted to overwrite a preexisting watermark layer with the watermark layer, and the processor of claim 11 including a programmed processor adapted to associate in a database the first electronic payload from the preexisting watermark layer with the second electronic payload embedded in the new watermark layer.