Method and apparatus for modifying a video stream to encode metadata

• US 9,330,428 B2
• Filed: 12/11/2013
• Issued: 05/03/2016
• Est. Priority Date: 12/12/2012
• Status: Active Grant

• Current Assignee: Grass Valley USA Incorporated
• Original Assignee: Snell Limited (Belden Inc.)
• Inventors: Diggins, Jonathan
• Primary Examiner(s): Liew, Alex
• Application Number:
  US14/103,068
• Publication Number:
  US 20140161304A1
• Time in Patent Office: 874 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0061 Embedding of the watermark in each block of the image, e.g. segmented watermarking
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection

Abstract

A watermark encoder receives a current video image together with current metadata associated with the current image. A metadata delay also makes available to the watermark decoder delayed metadata associated respectively with four or more of the preceding. Then the watermark encoder modifies pixel values of the current image not only to encode the current metadata but also the delayed metadata. At a decoder, if metadata for the current image is corrupted or missing, it can be recovered from one of the succeeding images.

Claims

1. A method of modifying video data to encode metadata, comprising:

receiving in a video processor video in the form of a sequence of images, each image having metadata associated with it, the metadata associated with each of the images differing from the metadata associated with at least one other of the images, each image comprising pixel data defining pixel values of that image;

for a current image in the sequence, collecting in the video processor the metadata associated with that image and the metadata associated with N of the images preceding the current image in the sequence of images, where N is equal to or greater than four; and

modifying in the video processor the pixel data of the current image to encode the metadata associated with the current image and to encode the metadata associated respectively with N of the images preceding the current image in the sequence of images.

2. A method according to claim 1 in which pixel activity is measured within a region surrounding each pixel and pixel values are only modified when activity measured within a region surrounding the pixel to be modified exceeds a threshold.

3. A method according to claim 1 in which identical modifications are applied to the low-significance bits defining the values of all the pixels of a contiguous set of pixels comprising a spatial region within a field or frame so as to encode one or more bits of metadata within that spatial region of that field or frame.

4. A method according to claim 3 in which the two least-significant bits of a ten-bit value are modified.

5. A method according to claim 3 in which low-significance bits defining the values of a contiguous set of pixels in a spatial region within a field or frame are modified so as to encode a fixed data value within that region that aids the recognition of that fixed data value when encoded in a different spatial region within the said field or frame.

6. A method according to claim 3 in which identical data is encoded in a plurality of spatial regions within the same field or frame.

7. A non-transitory computer readable medium containing programming instructions for causing a programmable apparatus to implement a method comprising the steps of:

receiving in a video processor a sequence of video images, each image having metadata associated with it, the metadata associated with each of the video images differing from the metadata associated with at least one other of the video images, each video image comprising pixel data defining pixel values of that image;

for a current image in the sequence, collecting in the video processor the metadata associated with that image and the metadata associated with N of the images preceding the current image in the sequence of images, where N is equal to or greater than four; and

modifying in the video processor the pixel data of the current image to encode the metadata associated with the current image and the metadata associated respectively with N of the images preceding the current image in the sequence of images.