Color selection scheme for digital video watermarking

• US 7,630,509 B2
• Filed: 09/29/2003
• Issued: 12/08/2009
• Est. Priority Date: 09/29/2003
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Alcatel-Lucent USA, Inc. (Nokia Corporation)
• Inventors: Zarrabizadeh, Mohammad Hossein
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US10/673,893
• Publication Number:
  US 20050069168A1
• Time in Patent Office: 2,262 Days
• Field of Search: 382/100, 382/168, 382163-167, 382/232, 382/236, 382/237, 382/243, 382/244, 382/251, 382/253, 382/254, 382/274, 382/275, 382/276, 382/305, 382/248, 375/240.12, 358/3.28
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 2201/0051 Embedding of the watermark in the spatial domain
• CPC Class Codes: G06T 2201/0061 Embedding of the watermark in each block of the image, e.g. segmented watermarking
• CPC Class Codes: G06T 2201/0202 whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/32309 in colour image data
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 which are undetectable to the naked eye, e.g. embedded codes

Abstract

Determining a chrominance portion to be watermarked employs a perception-based table that indicates for various pixel values which of the chrominance portions, if any, should be selected for watermarking. Only the Y, U, and V values of a pixel are needed to access the table and determine which chrominance portion should be selected. However, the table may be represented such that it may be accessed using only R, G, and B values. The table may be modified so that it may indicate which of U or V should be selected, or that neither should be selected, indicating that this pixel should not be watermarked at all. Advantageously, the table may be simplified by employing some processing, because a large section of the table may be replaced by a simple test on the pixel values, e.g., U<128, to determine the selected chrominance portion.

Claims

1. A method performed by an apparatus for watermarking a video signal, the method comprising the step of:

automatically selecting a chrominance portion of a pixel of an image of a video signal to be watermarked, said video signal to be watermarked without changing its luminance, said selecting step employing a perception-based table that is independent of said image and indicates for each of at least a plurality of possible pixels in a colorspace which, if any, of the chrominance portions of said plurality of pixels in said colorspace should be selected for watermarking, said table being stored in a computer readable medium.

2. The invention as defined in claim 1 wherein said perception-based table indicates for each entry therein whether to watermark only a first chrominance portion or only a second chrominance portion.

3. The invention as defined in claim 1 wherein said perception-based table indicates for each entry therein whether to watermark a first chrominance portion, a second chrominance portion, or not to watermark at all.

4. The invention as defined in claim 1 wherein said perception-based table is in computer readable form.

5. The invention as defined in claim 1 wherein said perception-based table divides an entire colorspace into regions, at least one of said possible pixels within each said region, and said perception-based table supplies an indication for said pixel based on which region of said perception-based table said pixel falls.

6. The invention as defined in claim 1 wherein said pixel of said image is part of a digital video bitstream represented in YUV format and wherein said perception-based table indicates for any pixel that could possibly be in said image to watermark U or V as a function of the Y, U, and V values of said pixel.

7. The invention as defined in claim 1 wherein said pixel of said image is part of a digital video bitstream represented in YUV format, and wherein said selecting step is performed using only said YUV formatted digital bitstream directly and no other version of said digital bitstream formatted in any other format.

8. The invention as defined in claim 1 wherein said pixel of said image is part of a digital video bitstream represented using a first colorspace type representation, and wherein, said selecting step is performed using only a digital bitstream formatted in said first colorspace type representation directly and other colorspace type representation.

9. The invention as defined in claim 1 wherein said pixel of said image is a decimated pixel derived from an original digital video bitstream.

10. The invention as defined in claim 1 wherein said pixel of said image is a decimated pixel derived from an original digital video bitstream represented in YUV format.

11. The invention as defined in claim 1 wherein said pixel of said image is a quantized pixel derived from an original digital video bitstream.

12. The invention as defined in claim 1 wherein said pixel of said image is a quantized pixel derived from an original digital video bitstream represented in YUV format.

13. The invention as defined in claim 1 wherein said perception-based table contains information to indicate which, if any, of the chrominance portions should be selected for watermarking for every possible pixel value of the entirety of said colorspace.

14. The invention as defined in claim 1 wherein said perception-based table contains information to indicate which, if any, of the chrominance portions should be selected for watermarking for each possible pixel of only a prescribed portion of said colorspace, and wherein said selecting step further comprises the step of determining that pixel of said image is within said prescribed portion of said colorspace for which said perception-based table contains information.

15. The invention as defined in claim 1 wherein said perception-based table contains information to indicate which, if any, of the chrominance portions should be selected for watermarking for each possible pixel of only a portion of said colorspace, and wherein said method further comprises the steps of:

determining that pixel of said image is not within said portion of said colorspace for which said perception-based table contains information; and

determining which, if any, of the chrominance portions should be selected for watermarking for said pixel of said image, as a computed function of at least one value of said pixel.

16. The invention as defined in claim 1 wherein a chrominance portion of said pixel of said image is watermarked by having its value changed to represent the conveyance of additional data other than the original value of said chrominance portion.

17. Apparatus for supplying an indication as to which chrominance portion of a pixel an image of a video signal, if any, is better suited to be altered so as to carry additional watermark information without changing said pixel'"'"'s luminance, said apparatus comprising a perception-based table in a computer readable media for at least a portion of the possible pixel colorspace, said table being independent of said image, said table specifying for pixels that are within said portion of said colorspace the chrominance portion to be indicated by said apparatus.

18. The invention as defined in claim 17 further comprising a computation unit for indicating for a pixel of said image that is not within said portion of said colorspace which chrominance portion is to be indicated based on at least a value of one of said chrominance portions of said pixel of said image.

19. The invention as defined in claim 17 wherein said chrominance portion is better suited to be altered when altering said chrominance portion will produce less, if any, visible artifact than altering any other chrominance portion of said pixel of said image.

20. A method for that is performed by an apparatus for detecting watermark data that was added to a video signal, the method comprising the step of:

automatically selecting a chrominance portion of a pixel of an image of a video signal, said video signal having been watermarked without changing its luminance, said selecting step employing a perception-based table that is independent of said image and which indicates for each of at least a plurality of possible pixels in a colorspace which, if any, of the chrominance portions most likely had watermark data added thereto, said table being stored in a computer readable medium.

21. Apparatus for selecting a chrominance portion of a pixel of an image of a video signal to be watermarked, said apparatus comprising a perception-based table in a computer readable medium that indicates for each of at least a plurality of possible pixels in at least a portion of a colorspace which if any, of the chrominance portions would be least likely to introduce a visible artifact should watermark data be added thereto, said video signal to be watermarked without changing its luminance.

22. Apparatus for selecting a chrominance portion of a pixel of an image of a video signal to be watermarked so that there are effectively no changes to a luminance of said video signal, said apparatus comprising:

a computer readable store containing a perception-based table that is independent of said image and which indicates for each of at least a plurality of possible pixels in at least a portion of a colorspace which, if any, of the chrominance portions should be selected for watermarking; and

means for accessing said store to determine which chrominance portion, if any, to select, when said pixel of said image to be watermarked is one of said pixels in said portion of said colorspace.

23. The invention as defined in claim 22 further comprising means for computing as a function of a least one value of said pixel of said image which, if any, of the chrominance portions should be selected for watermarking, said means for computing operating only when said pixel is not one of said pixels in said portion of said colorspace.

24. Apparatus for selecting a chrominance portion of a pixel of an image of a video signal, said video signal having been watermarked without changing its luminance, said apparatus comprising:

a computer readable store containing a perception-based table that is independent of said image and which indicates for each of at least a plurality of possible pixels in at least a portion of a colorspace which, if any, of the chrominance portions most likely had watermarking data added thereto; and

means for accessing said store to determine which chrominance portion, if any, to select, when said pixel is one of said pixels in said portion of said colorspace.

25. Apparatus in a receiver for selecting a chrominance portion of a pixel of an image of a video signal that may have been watermarked in a transmitter, said video signal having been watermarked so as not to change its luminance, the apparatus comprising:

a computer readable store containing a perception-based table that is independent of said image and which indicates for each of at least a plurality of possible pixels in at least a portion of a colorspace which, if any, of the chrominance portions was most likely selected to be watermarked; and

means for accessing said store to determine which chrominance portion, if any, to select, when said pixel of said image is within said portion of said colorspace.

26. A method performed by an apparatus for watermarking a video signal, the method comprising the step of:

automatically selecting at most one chrominance portion of a pixel of an image of a video signal to be watermarked by adding thereto additional information, said selecting step employing a perception-based table that is independent of (i) said image and (ii) said additional information, said table indicating for each of at least a plurality of possible pixels in a colorspace which one, if any, of the chrominance portions of said plurality of pixels in said colorspace should be selected to have said additional information added thereto, said table being stored in a computer readable medium.

27. Apparatus for supplying an indication as to which chrominance portion of a pixel an image of a video signal, if any, is better suited to be altered so as to carry additional watermark information, said apparatus comprising a perception-based table in a computer readable media for at least a portion of the possible pixel colorspace, said table being independent of (i) said image and (ii) said additional watermark information, said table specifying for pixels that are within said portion of said colorspace the chrominance portion to be indicated by said apparatus.

28. A method that is performed by an apparatus for detecting watermark information that was added to a video signal, the method comprising the step of:

automatically selecting a chrominance pardon of a pixel of an image of a video signal, said video signal having been watermarked with watermark information, said selecting step employing a perception-based table that is independent of (i) said image and (ii) said watermark information and which indicates for each of at least a plurality of possible pixels in a colorspace which, if any, of the chrominance portions most likely had watermark information added thereto, said table being stored in a computer readable medium.

29. Apparatus for selecting a chrominance portion of a pixel of an image of a video signal to be watermarked by adding thereto additional information, said apparatus comprising a perception-based table in a computer readable medium that is independent of (i) said image and (ii) said additional information and which indicates for each of at least a plurality of possible pixels in at least a portion of a colorspace which, if any, of the chrominance portions would be least likely to introduce a visible artifact should watermark data be added thereto.

30. A method that is performed by an apparatus for detecting watermark data that was added to a video signal, the method comprising the step of:

automatically selecting a chrominance portion of a pixel of an image of a video signal that had watermark data added thereto, said selecting step employing a perception-based table that is independent of (i) said image and (ii) said watermark data and which indicates for each of at least a plurality of possible pixels in a colorspace which, if any, of the chrominance portions most likely had watermark data added thereto, said table being stored in a computer readable medium.

31. A method performed by an apparatus for watermarking a video signal, the method comprising the step of:

automatically selecting no more than one chrominance portion of a pixel of an image of a video signal to be watermarked, said selecting step employing a perception-based table that is independent of said image and indicates for each of at least a plurality of possible pixels in a colorspace which, if any, of the chrominance portions of said plurality of pixels in said colorspace should be selected for watermarking, said table being stored in a computer readable medium.

32. Apparatus for supplying an indication as to only one of which, if any, chrominance portion of a pixel an image of a video signal, is better suited to be altered so as to carry additional watermark information, said apparatus comprising a perception-based table in a computer readable media for at least a portion of the possible pixel colorspace, said table being independent of said image, said table specifying for pixels that are within said portion of said colorspace the particular no more than one chrominance portion to be indicated by said apparatus.

33. A method for that is performed by an apparatus for detecting watermark data that was added to a video signal, the method comprising the step of:

automatically selecting no more than one of a chrominance portion of a pixel of an image of a video signal, said video signal having been watermarked, said selecting step employing a perception-based table that is independent of said image and which indicates for each of at least a plurality of possible pixels in a colorspace which, if any, of the chrominance portions most likely had said watermark data added thereto, said table being stored in a computer readable medium.

34. Apparatus for selecting no more than one chrominance portion of a pixel of an image of a video signal to be watermarked, said apparatus comprising a perception-based table in a computer readable medium that indicates for each of at least a plurality of possible pixels in at least a portion of a colorspace which, if any, of the chrominance portions would be least likely to introduce a visible artifact should watermark data be added thereto.