Method and apparatus for adding watermarks to images and/or video data streams

• US 6,643,386 B1
• Filed: 08/10/2000
• Issued: 11/04/2003
• Est. Priority Date: 08/10/2000
• Status: Expired due to Term

• Current Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Original Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Inventors: Foster, Ronald R.
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): Miller, Ryan J.
• Application Number:
  US09/638,800
• Time in Patent Office: 1,181 Days
• Field of Search: 382/100, 382/232, 396/310, 396/315, 348/460, 348/463, 386/94, 283/113, 380/200, 380/201, 380/202, 380/203
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 2201/0051 Embedding of the watermark in the spatial domain
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark

Abstract

A watermark can be permanently and simultaneously added to image data, such as to a video data stream, produced by an image sensor. To produce the watermark in the image data, color filters of a filter array overlying pixels of a sensor array can be arranged in a watermark pattern different from the normal pattern of other color filters of the filter array. The color filters in the watermark pattern can have different colors than other color filters of the filter array. Alternatively or in addition to the watermark pattern of the color filters, a pattern can be formed in a microlens array overlying the filter array. The pattern in the microlens array can have regions devoid of microlenses, microlenses having different shapes, or microlenses having different colors.

Claims

1. A CMOS integrated circuit comprising:

a sensor array formed in a semiconductor substrate; and

a filter array formed as part of said integrated circuit and over the sensor array, the filter array having a plurality of filters arranged in a pattern representative of a watermark that is combined with image data derived from the sensor array.

2. The CMOS integrated circuit of claim 1 wherein the filter array comprises a color filter array, the plurality of filters arranged in the pattern representative of the watermark having color transparency characteristics different from color transparency characteristics of other filters of the color filter array.

3. The CMOS integrated circuit of claim 1 wherein the plurality of filters arranged in the pattern representative of the watermark are arranged in a pattern different from a pattern of other filters of the filter array.

4. The CMOS integrated circuit of claim 1 wherein the filter array comprises a black-and-white filter array.

5. The CMOS integrated circuit of claim 1 wherein the filter array is disposed on different layers.

6. The CMOS integrated circuit of claim 1, further comprising an array of microlenses, formed as part of said integrated circuit, the array of microlenses having a pattern that can be combined with the pattern of the plurality of filters to represent the watermark.

7. The CMOS integrated circuit of claim 6 wherein the patter of the array of microlenses includes microlenses having color transparency characteristics different from color transparency characteristics of other microlenses of the array of microlenses.

8. The CMOS integrated circuit of claim 6 wherein the pattern of the array of microlenses includes microlenses having shapes substantially different from shapes of other microlenses of the array of microlenses.

9. The CMOS integrated circuit of claim 6 wherein the pattern of the array of microlenses includes regions devoid of microlenses.

10. A CMOS integrated circuit comprising:

a sensor array formed in a semiconductor substrate; and

an array of microlenses formed as part of said integrated circuit and over the sensor array;

the array of microlenses having a pattern representative of a watermark that is combined with image data derived from the sensor array.

11. The CMOS integrated circuit of claim 10 wherein the pattern of the array of microlenses includes microlenses having color transparency characteristics different from color transparency characteristics of other microlenses of the array of microlenses.

12. The CMOS integrated circuit of claim 10 wherein the pattern of the array of microlenses includes microlenses having shapes substantially different from shapes of other microlenses of the array of microlenses.

13. The CMOS integrated circuit of claim 10 wherein the pattern of the array of microlenses includes regions devoid of microlenses.

14. The CMOS integrated circuit of claim 10, further comprising a filter array formed as part of said integrated circuit and disposed between the sensor array and the array of microlenses, the filter array having a plurality of filters arranged in a pattern that can be combined with the pattern of the array of microlenses to represent the watermark.

15. The CMOS integrated circuit of claim 14 wherein the pattern of the plurality of filters is different from a pattern of other filters of the filter array, or includes filters having transparency characteristics different from transparency characteristics of other filters of the filter array.

16. A CMOS image sensor formed on a single integrated circuit die, said image sensor comprising:

a plurality of pixels formed in a semiconductor substrate; and

a color filter layer formed over said plurality of pixels and as part of said integrated circuit die, said color filter layer having a watermark pattern formed therein such that images captured and output by said image sensor include said watermark pattern.

17. A CMOS image sensor formed on a single integrated circuit die, said image sensor comprising:

a plurality of pixels formed in a semiconductor substrate; and

an array of microlenses formed over said plurality of pixels and as part of said integrated circuit die, said array of microlenses having a watermark pattern formed therein such that images captured and output by said image sensor include said watermark pattern.

18. The image sensor of claim 17 wherein the pattern of the array of microlenses includes microlenses having color transparency characteristics different from color transparency characteristics of other microlenses of the array of microlenses.

19. The image sensor of claim 17 wherein the pattern of the array of microlenses includes microlenses having shapes substantially different from shapes of other microlenses of the array of microlenses.

20. The image sensor of claim 17 wherein the pattern of the array of microlenses includes regions devoid of microlenses.