Network camera apparatus, network camera server and digital video recorder for preventing forgery and alteration of a digital image, and apparatus for authenticating the digital image from said apparatus, and method thereof

• US 20040071311A1
• Filed: 11/12/2003
• Published: 04/15/2004
• Est. Priority Date: 12/09/2000
• Status: Abandoned Application

• Current Assignee: MarkAny, Inc., Marktek
• Original Assignee: MarkAny, Inc., Marktek
• Inventors: Choi, Young-Ho, Seo, Ji-Sun, Shin, Dong-Hwan, Choi, Jong-Uk
• Application Number:
  US10/450,234
• Publication Number:
  US 20040071311A1
• Time in Patent Office: Days
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0071 using multiple or alternating watermarks

Abstract

The present invention discloses a network camera apparatus, network camera server and digital video recorder which makes it possible to prevent a digital image from being forged or altered by embedding a watermark into an image signal input through a camera in a real time. Two types of watermark, i.e. a robust watermark for authenticating whether the image is original image or not and a fragile watermark whether the image is forged or altered or where the forgery or alteration of image takes place. An authentication apparatus for authenticating the watermark-embedded image is further disclosed.

Claims

1. A network camera apparatus comprising:

an image inputting portion for receiving an image signal photographed in real time;

an image data processing portion for converting the image signal outputted from said image inputting portion to a digital signal;

an information generating portion for generating an information to be embedded as a watermark;

a watermark generating portion for generating the watermark using the information of said information generating portion;

a watermark embedding portion for embedding the watermark generated at said watermark generating portion into the image signal outputted from said image data processing portion;

an image compressing portion for compressing the watermark-embedded image signal outputted from said watermark embedding portion; and

a network connecting portion for transmitting the compressed image signal outputted from said image compressing portion through network.

2. The network camera apparatus according to claim 1,

wherein said information generating portion is a determined information generating portion for generating an information on the basis of the determined information stored in said network camera apparatus, and the watermark which is embedded into the image signal at said watermark embedding portion is a robust watermark.

7. The network camera apparatus according to any one of claims 1 to 6, further comprising a real-time operating portion for controlling said embedding of the watermark, said compressing of the image signal, and said generating of the arbitrary information in real time.

8. An apparatus for authenticating a watermark-embedded image transmitted from the network camera apparatus described in any one of claims 1 to 6,

an image inputting portion receiving a watermark-embedded and compressed image signal through network;

an image decompressing portion for restoring the image signal outputted from said image inputting portion to the image signal prior to compression;

an, image authenticating portion for determining authenticity of the image by calculating correlation between a watermark extracted from the digital image which is restored at said image decompressing portion and a watermark generated from an information for authentication of an image; and

an image authentication result output portion for outputting an authentication result of said image authenticating portion.

9. The apparatus according to claim 8, wherein said image authenticating portion comprises:

a robust watermark authenticating portion for detecting a robust watermark, thereby determining whether the image is the original; and

a fragile watermark authenticating portion for detecting a fragile watermark, thereby determining whether the image has been forged/altered and finding the location where a forgery/alteration has been occurred.

3. A network camera apparatus comprising:

an image inputting portion for receiving an image signal photographed in real time;

an image data processing portion for converting the image signal outputted from said image inputting portion to a digital signal;

an image compressing portion for compressing the image signal outputted from said image data processing portion;

an information generating portion for generating an information to be embedded as a watermark;

a watermark generating portion for generating the watermark using the information of said information generating portion;

a watermark embedding portion for embedding the watermark generated at said watermark generating portion into the image signal outputted from said image compressing portion; and

a network connecting portion for transmitting the watermark-embedded image signal outputted from said watermark embedding portion through network.

4. The network camera apparatus according to claim 3,

wherein said information generating portion is an arbitrary information generating portion for generating an information transmitted from a distant place through network, and the watermark which is embedded into the image signal at said watermark embedding portion is a fragile watermark.

5. A network camera apparatus comprising:

an image inputting portion for receiving an image signal photographed in real time;

an image data processing portion for converting the image signal outputted from said image inputting portion to a digital signal;

an information generating portion for generating an information to be embedded as a watermark;

a watermark generating portion for generating the watermark using the information of said information generating portion;

a first watermark embedding portion for embedding a first watermark generated at said watermark generating portion into the image signal outputted from said image data processing portion;

an image compressing portion for compressing the first watermark-embedded image signal outputted from said first watermark embedding portion;

a second watermark embedding portion for embedding a second watermark generated at said watermark generating portion into the compressed image signal outputted from said image compressing portion; and

a network connecting portion for transmitting the second watermark-embedded image signal outputted from said second watermark embedding portion through network.

6. The network camera apparatus according to claim 5,

wherein said information generating portion comprises a determined information generating portion for generating an information on the basis of the determined information stored in said network camera apparatus;

and an arbitrary information generating portion for generating an information transmitted from a distant place through network, and

the first watermark which is embedded into the image signal at said first watermark embedding portion is a robust watermark, and the second watermark which is embedded into the image signal at said second watermark embedding portion is a fragile watermark.

10. A method for embedding a watermark into an image signal photographed through network camera apparatus and transmitting the image signal to a network, said method comprising the steps of:

converting an image signal inputted in real time to a digital signal;

embedding a robust watermark containing a unique information of the network camera apparatus into the converted image signal;

compressing the robust watermark-embedded image signal;

embedding a fragile watermark containing an arbitrary information transmitted from a distant place through network into the compressed image signal; and

transmitting the watermark-embedded image signal through network.

11. A network camera server comprising:

a plurality of image data processing portions for converting each of image signals inputted from a plurality of cameras in real time to a digital signal;

an information generating portion for generating an information to be embedded as a watermark, said information corresponding to each of image signals;

a watermark generating portion for generating each of watermarks corresponding to each of the image signals using the information of said information generating portion;

a plurality of watermark embedding portions for embedding respectively the watermark generated at said watermark generating portion into each of image signals outputted from said plurality of image data processing portions;

an image compressing portion for compressing respectively the watermark-embedded image signals outputted from said plurality of watermark embedding portions;

an image signal combining portion for combining the plurality of image signals outputted from said image compressing portion into a single image signal; and

a network connecting portion for transmitting the combined image signal outputted from said image signal combining portion through network.

12. The network camera server according to claim 11,

wherein said information generating portion is a determined information generating portion for generating a unique information of said plurality of cameras or said network camera server, and the watermark which is respectively embedded into said plurality of image signals at said plurality of watermark embedding portions is a robust watermark.

17. The network camera server according to any one of claims 11 to 16, further comprising a real-time operating portion for controlling said embedding of the watermark, said compressing of the image signal, and said generating of the arbitrary information in real time.

18. An apparatus for authenticating a watermark-embedded image transmitted from the network camera server described in any one of claims 11 to 16,

an image inputting portion for receiving a watermark-embedded, compressed and combined image signal through network;

an image signal dividing portion for dividing the combined image signal outputted from said image inputting portion into an image signal corresponding to each of cameras;

a plurality of image storing portion for storing respectively the image signal divided at said image signal dividing portion;

an image signal selecting portion for selecting a image signal which needs to be authenticated among the image signals stored in said image storing portions;

an image decompressing portion for restoring the image signal selected at said image signal selecting portion to the image signal prior to compression;

an image authenticating portion for determining authenticity of the image by calculating correlation between a watermark extracted from the digital image which is restored at said image decompressing portion and a watermark generated from an information for authentication of an image; and

an image authentication result output portion for outputting a authentication result of said image authenticating portion.

19. The apparatus according to claim 18, wherein said image authenticating portion comprises:

a robust watermark authenticating portion for detecting a robust watermark, thereby determining whether the image is the original; and

a fragile watermark authenticating portion for detecting a fragile watermark, thereby determining whether the image has been forged/altered and finding the location where a forgery/alteration has been occurred.

13. A network camera server comprising:

a plurality of image data processing portions for converting each of image signals inputted from a plurality of cameras in real time to a digital signal;

an image compressing portion for compressing respectively the image signals outputted from said plurality of image data processing portions;

an information generating portion for generating an information to be embedded as a watermark, said information corresponding to each of image signals;

a watermark generating portion for generating each of watermarks corresponding to each of the image signals using the information of said information generating portion;

a plurality of watermark embedding portions for embedding respectively the watermark generated at said watermark generating portion into each of image signals outputted from said image compressing portions;

an image signal combining portion for combining the plurality of watermark-embedded image signals outputted from said plurality of watermark embedding portions into a single image signal; and

a network connecting portion for transmitting the combined image signal outputted from said image signal combining portion through network.

14. The network camera server according to claim 13,

wherein said information generating portion is an arbitrary information generating portion for generating an information transmitted from a distant place through network, and the watermark which is respectively embedded into said plurality of image signals at said watermark embedding portion is a fragile watermark.

15. A network camera server comprising:

a plurality of image data processing portions for converting each of image signals inputted from a plurality of cameras in real time to a digital signal;

an information generating portion for generating an information to be embedded as a watermark, said information corresponding to each of image signals;

a watermark generating portion for generating each of watermarks corresponding to each of the image signals using the information of said information generating portion;

a plurality of a first watermark embedding portions for embedding respectively a first watermark generated at said watermark generating portion into each of image signals outputted from said plurality of image data processing portions;

an image compressing portion for compressing respectively the watermark-embedded image signals outputted from said plurality of first watermark embedding portions;

a plurality of a second watermark embedding portions for embedding respectively a second watermark generated at said watermark generating portion into each of image signals outputted from said image compressing portion;

an image signal combining portion for combining the plurality of watermark-embedded image signals outputted from said plurality of second watermark embedding portions into a single image signal; and

a network connecting portion for transmitting the combined image signal outputted from said image signal combining portion through network.

16. The network camera server according to claim 15,

wherein said information generating portion comprises a determined information generating portion for generating a unique information of said plurality of cameras or said network camera server;

and an arbitrary information generating portion for generating an information transmitted from a distant place through network, and

the first watermark which is respectively embedded into said plurality of image signals at said plurality of first watermark embedding portions is a robust watermark, and the second watermark which is respectively embedded into said plurality of image signals at said second watermark embedding portion is a fragile watermark.

20. A method for embedding watermark into a plurality of image signals inputted from a plurality of cameras and transmitting the image signals to a network, said method comprising the steps of:

converting said plurality of image signals inputted from said plurality of cameras in real time to digital signals;

embedding a robust watermark containing a unique information of the plurality of cameras or the network camera server into each of the converted image signals in real time;

compressing the robust watermark-embedded image signals respectively;

embedding a fragile watermark containing an arbitrary information transmitted through network into each of the compressed image signals in real time;

combining the plurality of the fragile watermark-embedded image signals into a single image signal; and

transmitting the combined image signal through network.

21. A digital video recorder which comprises a watermark embedding apparatus for embedding watermark into a plurality of image signals inputted from a plurality of cameras, said watermark embedding apparatus comprising:

a plurality of image data processing portions for converting each of image signals inputted from a plurality of cameras in real time to a digital signal;

an information generating portion for generating an information to be embedded as a watermark, said information corresponding to each of image signals;

a watermark generating portion for generating each of watermarks corresponding to each of the image signals using the information of said information generating portion;

a plurality of a first watermark embedding portions for embedding respectively a first watermark generated at said watermark generating portion into each of image signals outputted from said plurality of image data processing portions; and

an image signal combining portion for combining the plurality of watermark-embedded image signals outputted from said plurality of the first watermark embedding portion into a single image signal,

wherein the image signal outputted from said image compressing portion is compressed and then recorded.

22. The digital video recorder according to claim 21, wherein said watermark embedding apparatus further comprises a plurality of a second watermark embedding portions for embedding respectively a second watermark generated at said watermark generating portion into each of image signals outputted from said plurality of the first watermark embedding portion.

23. The digital video recorder according to claim 22,

wherein said information generating portion comprises a determined information generating portion for generating a unique information of each of said plurality of cameras;

and an arbitrary information generating portion for generating an information transmitted from a distant place through network, and

the first watermark which is respectively embedded into said plurality of image signals at said plurality of the first watermark embedding portions is a robust watermark, and the second watermark which is respectively embedded into said plurality of image signals at said second watermark embedding portion is a fragile watermark.

24. The digital video recorder according to any one of claims 21 to 23, wherein said watermark embedding apparatus further comprises a real-time operating portion for controlling said embedding of the watermark and said generating of the arbitrary information in real time.

25. The digital video recorder according to any one of claims 21 to 23, wherein said watermark embedding apparatus is integrated into said digital video recorder as a hardware or as a software module.

26. An apparatus for authenticating a watermark-embedded image from the digital video recorder described in any one of claims 21 to 23,

an image inputting portion for receiving a watermark-embedded and combined image signal as a transmission through a network or a file format;

an image signal dividing portion for dividing the combined image signal outputted from said image inputting portion into an image signal corresponding to each of cameras;

an image authenticating portion for determining authenticity of the image by calculating correlation between a watermark extracted from the digital image from said image signal dividing portion and a watermark generated from an information for authentication of an image; and

an image authentication result output portion for outputting a authentication result of said image authenticating portion.

27. A method for embedding a watermark into a plurality of image signals inputted from a plurality of cameras and recording the image signals, said method comprising the steps of:

converting said plurality of image signals inputted from said plurality of cameras in real time to digital signals;

embedding a robust watermark containing a unique information of the plurality of cameras into each of the converted image signals in real time;

embedding a fragile watermark containing an arbitrary information transmitted through network into each of the robust watermark-embedded image signals in real time;

combining the plurality of the fragile watermark-embedded image signals into a single image signal; and

compressing the combined image signal and then recording the image signal.

28. A digital video recorder for recording a plurality of image signals inputted from a plurality of cameras,

wherein a plurality of watermark embedding apparatus are respectively installed in said plurality of cameras in a separate manner, and

each of the watermark embedding apparatus comprises:

an image data processing portion for converting the image signal inputted from corresponding camera in real time to a digital signal;

an information generating portion for generating information to be embedded as a watermark;

a watermark generating portion for generating the watermark using the information of said information generating portion; and

a first watermark embedding portion for embedding a first watermark generated at said watermark generating portion into the image signal outputted from said image data processing portion,

wherein the image signal outputted from said first watermark embedding portion is compressed and then recorded.

29. The digital video recorder according to claim 28, wherein each of the watermark embedding apparatus further comprises a second watermark embedding portion for embedding a second watermark generated at said watermark generating portion into the image signal outputted from said first watermark embedding portion.

30. The digital video recorder according to claim 29,

wherein said information generating portion comprises a determined information generating portion for generating an unique information of said corresponding camera;

and an arbitrary information generating portion for generating an information transmitted from a distant place through network, and

the first watermark which is embedded into the image signal at said first watermark embedding portion is a robust watermark, and the second watermark which is embedded into the image signal at said second watermark embedding portion is a fragile watermark.

31. The digital video recorder according to any one of claims 28 to 30, wherein each of the watermark embedding apparatus further comprises a real-time operating portion for controlling said embedding of the watermark and said generating of the arbitrary information in real time.

32. An apparatus for authenticating a watermark-embedded image from the digital video recorder described in any one of claims 28 to 30,

an image inputting portion for receiving an image signal as a transmission through a network or a file format;

an image authenticating portion for determining authenticity of the image by calculating correlation between a watermark extracted from the digital image outputted from said image inputting portion and a watermark generated from an information for authentication of an image; and

an image authentication result output portion for outputting a authentication result of said image authenticating portion.