Video Surveillance System, Annotation And De-Annotation Modules Thereof

• US 20090310865A1
• Filed: 12/25/2008
• Published: 12/17/2009
• Est. Priority Date: 06/13/2008
• Status: Abandoned Application

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Hu, Jwu-Sheng, Jang, Lih-Guong, Huang, Yu Lun, Kuo, Chie-Chung, Tarng, Jenn Hwan, Chang, Bor-Gaung, Chen, Li-Huei
• Application Number:
  US12/344,232
• Publication Number:
  US 20090310865A1
• Time in Patent Office: Days
• US Class Current: 382/190
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A video surveillance system gets a first image from at least a video source, and extracts its image features. It embeds annotation information with at least the image features into the first image, and converts the embedded image into a second image without changing the image format. After having compressed and decompressed the second image, the system extracts the embedded information from the decompressed embedded stream to separate the image and the annotation information, thereby obtaining completely recovered annotation information after a recovery process and an image processing. Because the image format is not changed, the operations on the second image at the rear end of the system, such as compression and decompression, are not affected.

Claims

1. An video surveillance system, comprising:

an image extraction module for capturing at least a video source to obtain an original image and capturing feature information of said original image;

an image annotation module for embedding annotation information including at least said feature information into said original image, and converting said embedded image into a second image of the same format as said original image;

an image compression module for compressing said second image;

an image decompression module for decompressing said compressed second image; and

an image information de-annotation module for extracting embedded information from said decompressed second image and separating an object image from said annotation information to obtain de-annotation information.

2. The system as claimed in claim 1, wherein said annotation information is chosen from a group of environmental parameter information and feature information of said original image.

3. The system as claimed in claim 2, wherein said environmental parameter information is the information of a plurality of external sensed signals.

4. The system as claimed in claim 1, wherein said image information annotation module encodes said annotation information and embeds into said original image through an encoding technique.

5. The system as claimed in claim 1, wherein said encoding technique is an error recovery encoding technique.

6. The system as claimed in claim 1, wherein said de-annotation information is a fully recovery of said annotation information.

7. The system as claimed in claim 1, wherein said image information de-annotation module obtains said de-annotation information through an error recovery decoding technique.

8. The system as claimed in claim 1, wherein the data amount of said feature information is far less than the data amount of said original image.

9. The system as claimed in claim 1, wherein said image information annotation module further includes:

an error recovery processing unit for encoding said annotation information into embedded information;

an image processing unit for computing an embeddable information capacity of said original image through processing said original image; and

an annotation unit for embedding L copies of said embedded information into said original image, L is an embedded information multiple, and converting said embedded image into said second image.

10. The system as claimed in claim 9, wherein said embeddable information capacity is an information capacity to ensure the integrity of said embedded information when embedded.

11. The system as claimed in claim 9, wherein said embedded information multiple L depends on said embeddable information capacity, length of said embedded information and a compression ratio.

12. An image information annotation module, comprising:

an error recovery processing unit for encoding annotation information including at least feature information of an original image into embedded information;

an image processing unit for computing an embeddable information capacity of said original image; and

an annotation unit for embedding L copies of said embedded information into said original image, L is an embedded information multiple, and converting said embedded image into a second image.

13. The module as claimed in claim 12, wherein said embedded information multiple L depends on said embeddable information capacity, length of said embedded information and a compression ratio.

14. The module as claimed in claim 12, wherein data amount of said L copies of said embedded information is less than said embeddable information capacity.

15. An image de-annotation module, comprising:

a de-annotation unit for extracting an embedded information from an embedded stream and obtaining de-annotation information via error recovery processing, said de-annotation information being a fully recovery of annotation information; and

an image processing unit for separating said de-annotation information from an object image through image processing.

16. An image information annotation method, comprising:

embedding annotation information including at least feature information of an original image into said original image; and

converting said embedded image into a second image of the same format as said original image.

17. The method as claimed in claim 16, wherein said feature information of said original image is combined with environmental parameter information to form said annotation information and then said annotation information is encoded as embedded information.

18. The method as claimed in claim 16, said method encodes said annotation information as embedded information through an error recovery encoding technique and a threshold scheme.

19. The method as claimed in claim 17, wherein L copies of said embedded information are embedded into said original image, where L is an embedded information multiple and depends on an embeddable information capacity, length of said embedded information and a compression ratio.

20. An image de-annotation method, comprising:

extracting embedded information from an embedded stream;

obtaining de-annotation information from said extracted embedded information, said de-annotation information being a full recovery of annotation information; and

separating an object image from said de-annotation information through image processing.

21. The method as claimed in claim 20, wherein said de-annotation information includes at least feature information of said object image.

22. The method as claimed in claim 21, wherein said de-annotation information further includes environmental parameter information.

23. The method as claimed in claim 22, wherein said environmental parameter information is a plurality of external sensed signals.