Method and apparatus for compressing image information

• US 6,937,651 B1
• Filed: 06/22/1999
• Issued: 08/30/2005
• Est. Priority Date: 06/29/1998
• Status: Active Grant

• Current Assignee: Novartis Ag, Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Brill, Frank Z., Flinchbaugh, Bruce E.
• Primary Examiner(s): Vo, Tung T.
• Application Number:
  US09/338,202
• Time in Patent Office: 2,261 Days
• Field of Search: H04/B00.1/66, 348/143, 348/146, 348/149, 348/150, 348/151, 348/152, 348/155, 348/159, 348/160, 348/169, 348/140, 348/141, 382/118, 382/115, 382/116, 375/240.01, 375/240
• US Class Current: 375/240
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19691 Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system (10) includes an image detector (12) which is a video camera, and which detects and outputs a succession of video images of a selected subject. A technique for processing these images involves preparing compressed image information. The compressed image information includes a first detected image (FIG. 2A) that serves as a reference image, includes information (FIG. 2G) identifying regions of subsequent detected images that differ from the first image, and excludes at least a portion of each of the subsequent images. The information identifying regions of subsequent detected images is free of contrast information for a substantial portion of each of those regions. The compressed image information for a given image is decompressed by displaying the reference image and by modifying the displayed reference image based on the information identifying differences from the reference image.

Claims

1. A method of compressing video information comprising the steps of:

detecting a time series of images of a selected view;

storing a reference image of the selected view;

preparing compressed image information including the reference image and a time series of compressed images, each compressed image corresponding to a difference between a corresponding image of the time series and the reference image, each compressed image free of contrast information;

storing the compressed image information in a non-volatile storage medium; and

displaying the compressed image information in a time series of display images, each display image including of a corresponding compressed image free of contrast information overlain upon corresponding pixels of the reference image in a solid color.

2. The method of claim 1, wherein:

said step of preparing compressed image information includes;

sub-sampling the reference image thereby forming a sub-sampled reference image,

sub-sampling each image of the time series of images thereby forming a time series of sub-sampled images,

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the sub-sampled reference image and the corresponding pixel of time series of sub-sampled images, and

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold.

3. The method of claim 1, wherein:

said step of preparing compressed image information includes;

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

sub-sampling the absolute difference image thereby forming a sub-sampled absolute difference image, and

thresholding the sub-sampled absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold.

4. The method of claim 1, wherein:

said step of preparing compressed image information includes;

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold, and

determining an outline of the thresholded absolute difference image between pixels having the first value and pixels having the second value.

5. The method of claim 1, further comprising the step of:

transmitting the compressed image information to a remotely located computer.

6. A method of compressing video information comprising the steps of:

detecting a time series of images of a selected view;

storing a reference image of the selected view;

preparing compressed image information including the reference image and a time series of compressed images, each compressed image corresponding to a difference between a corresponding image of the time series and the reference image, each compressed image free of contrast information;

transmitting the compressed image information to a remotely located computer; and

displaying the compressed image information in a time series of display images, each display image including of a corresponding compressed image free of contrast information overlain upon corresponding pixels of the reference image in a solid color.

7. The method of claim 6, wherein:

said step of preparing compressed image information includes;

sub-sampling the reference image thereby forming a sub-sampled reference image,

sub-sampling each image of the time series of images thereby forming a time series of sub-sampled images,

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the sub-sampled reference image and the corresponding pixel of time series of sub-sampled images, and

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold.

8. The method of claim 6, wherein:

said step of preparing compressed image information includes;

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

sub-sampling the absolute difference image thereby forming a sub-sampled absolute difference image, and

thresholding the sub-sampled absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold.

9. The method of claim 6, wherein:

said step of preparing compressed image information includes;

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold, and

determining an outline of the thresholded absolute difference image between pixels having the first value and pixels having the second value.

10. The apparatus of claim 6, wherein:

said computer is further programmed to prepare said compressed image information by

determining if an object corresponds to a person,

selecting an upper portion of the object as the first region if the object is determined to be a person, and

selecting a lower portion of the object exclusive of the upper portion as the second region if the object is determined to be a person.

11. A method of compressing video information comprising the steps of:

detecting a time series of images of a selected view;

storing a reference image of the selected view;

preparing compressed image information including the reference image and a time series of compressed images by

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold, and

determining an outline of the thresholded absolute difference image between pixels having the first value and pixels having the second value.

12. The method of claim 11, further including the step of:

displaying the compressed image information in a time series of display images, each display image including of a corresponding compressed image overlain upon the reference image in a solid color.

13. The method of claim 11, further comprising the step of:

storing the compressed image information in a non-volatile memory.

14. The method of claim 11, further comprising the step of:

transmitting the compressed image information to a remotely located computer.

18. The method of claim 11, wherein:

said step of determining if an identified object corresponds to a person includes

determining a bottom location of the object within the corresponding image of the time series of images,

determining a top of the object within the corresponding image of the time series of images,

estimating a height of the object from the bottom location, predetermined geometry of the selected view, and the top of the object,

determining the object to be a person if the estimated height is within a predetermined range of heights.

15. A method of compressing video information comprising the steps of:

detecting a time series of images of a selected view;

storing a reference image of the selected view;

preparing compressed image information including the reference image and a time series of compressed images by;

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold,

identifying within each of said time series of images each object of a contiguous region of pixels which differ from corresponding pixels of the reference image, and

forming a compressed image for at least one identified object having a first region consisting of pixels of the absolute difference image and a second region of pixels of the thresholded absolute difference image.

16. The method of claim 15, further including the step of:

displaying the compressed image information in a time series of display images, each display image including of a corresponding compressed image for the at least one identified object overlain upon corresponding pixels of the reference image, the first region in a plurality of colors and the second region in a solid color.

17. The method of claim 15, wherein:

said step of preparing compressed image information includes

determining if an identified object corresponds to a person,

selecting an upper portion of the object as the first region if the object is determined to be a person, and

selecting a lower portion of the object exclusive of the upper portion as the second region if the object is determined to be a person.

19. An apparatus for compressing video information comprising:

an image detector generating a time series of images of a selected view;

a non-volatile memory;

a display device; and

a computer connected to said image detector, said non-volatile memory and said display device, said computer programmed to

store a reference image of the selected view in said non-volatile memory,

generate compressed image information including said reference image and a time series of compressed images, each compressed image corresponding to a difference between a corresponding image of said time series and said reference image, each compressed image free of contrast information,

store said compressed image information in said non-volatile memory, and

display the compressed image information in a time series of display images via said display device, each display image including of a corresponding compressed image free of contrast information overlain upon corresponding pixels of the reference image in a solid color.

20. The apparatus of claim 19, wherein:

said computer is programmed to prepare said compressed image information by

sub-sampling the reference image thereby forming a sub-sampled reference image,

sub-sampling each image of the time series of images thereby forming a time series of sub-sampled images,

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the sub-sampled reference image and the corresponding pixel of time series of sub-sampled images, and

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold.

21. The apparatus of claim 19, wherein:

said computer is programmed to prepare said compressed image information by

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

sub-sampling the absolute difference image thereby forming a sub-sampled absolute difference image, and

thresholding the sub-sampled absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold.

22. The apparatus of claim 19, wherein:

said computer is programmed to prepare said compressed image information by

forming an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

thresholding the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold, and

determining an outline of the thresholded absolute difference image between pixels having the first value and pixels having the second value.

23. The apparatus of claim 19, wherein:

said computer is further programmed to transmit the compressed image information to a remotely located computer.

25. The apparatus of claim 19, further comprising:

a display device; and

said computer is further programmed to

display the compressed image information in a time series of display images via said display device, each display image including of a corresponding compressed image for the at least one identified object overlain upon corresponding pixels of the reference image, the first region in a plurality of colors and the second region in a solid color.

24. An apparatus for compressing video information comprising:

an image detector generating a time series of images of a selected view;

a non-volatile memory; and

a computer connected to said image detector and said non-volatile memory, said computer is programmed to

form an absolute difference image from the absolute difference of an image attribute between each pixel of the reference image and the corresponding pixel of time series of images,

threshold the absolute difference image by assigning a first value to each pixel absolute difference less than a predetermined threshold and a second value different from the first value to each pixel absolute difference greater than the predetermined threshold,

identify within each of said time series of images each object of a contiguous region of pixels which differ from corresponding pixels of the reference image, and

form a compressed image for at least one identified object having a first region consisting of pixels of the absolute difference image and a second region of pixels of the thresholded absolute difference image.

26. The apparatus of claim 24, wherein:

said computer is further programmed to transmit the compressed image information to a remotely located computer.