Motion detection apparatus and motion detection method

• US 6,125,145 A
• Filed: 12/23/1996
• Issued: 09/26/2000
• Est. Priority Date: 12/28/1995
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Koyanagi, Masakazu, Hosonuma, Naoyasu, Tomitaka, Tadafusa, Suito, Taro
• Primary Examiner(s): Kelley, Chris S.
• Assistant Examiner(s): Philippe, Gims
• Application Number:
  US08/771,678
• Time in Patent Office: 1,373 Days
• Field of Search: 348/699, 348/169, 348/170, 348/171, 348/172, 348/152, 348/156, 348/161, 348/129, 348/131, 348/138, 348/142, 348/153, 348/154, 348/155, 348/130, 348/407, 348/412, 348/413 , 348/415, 348/416, 348/413.1, 382/107, 375/240, 375/240.16
• US Class Current: 375/240.16
• CPC Class Codes: G06T 7/254 involving subtraction of images

Abstract

A motion detection system for detecting motion in input images. One of the input images is stored for use as a reference image for motion detection processing. The reference image is updated according to any one of a multiple of possible updating modes. Images input after establishment of the reference image are compared to the reference image and the detection of motion in the input images is based on the comparison. The interval in which motion in the input images is detected is extended according to a predetermined extension time.

Claims

1. A motion detection apparatus for detecting motion of an inputted image, comprising:

reference image storage means for storing the image as a reference image to be used as a reference for detection of motion;

updating means for updating the reference image stored in said reference image storage means, said updating means being operable in at least three alternative updating modes;

an unconditional updating mode in which the reference image is periodically updated, a conditional updating mode in which the reference image is periodically updated until motion is detected whereupon updating of the reference image is inhibited, and an updating inhibition mode in which the reference image is not updated;

current image storage means for storing an image inputted now as a current image;

motion detection means for comparing the current image stored in said current image storage means with the reference image stored in said reference image storage means and detecting motion of the image based on a result of the comparison; and

extension means for extending an interval within which motion of the image is detected by said motion detection means by a predetermined extension time.

2. A motion detection apparatus according to claim 1, further comprising extension time setting means for setting the predetermined extension time.

3. A motion detection apparatus according to claim 1, further comprising updating periodical setting means for setting an updating period of the reference image by said updating means.

4. A motion detection method for detecting motion of an inputted image, comprising the steps of:

storing an image inputted as a reference image to be used as a reference for detection of motion;

storing an inputted image as a current image;

comparing the reference image and the current image with each other and detecting motion of the image based on a result of the comparison;

extending an interval within which motion of the image is detected by a predetermined time; and

updating the reference image according to one of at least three alternative updating procedures;

periodically updating the reference image;

periodically updating the reference image until motion is detected whereupon updating of the reference image is inhibited, and not updating the reference image.

5. A motion detection apparatus for detecting motion of an inputted image, comprising:

reference image storage means for storing the image as a reference image to be used as a reference for detection of motion;

updating means for updating the reference image stored in said reference image storage means, said updating means being operable in at least three alternative updating modes;

an unconditional updating mode in which the reference image is periodically updated, a conditional updating mode in which the reference image is periodically updated until motion is detected whereupon updating of the reference image is inhibited, and an updating inhibition mode in which the reference image is not updated;

current image storage means for storing an image inputted now as a current image;

motion detection means for comparing the current image stored in said current image storage means with the reference image stored in said reference image storage means and detecting motion of the image based on a result of the comparison; and

selection means for selecting an updating method of the reference image by said updating means from among a plurality of methods.

6. A motion detection apparatus according to claim 5, wherein when the updating means is operating in the unconditional updating mode the reference image is periodically updated by replacing the reference image with the current image, and when the updating means is operating in the conditional updating mode the reference image is periodically updated by replacing the reference image with the current image until motion is detected.

7. In a motion detection method for a motion detection apparatus which includes reference image storage means for storing an inputted image as a reference image to be used as a reference for detection of motion, updating means for updating the reference image stored in said reference image storage means, current image storage means for storing an image inputted now as a current image, and motion detection means for comparing the current image stored in said current image storage means with the reference image stored in said reference image storage means and detecting motion of the image based on a result of the comparison, the improvement wherein

an updating method of the reference image by said updating means is selectable from among at least three updating methods:

an unconditional updating method in which the reference image is periodically updated, a conditional updating method in which the reference image is periodically updated until motion is detected whereupon updating of the reference image is inhibited, and an updating inhibition method in which the reference image is not updated.

8. A motion detection apparatus for detecting motion of an inputted image, comprising:

reference image storage means for storing the image as a reference image to be used as a reference for detection of motion;

updating means for updating the reference image stored in said reference image storage means, said updating means being operable in at least three updating modes;

an unconditional updating mode in which the reference image is periodically updated, a conditional updating mode in which the reference image is periodically updated until motion is detected whereupon updating of the reference image is inhibited and an updating inhibition mode in which the reference image is not updated;

current image storage means for storing an image inputted now as a current image;

brightness information comparison means for comparing brightness information regarding brightness of the current image stored in said current image storage means and the reference image stored in said reference image storage means to each other;

color information comparison means for comparing color information regarding colors of the current image stored in said current image storage means and the reference image stored in said reference image storage means to each other; and

motion detection means for detecting motion of the image based on results of the comparison by both of said brightness information comparison means and said color information comparison means.

9. A motion detection apparatus according to claim 8, wherein the color information includes a hue of a color of each of pixels which form the reference image or the current image.

10. A motion detection apparatus according to claim 8, wherein the color information includes information of whether a color of each of pixels which form the reference image or the current image is a chromatic color or an achromatic color.

11. A motion detection apparatus according to claim 10, further comprising saturation detection means for detection a saturation of each of pixels which form the reference image or the current image, and chromatic/achromatic color discrimination means for discriminating based on the saturation detected by said saturation detection means whether the color of each of the pixels which form the reference image or the current image is a chromatic color or an achromatic color.

12. A motion detection apparatus according to claim 8, further comprising imaging means for imaging an object to be imaged and outputting an image signal corresponding to the image, and wherein an exposure state of said image is fixed to a state for imaging of the reference image for a time until the reference image stored in said reference image storage means is updated by said updating means.

13. A motion detection apparatus according to claim 8, further comprising motion detection range setting means for setting a range within which motion of the image is to be detected, and wherein said motion detection means detects motion within the range set by said motion detection range setting means.

14. A motion detection apparatus according to claim 13, further comprising range selection means for selecting, when a plurality of ranges are set by said motion detection range setting means, whether the plurality of ranges should be treated as independent ranges of each other or as a single range.

15. A motion detection apparatus according to claim 8, wherein said brightness information comparison means calculates a brightness difference value which is a difference in brightness information between the reference image and the current image, and said color information comparison means calculates a color difference value which is a difference in color information between the reference image and the current image, and besides said motion detection means detects motion of the image based on both of the brightness difference value and the color difference value.

16. A motion detection apparatus according to claim 15, wherein said motion detection means detects motion of the image by detecting, based on a relationship in magnitude between the brightness difference value and a predetermined threshold value, whether each of the pixels which form the image exhibits a variation.

17. A motion detection apparatus according to claim 16, further comprising threshold value setting means for setting the predetermined threshold value.

18. A motion detection apparatus according to claim 16, wherein said motion detection means discriminates whether a variation is detected with pixels around the pixel with which a variation has been detected, and determines based on a result of the discrimination that the pixel with which the variation has been detected does not exhibit the variation.

19. A motion detection apparatus according to claim 15, wherein said motion detection means detects motion of the image by detecting, based on a relationship in magnitude between the color difference value and a predetermined threshold vale, whether or not each of the pixels which form the image exhibits a variation.

20. A motion detection apparatus according to claim 19, further comprising threshold value setting means for setting the predetermined threshold value.

21. A motion detection apparatus according to claim 19, wherein said motion detection means discriminates whether a variation is detected with pixels around the pixel with which a variation has been detected, and determines based on a result of the discrimination that the pixel with which the variation has been detected does not exhibit the variation.

22. A motion detection apparatus according to claim 8, where said motion detection means detects, based on results of the comparison by both of said brightness information comparison means and said color information comparison means, whether each of pixels which form the image exhibits a variation, and discriminates, based on a relationship in magnitude between an area of a region formed by those of the picture elements with which a variation has been detected and a predetermined area, whether or not motion is involved in the region.

23. A motion detection apparatus according to claim 22, further comprising area setting means for setting the predetermined area.

24. A motion detection apparatus according to claim 8, wherein said motion detection means detects, based on results of the comparison by both of said brightness information comparison means and said color information comparison means, whether each of pixels which form the image exhibits a variation, and outputs, when a variation of a pixel is still detected after a predetermined first interval elapses after detection of a variation of the pixel is started, information representing that motion of the image has been detected.

25. A motion detection apparatus according to claim 24, wherein said motion detection means stops outputting of the information representing that motion of the image has been detected if the variation of the image is not detected any more after lapse of a second interval after it becomes, after detection of a variation of the pixel is started, that the variation is not detected any more.

26. A motion detection apparatus according to claim 8, further comprising display means for displaying a result of the motion detection by said motion detection means in a superimposed state with the image.

27. A motion detection apparatus according to claim 26, wherein said display means is capable of setting whether or not a result of the motion detection by said motion detection means should be displayed.

28. A motion detection apparatus according to claim 8, further comprising outputting means for outputting a result of the motion detection by said motion detection means to the outside.

29. A motion detection method for detecting motion of an inputted image, comprising the steps of:

storing the image as a reference image to be used as a reference for detection of motion and storing an image inputted now as a current image;

updating the reference image according to one of at least three alternative updating methods;

an unconditional updating method in which the reference image is periodically updated, a conditional updating method in which the reference image is periodically updated until motion is detected whereupon updating of the reference image is inhibited, and an updating inhibition method in which the reference image is not updated;

comparing brightness information regarding brightness of the reference image and the current image with each other and comparing color information regarding a color between the reference image and the current image with each other; and

detecting motion of the image based on both results of the comparison.