Motion detection and estimation apparatus and method thereof

• US 5,488,430 A
• Filed: 12/22/1992
• Issued: 01/30/1996
• Est. Priority Date: 12/23/1991
• Status: Expired due to Term

• Current Assignee: Goldstar Jewellery LLC
• Original Assignee: Goldstar Jewellery LLC
• Inventors: Hong, Sung H.
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US07/995,032
• Time in Patent Office: 1,134 Days
• Field of Search: 348/699, 348/700, 348/416
• US Class Current: 348/699
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

Motion detection and motion estimation apparatus and method thereof. Motion detection becomes correct by taking horizontal/vertical changes of the incoming image into account. Also, motion direction and motion magnitude are detected and motion estimation can be made. The apparatus uses horizontal/vertical difference signals as certain critical values for motion detection judgement, detects left/right motion in the horizontal direction and up/down motion in the vertical direction by performing the exclusive-OR of horizontal/vertical difference signals and frame difference signals, and makes horizontal/vertical motion estimation possible by using a ratio of horizontal/vertical signal sums and frame difference signal sums with respect to a K×3 window.

Claims

1. Motion detection apparatus, comprising:

motion region detection means for comparing absolute values of horizontal and vertical difference signal sums with respect to repective incoming signals and 1 frame-delayed signals and certain critical values with frame difference signals in order to detect a motion region;

motion direction detection means for performig an exclusive OR of frame difference signal sign bits and sum signal sign bits of horizontal and vertical difference signals with respect to respective incoming signals and 1 frame-delayed signals in order to detect left/right motion direction and up/down motion direction; and

motion magnitude detection means for detecting a horizontal motion magnitude and a vertical motion magnitude by ratios of frame difference signal absolute value sums and horizontal/vertical difference signal absolute value sums.

2. Motion detection apparatus as claimed in claim 1, wherein the in motion dection signals of the motion region detection means and left/light/up/down motion direction detection signals of the motion direction detection means are ANDed so that information on horizontal/vertical signals is obtained through the motion magnitude detection means.

3. Motion detection apparatus, comprising;

motion region detection means for comparing absolute values of horizontal and vertical difference signal sums with respect to respective incoming signals and 1 frame-delayed signals and certain critical values with frame difference signals in order to detect a motion region, wherein the motion region detection means includes,

an interframe vertical difference signal absolute value generating section for converting vertical difference signal sums with respect to incoming image signals and 1 frame-delayed image signals to absolute values;

an interframe horizontal difference signal absolute value generating section for converting horizontal diffierence signal sums with respect to incoming image signals and 1 frame-delayed image signals to absolute values;

a frame difference signal absolute value generating section for obtaining frame difference signals with respect to incoming image signals and converting them to absolute values; and

a motion region judging section for comparing the frame difference signal absolute value with certain critical values, and comparing the frame difference signal absolute values with horizontal/vertical difference signal sum absolute values, in order to judge whether or not motions exist;

motion direction detection means for performing an exclusive OR of frame difference signal sign bits and sum signal sign bits of horizontal and vertical difference with respect to respective incoming signals and 1 frame-delayed signals in order to detect left-right motion direction and up/down motion direction; and

motion magnitude detection means for detecting a horizontal motion magnitude and a vertical motion magnitude by ratios of frame difference signal absolute value sums and horizontal/vertical difference signal absolute value sums.

4. Motion detection apparatus as claimed in claim 3, wherein the interframe vertical difference signal absolute value generating section comprises:

a 1st vertical difference signal generating element for generating vertical difference signals with respect to incoming image signals;

a 2nd vertical difference signal generating element for generating vertical difference signals with respect to incoming 1 frame-delayed signals;

an adding element for adding signals from the 1st and 2nd vertical difference signal generating elements; and

an absolute value generating element for generating absolute values of the added signals.

5. Motion detection apparatus as claimed in claim 3, wherein the interframe horizontal difference signal absolute value generating section comprises:

a 1st horizontal difference signal generating element for generating horizontal difference signals with respect to incoming image signals;

a 2nd horizontal difference signal geerating element for generating horizontal difference signals with respect to incoming 1 frame-delayed signals;

an adding element for adding signals from the 1st and 2nd horizontal difference signal generating elements; and

an absolute value generating element for generating absolute values of the added signals.

6. Motion detection apparatus as claimed in claim 3, wherein the motion region judging section comprises;

1st comparating element for comparing outputs of the frame difference signal absolute value generating section with certain critical values;

a 2nd comparating element for comparing the frame difference signal absolute values with outputs of the interframe vertical difference signal absolute value generating section;

a 3rd comparating element for comparing outputs of the interframe horizontal difference signal absolute value generating section with outputs of the frame difference signal absolute value generating section; and

an OR gate element for performing a logic sum of outputs of the 1st, 2nd and 3rd comparating elements in order to detect a motion region.

7. Motion detection apparatus, comprising;

motion region detection means for comparing absolute values of horizontal and vertical difference signal sums with respect to respective incoming signals and 1 frame-delayed signals and certain critical values with frame difference signals in order to detect a motion region,

motion direction means for performing an exclusive OR of frame difference signal sign bits and sum signal sign bits of horizontal and vertical difference signals with respect to respective incoming signals and 1 frame-delayed signals in order to detect left-right motion direction and up/down motin direction;

wherein the motion direction detection means includes;

an interframe vertical difference signal generating section for adding vertical difference signals with respect to respective incoming image signals and 1 frame-delayed image signals;

an interframe horizontal difference signal generating section for adding horizontal difference signals with respect to respective incoming image signals and 1 frame-delayed image signals;

a frame difference signal generating section for generating frame difference signals with respect to incoming image signals;

a motion direction judging section for performing an exclusive OR with respect to signals from the frame difference signal generating section, interframe vertical difference signal generating section and interframe horizontal difference signal generating section in order to detect whether or not motions in up, down, left and right directions exist; and

motion magnitude means for detecting a horizontal motion magnitude and a vertical motion magnitude by ratios of frame difference signal absolute value sums and horizontal/vertical difference signal absolute value sums.

8. Motion detection apparatus as claimed in claim 7, wherein the interframe vertical difference signal generating section comprises:

a 1st vertical difference signal generating element for generating vertical difference signals with respect to incoming image signals;

a 2nd vertical difference signal generating element for generating vertical difference signals with respect to 1 frame-delayed signals;

an adding element for adding signals from the 1st and 2nd vertical difference signal generating elements.

9. Motion detection apparatus as claimed in claim 7, wherein the interframe horizontal difference signal generating section comprises:

a 1st horizontal differnce signal generating element for generating horizontal difference signals with respect to incoming image signals;

a 2nd horizontal difference signal generating element for generating horizontal difference signals with respect to 1 frame-delayed signals;

an adding element for adding signals from the 1st and 2nd horizontal difference signal generating elements.

10. Motion detection apparatus as claimed in claim 7, wherein the motion direction judging section comprises:

an exclusive OR gate element for performing an exclusive OR with respect to signals from the frame difference signal generating section and the interframe horizontal difference signal generating section in order to judge whether or not motion in left right directions exist; and

an exclusive OR gate element for performing an exclusive OR with respect to signals from the frame difference signal generating section and the interframe horizontal difference signal generating section in order to judge whether or not motions in up and down directions exits.

11. Motion detection apparatus, comprising:

motion region detection means for comparing absolute values of horizontal and vertical difference signal sums with respect to respective incoming signals and 1 frame-delayed signals and certain critical values with frame difference signals in order to detect a motion region,

motion direction detection means for performing an exclusive OR of frame difference signal sign bits and sum signal sign bits of horizontal and vertical difference signals with respect to respective incoming signals and 1 frame-delayed signals in order to detect left-right motion direction and up/down motion direction;

motion magnitude detection means for detecting a horizontal motion magnitude and a vertical motion magnitude by ratios of frame difference signal absolute value sums and horizontal/vertical difference signal absolute value sums;

wherein the motion magnitude detection means includes;

a vertical difference signal absolute value generating section for generating vertical difference signal absolute values with respect to 1 line-delayed signals and 2 line-delayed signals with respect to incoming image signals and add the absolute values;

a horizontal difference signal absolute value generating section for generating horizontal difference signal absolute values with respect to incoming image signals, 1 sample-delayed signals and 2 line-delayed signals respectively with respect to the incoming image signals;

a frame difference signal generating section for obtaining frame difference signals with respect to incoming image signals, 1 line-delayed signals and 2 line-delayed signals respectively with respect to the incoming image signals;

a motion magnitude calculating section for detecting motion magnitudes by a ratio of vertical difference signal absolute value accumulation signals with respect to a K×

2 window, horizontal difference signal absolute value accumulation signals with respect to a K×

3 window and frame difference signal absolute value accumulation signals when signals come in from the vertical difference signal absolute value section, horizontal difference signal absolute value generating section and frame difference signal generating section.

12. Motion detection apparatus as claimed in claim 11, wherein the vertical difference signal absolute value generating section comprises:

a 1st vertical difference signal absolute value generating element for generating vertical difference signal absolute values with respect to incoming image signals;

a 2nd vertical difference signal absolute value generating element for generating vertical difference signal absolute values with respect to 1 line-delayed signals of incoming image signals; and

an adding element for adding outputs of the 1st and 2nd vertical difference signal absolute value generating elements.

13. Motion detection apparatus as claimed in claim 11, wherein the horizontal difference signal absolute value generating section comprises:

a 1st horizontal difference signal absolute value generating element for generating horizontal difference signal absolute values with respect to incoming image signals;

a 2nd horizontal differnce signal absolute value generating element for generating horizontal difference signal absolute values with respect to 1 line-delayed signals of incoming image signals;

a 3rd horizontal difference signal absolute value generating element for generating horizontal difference signal absolute values with respect to 2 line-delayed signals of incoming image signals; and

an adding element for adding outputs of the 1st, 2nd and 3rd horizontal difference signal absolute value generating elements and generating the added signals to the motion magnitude calculating section.

14. Motion detection apparatus as claimed in claim 11, wherein the frame difference signal generating section comprises:

a frame difference signal absolute value generating element for generating 1 frame difference signal absolute values with respect to incoming image signals;

a 1st interframe vertical difference signal absolute value generating element for generating differences between 1 line-delayed signals and 1 frame/1 line-delayed signals respectively with respect to incoming image signals and obtains absolute values of the differences;

a 2nd interframe vertical difference signal absolute value generating element for generating differences between 2 line-delayed signals and 1 frame/2 line-delayed signals respectively with respect to incoming image signals and generates absolute values of the differences; and

an adding element for adding outputs of the frame difference signal absolute value generating element, 1st and 2nd interframe vertical difference signal absolute value generators as its output.

15. Motion detection apparatus as claimed in claim 11, wherein the motion magnitude calculating section comprises:

a 1st sample accumulating element for accumulating outputs of the vertical difference signal absolute value generating section by k samples as its outputs;

a 2nd sample accumulating element for accumulating outputs of the horizontal difference signal absolute value generating section by k samples as its output;

a 3rd sample accumulating element for accumulating outputs of the frame difference signal generating section by k samples as its output; and

a dividing element for dividing outputs of the 2nd sample accumulating element by outputs of the 3rd sample accumulating in order to detect horizontal motion magnitudes; and

a dividing element for dividing outputs of the 1st sample accumulating element by outputs of the 3rd sample accumulating element in 227 order to detect vertical motion magnitudes.

16. Motion detection method comprising:

a motion region detection step which compares absolute values respective input signals and horizontal and vertical difference signal sums with respect to 1 frame-delayed signals and certain critical values with frame difference signals in order to detect a motion region;

a motion direction detection step which performs an exclusive of frame difference signal sign bits and sum signal sign bits of horizontal and vertical difference signals with respect to respective input signals and 1 frame-delayed signals in order to detect left/right motion direction and up/down motion direction; and

a motion magnitude detection steps which detects a horizontal motion magnitude with regard to a K×

3 window and a vertical motion magnitude with regard to a K×

2 window by a ratio of frame difference signal absolute value sums and horizontal/vertical difference signal absolute value sums.

17. Motion detection mehtod as claimed in claim 16, wherein the motion region detection steps comprise:

step A which generates vertical difference signals with respect to incoming signals and 1 frame-delayed signals of it respectively, adds the 2 vertical difference signals and generates absolute values of the added values;

step B which generates horizontal difference signals with respect to incoming signals and 1 frame-delayed signals of it respectively, adds the 2 horizontal difference signals and generates absolute values of the added values;

step C which obtains frame difference signals with respect to incoming image signals and converts then to absolute values; and

step D which compares outputs of the step C with certain critical values, compares outputs of the step C with those of the step A, compares output of the step B with those of the step A and ORs the compared outputs.

18. Motion detection method as claimed in claim 16, wherein the motion direction detection steps comprise:

step A which generates vertical difference signals with respect to incoming signals and 1 frame-delayed signals of it respectively and adds the 2 vertical difference signals;

step B which gnerates horizontal difference signals with respect to incoming signals and 1 frame-delayed signals of it respectively and adds the 2 horizontal difference signals;

step C which obtains frame difference signals with respect to incoming image signals; and

step D which performs an exclusive OR with respect to outputs of the step C and those of the step B in order to detect a left/right motion and performs an exclusive OR with respect to outputs of the step C and those of the step A in order to detect and up/down motion.

19. Motion detection mehtod as claimed in claim 16, wherein the motion magnitude detection steps comprise:

step A which generates vertical difference signal absolute values with respect to incoming signals and 1 frame-delayed signals of it respectively and adds outputs of the 2 vertical difference signal absolute values;

step B which generates horizontal difference signal absolute values with respect to incoming signals, 1 line-delayed signals and 2 line-delayed signals of it respectively and adds the 3 horizontal difference signal absolute values;

step C which generates 1 frame difference signal absolute values with respect to incoming image signals, generates difference signals between 1 line-delayed signals and 1 frame/1 line-delayed signals with repect to the incoming image signals respectively, obtains the difference signal absolute values, generates difference signals between 2 line-delayed signals and 1 frame/2 line-delayed signals with respect to the incoming image signals, obtains differene signal absolute values and generates sum signals of the frame difference signal absolute values, the 1st interframe vertical difference signal absolute values and the 2nd interframe vertical difference signal absolute values; and

step D which detects horizontal and vertical motion magnitudes comprises substeps of;

substep d1 which accumuates outputs of the step A by k samples;

substep d2 which accumuates outputs of the step B by k samples;

substep d3 which accumuates outputs of the step C by k samples; and

substep d4 which divides outputs of the substep d2 by outputs of substep d3 in order to detect horizontal motion magnitudes and divides outputs of the substep d1 by outputs of the substep d3 in order to detect vertical motion magnitudes.

20. Motion estimation apparatus, comprising:

a vertical difference estimation absolute value generating means for generating vertical difference signal absolute values with respect to incoming image signals, 1 line-delayed signals and 2 line-delayed signals of the incoming image signals and adding the absolute values;

a horizontal difference estimation signal absolute value generating means for generating horizontal difference signal absolute values with respect to incoming image signals, 1 line-delayed signals and 2 line-delayed signals and adding the absolute values;

a frame difference correction signal generating means for generating difference signals with respect to incoming image signals, 1 frame/1 line-delayed signals and 1 frame/2 line-delayed signals of the incoming image signals;

an estimation signal complement generating means for checking sign bits of output signals from the vertical difference estimation signal absolute value generating means, horizontal difference estimation signal absolute value generating means and frame difference correction signal generating means; and

an estimation value calculating means for accumulating input signals from the vertical difference estimation signal absolute value generating means, horizontal difference estimation signal absolute value generating means and frame difference correction signal generating means by k samples with respect to a K×

3 window in order for motion detection.

21. Motion estimation apparatus as claimed in claim 20, wherein the vertical difference estimation signal absolute value generating means comprises:

a 1st vertical difference signal absolute value generating section for generating vertical difference signal absolute values with respect to incoming image signals;

a 2nd vertical difference signal absolute value generating section for generating vertical difference signal absolute values with respect to 1 line-delayed signals of the incoming image signals;

a 3rd vertical difference signal absolute value generating section for generating vertical difference signal absolute values with respect to 2 line-delayed signals of the incoming image signals; and

an adding element for adding the 1st, 2nd and 3rd vertical difference signal absolute values.

22. Motion estimation apparatus as claimed in claim 20, wherein the horizontal difference estimation signal absolute value generating means comprises:

a 1st horizontal difference signal absolute value generating section for generating horizontal difference signal absolute values with respect to incoming image signals;

a 2nd horizontal difference signal absolute value generating section for generating horizontal difference signal absolute values with respect to 1 line-delayed signals of the incoming image signals;

a 3rd horizontal difference signal absolute value generating section for generating horizontal difference signal absolute values with respect to 2 line-delayed signals of incoming image signals; and

an adding element for adding horizontal difference signal absolute values from the 1st, 2nd and 3rd horizontal difference signal absolute value generating sections.

23. Motion estimation apparatus as claimed in claim 20, wherein the frame difference correction signal generating means comprises:

a frame difference signal absolute value generating section for generating 1 frame difference signal absolute value with respect to incoming image signals;

a 1st interframe vertical difference signal generating section for generating differences between 1 line-delayed signals and 1 frame/1 line-delayed signals with respect to the incoming image signals;

a 2nd interframe vertical difference signal generating section for generating differences between 2 line-delayed signals and 1 frame/2 line-delayed signals with respect to the incoming image signals and obtains absolute values of the differences.

24. Motion estimation apparatus as claimed in claim 20, wherein the estimation value calculating means comprises:

a 1st sample accumulating section for generating its outputs after accumulating signals from the vertical difference estimation signal absolute value generating means by k samples;

a 2sample accumulating section for generating its outputs after accumulating signals from the horizontal difference estimation signal absolute value generating means by k samples;

a 3rd sample accumulating section for generating its outputs after accumulating sums of multiplication signals of vertical difference signal signs and frame difference signals by k samples;

a 4th sample accumulating section for generating its outputs after accumulating sums of multiplication signals of horizontal difference signal signs and frame difference signals by k samples;

a dividing element for estimating a vertical motion by a ratio of sums of multiplications of frame difference signals and vertical difference signal signs from the 3rd sample accumulating section and sums of vertical difference signal absolute values from the 1st sample accumulating section; and

a dividing element for estimaqting a horizontal motion by a ratio of sums of multiplications of frame difference signals and horizontal difference signal signs from the 4th sample accumulating section and sums of horizontal difference signal absolute values from the 2nd sample accumulating section.

25. Motion estimation apparatus as claimed in claim 20, wherein the estimation signal complement generating means comprises:

a 1st complement generating section for generating sign bits of the 1st horizontal difference signals and the 1st vertical difference signals;

a 2nd complement generating section for generating sign bits of the 2nd horizontal difference signals and the 2nd vertical difference signals;

a 3rd complement generating section for generating sign bits of the 3rd horizontal difference signals and the 3rd vertical difference signals; and

adding elements for adding outputs from the 1st, 2nd and 3rd complement generating sections.

26. Motion estimation apparatus as claimed in claim 25, wherein the 1st, 2nd and 3rd complement generating sections respectively comprise:

an inverting element for inverting the horizontal difference signal signs;

a 1st complement generating element for generating complements according to outputs of the inverting element and the frame difference signals;

an inverting element for inverting the vertical difference signal signs; and

a 2nd complement generating element for generating complements according to outputs of the inverting element and the frame difference signals.

27. Motion estimation method comprises:

step A which consists of

substep a1 generating vertical difference signal absolute values with respect to incoming image signals;

substep a2 generating vertical difference signal absolute values with respect to 1 line-delayed signals of the incoming image signals;

substep a3 generating vertical difference signal absolute values with respect to 2 line-delayed signals of the incoming image signals; and

substep a4 adding the vertical difference signal absolute values of the substeps a1, a2, a3;

step B which consists of

substep b1 generating horizontal difference signal absolute values with respect to incoming image signals;

substep b2 generating horizontal difference signal absolute values with respect to 1 line-delayed signals of the incoming image signals;

substep b3 generating horizontal difference signal absolute values with respect to 2 line-delayed signals of the incoming image signals; and

sibstep a4 adding the horizontal difference signal absolute values of the substeps b1, b2, b3;

step C which generates 1 frame difference signal absolute values with respect to incoming image signals, generates difference signals between 1 line-delayed signals and 1 frame/1 line-delayed signals with respect to the incoming image signals respectively and generates absolute values of difference signals between 2 line-delayed signals and 1 frame/2 line-delayed signals with respect to the incoming image signals;

step D which generates sign bits of substeps a1, a2, sign bits of substeps a2, b2 and sign bits of substeps a3, b3 and adds output signal sign bit values;

step E which estimates horizontal and vertical motions, consisting of

substep e1 which generates its outputs after accumulating output signals of the step A by k samples;

substep e2 which generates its outputs after accumulating output signals of the step B by k samples;

substep e3 which generates its outputs after accumulating sums of mutiplications of frame difference signals and vertical difference signal signs of the substep e1 by k samples;

substep e4 which generates its outputs after accumulating sums of mutiplications of frame difference signals and horzontal difference signal signs of the substep e2 by k samples; and

substep e5 which estimates a vertical motion by a ratio of sums of multiplications of frame difference signals and vertical difference signal signs from the substep e3 and sums of vertical difference signal absolute values from the substep e1, and estimates a horizontal motion by a ration of sums of multiplications of frame difference signals and horizontal difference signal signs from the substep e4 and sums of vertical difference signal absolute values from the substep e2.