Movement detecting apparatus with feature point extractor based on luminance gradient in current frame

• US 6,650,362 B1
• Filed: 03/18/1999
• Issued: 11/18/2003
• Est. Priority Date: 09/20/1996
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Akagi, Hiroshi, Nakamura, Yasuhisa, Kitamura, Yoshihiro
• Primary Examiner(s): Vu, Ngoc-Yen, VU, NGOC YEN T
• Application Number:
  US09/269,033
• Time in Patent Office: 1,706 Days
• Field of Search: H04/N.5232, H04/N.5228, 348/154, 348/155, 348/169, 348/207.99, 348/208.99, 348/208.1, 348/208.4, 348/208.6, 348/208.12, 348/208.13, 348/208.14, 348/222.1, 382/291, 382/292, 382/298-301, 382/190, 382/229
• US Class Current: 348/222.1
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

In connection with the detection of an amount of movement of an image such as a document image having a small gradient of brightness, it has been difficult to detect the amount by a representative point method, and a block matching method requires much time. An image (F1) at a time (T1), which has been imaged by moving an imaging section (1), is taken into a memory (2) and a feature point extracting section (3), where feature points of the image (F1) are extracted, and an image (F2) at a start time (T2) of the subsequent frame is taken in the memory (2) and the feature point extracting section (3). A correlation operating section (5) operates feature points of the image (F2) and the image (F1) in an area designated by a search area deciding section (4) to output an amount of movement.

Claims

1. A movement detecting apparatus which detects an amount of movement by storing document images inputted in time sequence, comprising:

feature point extracting means for extracting feature points of spots having a large change in brightness from a document image of a current frame, the feature point extracting means determining whether to extract a feature point from the document image of the current frame based on at least whether a luminance gradient, associated with the feature point and based upon a plurality of neighboring pixels in the current frame, exceeds a threshold value, so that feature points having respective large changes in brightness relative to neighboring pixels resulting in said threshold value being exceeded are extracted and thus selected for use in a correlation process by a correlation operation means, but feature points not having respective large changes in brightness relative to neighboring pixels and thus not exceeding the threshold value are not extracted for use in the correlation process by the correlation operation means;

search area deciding means for deciding a predetermined area of a document image of a subsequent frame as a search area for correlation operation; and

the correlation operation means for taking a correlation between an extracted feature point that was extracted by the extracting means and each pixel within the search area.

2. The movement detecting apparatus of claim 1, further comprising imaging means for inputting images in time sequence.

3. The movement detecting apparatus of claim 1, wherein the search area deciding means decides the search area on the basis of an amount of movement obtained from an image of a previous frame and the image of the current frame.

4. The movement detecting apparatus of claim 1, wherein the feature point extracting means extracts a feature point of a spot having a large change in brightness from a plurality of areas in the image of the current frame in which coordinates in one direction coincides with each other, the search area deciding means decides the search area for the correlation operation per area of an image of a subsequent frame and the correlation operation means implements the correlation operation per area.

5. The apparatus of claim 1, wherein the feature point extracting means comprises a line memory for reading neighboring pixels concurrently from the current frame, and an adder-subtracter for determining the luminance gradient associated with the feature point based on the neighboring pixels from the current frame.

6. A movement detecting apparatus which detects an amount of movement by storing document images inputted in time sequence, the apparatus comprising:

a feature point extractor for extracting a feature point having a change in brightness from a document image of a current frame, wherein the feature point extractor determines whether to extract the feature point from the document image of the current frame based on at least whether a luminance gradient associated with the feature point and based upon a plurality of neighboring pixels in the current frame exceeds a threshold value, so that feature points having respective large changes in brightness relative to neighboring pixels resulting in said threshold value being exceeded are extracted and thus selected for use in a correlation process by a correlation device, but feature points not having respective large changes in brightness relative to neighboring pixels and thus not exceeding the threshold value are not extracted for use in the correlation process by the correlation device;

a search area deciding device for deciding a predetermined area of a document image of a subsequent frame as a search area for a correlation operation; and

a correlation device for taking a correlation between a feature point extracted by the feature point extractor and each pixel within the search area.

7. The apparatus of claim 6, wherein the feature point extractor comprises a line memory for reading neighboring pixels concurrently from the current frame, and an adder-subtracter for determining the luminance gradient associated with the feature point based on the neighboring pixels from the current frame.

8. The apparatus of claim 7, wherein the feature point extractor further comprises an absolute value computing unit whose output is received by a comparator that determines whether the luminance gradient exceeds the threshold value.

9. The apparatus of claim 6, wherein the search area deciding device decides the search area on the basis of an amount of movement obtained from an image of a previous frame and the image of the current frame.