Photographing device and method for obtaining photographic image having image vibration correction

• US 7,468,743 B2
• Filed: 04/26/2004
• Issued: 12/23/2008
• Est. Priority Date: 05/30/2003
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Washisu, Koichi
• Primary Examiner(s): Ye; Lin
• Assistant Examiner(s): WHIPKEY, JASON T
• Application Number:
  US10/831,272
• Publication Number:
  US 20040239775A1
• Time in Patent Office: 1,702 Days
• Field of Search: 348/208.4, 348/208.6, 348/208.99, 348/208.1, 348/208.3, 348/208.14, 382/103
• US Class Current: 348/208.1
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 23/6842 by controlling the scanning position, e.g. windowing
• CPC Class Codes: H04N 23/6845 by combination of a plurality of images sequentially taken
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors

Abstract

A photographing device comprises a detecting unit for extracting at least one characteristic point in each image of multiple images and detecting movement of the characteristic point on another image as to a characteristic point on a reference image; a coordinate converting unit for performing coordinates conversion of the other image so as to match the characteristic point on the other image with the characteristic point on the reference image based on the detected results of the detecting unit; a synthesizing unit for synthesizing the reference image and the other image subjected to coordinates conversion by the coordinate converting unit; a determining unit for determining whether or not the characteristic points from the multiple images acquired by the image sensor can be extracted by the detecting unit; and a warning unit for warning users when the determining unit cannot extract characteristic points. A user-friendly photographing device can thus be provided.

Claims

1. A photographing device comprising:

a switch that starts a photographing operation;

an image sensor that continuously outputs a plurality of images before and after turning on the switch;

an area setting unit that sets an area on the plurality of images obtained by the output of the image sensor before turning on the switch, according to the distance to a subject;

a determining unit that determines, within the area set by the area setting unit on the plurality of images obtained by the output of the image sensor before turning on the switch, whether or not a movement vector between the plurality of images can be detected; and

a movement vector detecting unit that, in a case where the determining unit determines that the movement vector can be detected, sets the area set by the area setting unit on the plurality of images obtained before turning on the switch onto the plurality of images obtained after turning on the switch, and detects a movement vector between the plurality of images obtained after turning on the switch.

2. A photographing device according to claim 1, wherein the determining unit extracts a characteristic point in the area set by the area setting unit on the plurality of images obtained by output of the image sensor before turning on the switch, so as to determine whether a movement vector of the characteristic point between the plurality of images can be detected, and

wherein the movement vector detecting unit sets, in a case where the determining unit determines that the movement vector can be detected, the area set by the area setting unit on the plurality of images obtained before turning on the switch onto the plurality of images obtained after turning on the switch, and detects the movement vector of the characteristic point between the plurality of images obtained after turning on the switch in the set area.

3. A photographing device according to claim 1, further comprising

a coordinate converting unit that performs coordinate conversion among the plurality of images obtained after turning on the switch, by using a detection result of the movement vector detecting unit, and

a synthesizing unit that synthesizes at least the plurality of images which have been subjected to coordinate conversion by the coordinate converting unit so as to obtain one photographing image.

4. A control method for a photographing device having a switch to start a photographing operation and an image sensor which continuously outputs a plurality of images before and after turning on the switch, the control method comprising:

an area setting step for setting an area on the plurality of images obtained by the output of the image sensor before turning on the switch, according to a subject distance;

a determining step for determining, within the area set in the area setting step on the plurality of images obtained by the output of the image sensor before turning on the switch, whether or not a movement vector between the plurality of images can be detected; and

a movement vector detecting step for, in a case where the movement vector can be detected in the determining step, setting the area set in the area setting step on the plurality of images obtained before turning on the switch onto the plurality of images obtained after turning on the switch, and detecting a movement vector between the plurality of images obtained after turning on the switch.